2024-03-13 08:55:46,273 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle timeout: 13 mins 2024-03-13 08:55:46,499 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d 2024-03-13 08:55:46,514 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2024-03-13 08:55:46,514 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/cluster_a0027e9f-97f8-3313-69aa-0deddba9a82b, deleteOnExit=true 2024-03-13 08:55:46,515 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2024-03-13 08:55:46,515 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/test.cache.data in system properties and HBase conf 2024-03-13 08:55:46,516 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/hadoop.tmp.dir in system properties and HBase conf 2024-03-13 08:55:46,517 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/hadoop.log.dir in system properties and HBase conf 2024-03-13 08:55:46,517 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/mapreduce.cluster.local.dir in system properties and HBase conf 2024-03-13 08:55:46,518 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/mapreduce.cluster.temp.dir in system properties and HBase conf 2024-03-13 08:55:46,518 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2024-03-13 08:55:46,638 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2024-03-13 08:55:47,025 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-03-13 08:55:47,030 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2024-03-13 08:55:47,030 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2024-03-13 08:55:47,031 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/yarn.nodemanager.log-dirs in system properties and HBase conf 2024-03-13 08:55:47,031 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-03-13 08:55:47,031 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2024-03-13 08:55:47,031 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2024-03-13 08:55:47,032 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-03-13 08:55:47,032 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/dfs.journalnode.edits.dir in system properties and HBase conf 2024-03-13 08:55:47,033 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2024-03-13 08:55:47,033 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/nfs.dump.dir in system properties and HBase conf 2024-03-13 08:55:47,034 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/java.io.tmpdir in system properties and HBase conf 2024-03-13 08:55:47,034 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/dfs.journalnode.edits.dir in system properties and HBase conf 2024-03-13 08:55:47,035 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2024-03-13 08:55:47,035 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2024-03-13 08:55:47,562 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-03-13 08:55:47,566 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-03-13 08:55:47,850 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2024-03-13 08:55:48,005 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2024-03-13 08:55:48,019 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-03-13 08:55:48,055 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2024-03-13 08:55:48,088 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/java.io.tmpdir/Jetty_localhost_36489_hdfs____3gvyjg/webapp 2024-03-13 08:55:48,214 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36489 2024-03-13 08:55:48,224 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-03-13 08:55:48,224 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-03-13 08:55:48,685 WARN [Listener at localhost/45049] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-03-13 08:55:48,757 WARN [Listener at localhost/45049] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-03-13 08:55:48,776 WARN [Listener at localhost/45049] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-03-13 08:55:48,784 INFO [Listener at localhost/45049] log.Slf4jLog(67): jetty-6.1.26 2024-03-13 08:55:48,788 INFO [Listener at localhost/45049] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/java.io.tmpdir/Jetty_localhost_37177_datanode____65lqac/webapp 2024-03-13 08:55:48,891 INFO [Listener at localhost/45049] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37177 2024-03-13 08:55:49,218 WARN [Listener at localhost/36903] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-03-13 08:55:49,238 WARN [Listener at localhost/36903] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-03-13 08:55:49,241 WARN [Listener at localhost/36903] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-03-13 08:55:49,243 INFO [Listener at localhost/36903] log.Slf4jLog(67): jetty-6.1.26 2024-03-13 08:55:49,250 INFO [Listener at localhost/36903] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/java.io.tmpdir/Jetty_localhost_38099_datanode____hdu5o2/webapp 2024-03-13 08:55:49,351 INFO [Listener at localhost/36903] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38099 2024-03-13 08:55:49,362 WARN [Listener at localhost/37591] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-03-13 08:55:49,672 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3630dc9102c69a96: Processing first storage report for DS-c16e7576-411c-4863-9a82-e8928848bc67 from datanode f20fe36f-929e-42a6-84e3-52b95f086d20 2024-03-13 08:55:49,674 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3630dc9102c69a96: from storage DS-c16e7576-411c-4863-9a82-e8928848bc67 node DatanodeRegistration(127.0.0.1:41473, datanodeUuid=f20fe36f-929e-42a6-84e3-52b95f086d20, infoPort=46499, infoSecurePort=0, ipcPort=37591, storageInfo=lv=-57;cid=testClusterID;nsid=550343527;c=1710320147643), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2024-03-13 08:55:49,674 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc1c7cabb7052182e: Processing first storage report for DS-33908dab-baab-493f-b2b0-8b37baf8169e from datanode 29a1450e-3a1a-459b-96e1-e18efacd6aa9 2024-03-13 08:55:49,674 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc1c7cabb7052182e: from storage DS-33908dab-baab-493f-b2b0-8b37baf8169e node DatanodeRegistration(127.0.0.1:35097, datanodeUuid=29a1450e-3a1a-459b-96e1-e18efacd6aa9, infoPort=38379, infoSecurePort=0, ipcPort=36903, storageInfo=lv=-57;cid=testClusterID;nsid=550343527;c=1710320147643), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2024-03-13 08:55:49,675 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x3630dc9102c69a96: Processing first storage report for DS-a11374ac-f912-4c8f-82b5-21e05b50deef from datanode f20fe36f-929e-42a6-84e3-52b95f086d20 2024-03-13 08:55:49,675 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x3630dc9102c69a96: from storage DS-a11374ac-f912-4c8f-82b5-21e05b50deef node DatanodeRegistration(127.0.0.1:41473, datanodeUuid=f20fe36f-929e-42a6-84e3-52b95f086d20, infoPort=46499, infoSecurePort=0, ipcPort=37591, storageInfo=lv=-57;cid=testClusterID;nsid=550343527;c=1710320147643), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-03-13 08:55:49,675 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc1c7cabb7052182e: Processing first storage report for DS-75b89a8e-4ff7-4792-8ade-eab6b599ac15 from datanode 29a1450e-3a1a-459b-96e1-e18efacd6aa9 2024-03-13 08:55:49,675 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc1c7cabb7052182e: from storage DS-75b89a8e-4ff7-4792-8ade-eab6b599ac15 node DatanodeRegistration(127.0.0.1:35097, datanodeUuid=29a1450e-3a1a-459b-96e1-e18efacd6aa9, infoPort=38379, infoSecurePort=0, ipcPort=36903, storageInfo=lv=-57;cid=testClusterID;nsid=550343527;c=1710320147643), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-03-13 08:55:49,757 DEBUG [Listener at localhost/37591] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d 2024-03-13 08:55:49,873 INFO [Listener at localhost/37591] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/cluster_a0027e9f-97f8-3313-69aa-0deddba9a82b/zookeeper_0, clientPort=52215, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/cluster_a0027e9f-97f8-3313-69aa-0deddba9a82b/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/cluster_a0027e9f-97f8-3313-69aa-0deddba9a82b/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2024-03-13 08:55:49,890 INFO [Listener at localhost/37591] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52215 2024-03-13 08:55:49,898 INFO [Listener at localhost/37591] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-13 08:55:49,901 INFO [Listener at localhost/37591] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-13 08:55:50,586 INFO [Listener at localhost/37591] util.FSUtils(471): Created version file at hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4 with version=8 2024-03-13 08:55:50,586 INFO [Listener at localhost/37591] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/hbase-staging 2024-03-13 08:55:50,904 INFO [Listener at localhost/37591] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2024-03-13 08:55:51,363 INFO [Listener at localhost/37591] client.ConnectionUtils(126): master/jenkins-hbase4:0 server-side Connection retries=45 2024-03-13 08:55:51,398 INFO [Listener at localhost/37591] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-13 08:55:51,398 INFO [Listener at localhost/37591] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-03-13 08:55:51,399 INFO [Listener at localhost/37591] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-03-13 08:55:51,399 INFO [Listener at localhost/37591] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-13 08:55:51,399 INFO [Listener at localhost/37591] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-03-13 08:55:51,556 INFO [Listener at localhost/37591] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2024-03-13 08:55:51,631 DEBUG [Listener at localhost/37591] util.ClassSize(228): Using Unsafe to estimate memory layout 2024-03-13 08:55:51,728 INFO [Listener at localhost/37591] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36183 2024-03-13 08:55:51,738 INFO [Listener at localhost/37591] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-13 08:55:51,741 INFO [Listener at localhost/37591] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-13 08:55:51,762 INFO [Listener at localhost/37591] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36183 connecting to ZooKeeper ensemble=127.0.0.1:52215 2024-03-13 08:55:51,804 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:361830x0, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-03-13 08:55:51,806 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:36183-0x1005c672cd60000 connected 2024-03-13 08:55:51,835 DEBUG [Listener at localhost/37591] zookeeper.ZKUtil(165): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-03-13 08:55:51,836 DEBUG [Listener at localhost/37591] zookeeper.ZKUtil(165): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-13 08:55:51,840 DEBUG [Listener at localhost/37591] zookeeper.ZKUtil(165): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-03-13 08:55:51,848 DEBUG [Listener at localhost/37591] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36183 2024-03-13 08:55:51,848 DEBUG [Listener at localhost/37591] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36183 2024-03-13 08:55:51,849 DEBUG [Listener at localhost/37591] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36183 2024-03-13 08:55:51,849 DEBUG [Listener at localhost/37591] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36183 2024-03-13 08:55:51,849 DEBUG [Listener at localhost/37591] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36183 2024-03-13 08:55:51,856 INFO [Listener at localhost/37591] master.HMaster(445): hbase.rootdir=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4, hbase.cluster.distributed=false 2024-03-13 08:55:51,925 INFO [Listener at localhost/37591] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-03-13 08:55:51,925 INFO [Listener at localhost/37591] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-13 08:55:51,925 INFO [Listener at localhost/37591] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-03-13 08:55:51,925 INFO [Listener at localhost/37591] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-03-13 08:55:51,925 INFO [Listener at localhost/37591] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-13 08:55:51,925 INFO [Listener at localhost/37591] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-03-13 08:55:51,930 INFO [Listener at localhost/37591] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-03-13 08:55:51,933 INFO [Listener at localhost/37591] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46097 2024-03-13 08:55:51,935 INFO [Listener at localhost/37591] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-03-13 08:55:51,941 DEBUG [Listener at localhost/37591] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-03-13 08:55:51,942 INFO [Listener at localhost/37591] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-13 08:55:51,944 INFO [Listener at localhost/37591] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-13 08:55:51,946 INFO [Listener at localhost/37591] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46097 connecting to ZooKeeper ensemble=127.0.0.1:52215 2024-03-13 08:55:51,950 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): regionserver:460970x0, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-03-13 08:55:51,951 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46097-0x1005c672cd60001 connected 2024-03-13 08:55:51,951 DEBUG [Listener at localhost/37591] zookeeper.ZKUtil(165): regionserver:46097-0x1005c672cd60001, quorum=127.0.0.1:52215, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-03-13 08:55:51,952 DEBUG [Listener at localhost/37591] zookeeper.ZKUtil(165): regionserver:46097-0x1005c672cd60001, quorum=127.0.0.1:52215, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-13 08:55:51,953 DEBUG [Listener at localhost/37591] zookeeper.ZKUtil(165): regionserver:46097-0x1005c672cd60001, quorum=127.0.0.1:52215, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-03-13 08:55:51,954 DEBUG [Listener at localhost/37591] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46097 2024-03-13 08:55:51,955 DEBUG [Listener at localhost/37591] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46097 2024-03-13 08:55:51,955 DEBUG [Listener at localhost/37591] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46097 2024-03-13 08:55:51,956 DEBUG [Listener at localhost/37591] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46097 2024-03-13 08:55:51,956 DEBUG [Listener at localhost/37591] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46097 2024-03-13 08:55:51,969 INFO [Listener at localhost/37591] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-03-13 08:55:51,970 INFO [Listener at localhost/37591] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-13 08:55:51,970 INFO [Listener at localhost/37591] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-03-13 08:55:51,971 INFO [Listener at localhost/37591] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-03-13 08:55:51,971 INFO [Listener at localhost/37591] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-13 08:55:51,971 INFO [Listener at localhost/37591] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-03-13 08:55:51,971 INFO [Listener at localhost/37591] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-03-13 08:55:51,973 INFO [Listener at localhost/37591] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46627 2024-03-13 08:55:51,973 INFO [Listener at localhost/37591] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-03-13 08:55:51,975 DEBUG [Listener at localhost/37591] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-03-13 08:55:51,975 INFO [Listener at localhost/37591] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-13 08:55:51,977 INFO [Listener at localhost/37591] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-13 08:55:51,980 INFO [Listener at localhost/37591] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46627 connecting to ZooKeeper ensemble=127.0.0.1:52215 2024-03-13 08:55:51,983 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): regionserver:466270x0, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-03-13 08:55:51,984 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46627-0x1005c672cd60002 connected 2024-03-13 08:55:51,985 DEBUG [Listener at localhost/37591] zookeeper.ZKUtil(165): regionserver:46627-0x1005c672cd60002, quorum=127.0.0.1:52215, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-03-13 08:55:51,986 DEBUG [Listener at localhost/37591] zookeeper.ZKUtil(165): regionserver:46627-0x1005c672cd60002, quorum=127.0.0.1:52215, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-13 08:55:51,986 DEBUG [Listener at localhost/37591] zookeeper.ZKUtil(165): regionserver:46627-0x1005c672cd60002, quorum=127.0.0.1:52215, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-03-13 08:55:51,987 DEBUG [Listener at localhost/37591] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46627 2024-03-13 08:55:51,987 DEBUG [Listener at localhost/37591] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46627 2024-03-13 08:55:51,988 DEBUG [Listener at localhost/37591] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46627 2024-03-13 08:55:51,989 DEBUG [Listener at localhost/37591] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46627 2024-03-13 08:55:51,989 DEBUG [Listener at localhost/37591] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46627 2024-03-13 08:55:51,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2174): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,36183,1710320150734 2024-03-13 08:55:52,000 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-03-13 08:55:52,002 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,36183,1710320150734 2024-03-13 08:55:52,021 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): regionserver:46627-0x1005c672cd60002, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-03-13 08:55:52,021 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): regionserver:46097-0x1005c672cd60001, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-03-13 08:55:52,021 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-03-13 08:55:52,022 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-13 08:55:52,023 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-03-13 08:55:52,025 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,36183,1710320150734 from backup master directory 2024-03-13 08:55:52,025 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(163): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-03-13 08:55:52,028 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,36183,1710320150734 2024-03-13 08:55:52,028 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-03-13 08:55:52,029 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-03-13 08:55:52,029 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,36183,1710320150734 2024-03-13 08:55:52,032 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2024-03-13 08:55:52,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2024-03-13 08:55:52,122 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/hbase.id with ID: 51e557b8-a9c5-49cd-9d74-554cd017bdd5 2024-03-13 08:55:52,166 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-13 08:55:52,182 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-13 08:55:52,225 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x597869bf to 127.0.0.1:52215 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-03-13 08:55:52,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c344e6b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-03-13 08:55:52,285 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-13 08:55:52,286 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2024-03-13 08:55:52,305 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2024-03-13 08:55:52,305 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2024-03-13 08:55:52,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-03-13 08:55:52,310 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-03-13 08:55:52,312 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-03-13 08:55:52,345 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/MasterData/data/master/store-tmp 2024-03-13 08:55:52,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-13 08:55:52,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-03-13 08:55:52,381 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-13 08:55:52,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-13 08:55:52,382 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-03-13 08:55:52,382 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-13 08:55:52,382 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-13 08:55:52,382 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-03-13 08:55:52,383 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/MasterData/WALs/jenkins-hbase4.apache.org,36183,1710320150734 2024-03-13 08:55:52,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36183%2C1710320150734, suffix=, logDir=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/MasterData/WALs/jenkins-hbase4.apache.org,36183,1710320150734, archiveDir=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/MasterData/oldWALs, maxLogs=10 2024-03-13 08:55:52,464 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35097,DS-33908dab-baab-493f-b2b0-8b37baf8169e,DISK] 2024-03-13 08:55:52,464 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41473,DS-c16e7576-411c-4863-9a82-e8928848bc67,DISK] 2024-03-13 08:55:52,472 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2024-03-13 08:55:52,539 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/MasterData/WALs/jenkins-hbase4.apache.org,36183,1710320150734/jenkins-hbase4.apache.org%2C36183%2C1710320150734.1710320152414 2024-03-13 08:55:52,539 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41473,DS-c16e7576-411c-4863-9a82-e8928848bc67,DISK], DatanodeInfoWithStorage[127.0.0.1:35097,DS-33908dab-baab-493f-b2b0-8b37baf8169e,DISK]] 2024-03-13 08:55:52,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2024-03-13 08:55:52,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-13 08:55:52,544 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2024-03-13 08:55:52,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2024-03-13 08:55:52,605 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2024-03-13 08:55:52,613 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2024-03-13 08:55:52,639 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2024-03-13 08:55:52,650 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-13 08:55:52,655 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-03-13 08:55:52,657 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-03-13 08:55:52,672 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2024-03-13 08:55:52,676 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-13 08:55:52,678 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71905133, jitterRate=0.0714699774980545}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-13 08:55:52,678 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2024-03-13 08:55:52,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2024-03-13 08:55:52,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2024-03-13 08:55:52,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(608): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2024-03-13 08:55:52,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2024-03-13 08:55:52,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(628): Recovered RegionProcedureStore lease in 1 msec 2024-03-13 08:55:52,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(642): Loaded RegionProcedureStore in 33 msec 2024-03-13 08:55:52,740 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2024-03-13 08:55:52,765 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2024-03-13 08:55:52,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2024-03-13 08:55:52,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2024-03-13 08:55:52,802 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2024-03-13 08:55:52,804 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2024-03-13 08:55:52,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2024-03-13 08:55:52,813 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2024-03-13 08:55:52,817 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-13 08:55:52,819 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2024-03-13 08:55:52,819 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2024-03-13 08:55:52,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2024-03-13 08:55:52,836 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): regionserver:46097-0x1005c672cd60001, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-03-13 08:55:52,836 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-03-13 08:55:52,836 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): regionserver:46627-0x1005c672cd60002, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-03-13 08:55:52,837 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-13 08:55:52,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(745): Active/primary master=jenkins-hbase4.apache.org,36183,1710320150734, sessionid=0x1005c672cd60000, setting cluster-up flag (Was=false) 2024-03-13 08:55:52,854 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-13 08:55:52,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2024-03-13 08:55:52,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36183,1710320150734 2024-03-13 08:55:52,868 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-13 08:55:52,874 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2024-03-13 08:55:52,876 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36183,1710320150734 2024-03-13 08:55:52,878 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.hbase-snapshot/.tmp 2024-03-13 08:55:52,893 INFO [RS:1;jenkins-hbase4:46627] regionserver.HRegionServer(954): ClusterId : 51e557b8-a9c5-49cd-9d74-554cd017bdd5 2024-03-13 08:55:52,893 INFO [RS:0;jenkins-hbase4:46097] regionserver.HRegionServer(954): ClusterId : 51e557b8-a9c5-49cd-9d74-554cd017bdd5 2024-03-13 08:55:52,899 DEBUG [RS:1;jenkins-hbase4:46627] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-03-13 08:55:52,899 DEBUG [RS:0;jenkins-hbase4:46097] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-03-13 08:55:52,906 DEBUG [RS:0;jenkins-hbase4:46097] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-03-13 08:55:52,906 DEBUG [RS:1;jenkins-hbase4:46627] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-03-13 08:55:52,906 DEBUG [RS:0;jenkins-hbase4:46097] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-03-13 08:55:52,906 DEBUG [RS:1;jenkins-hbase4:46627] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-03-13 08:55:52,910 DEBUG [RS:1;jenkins-hbase4:46627] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-03-13 08:55:52,910 DEBUG [RS:0;jenkins-hbase4:46097] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-03-13 08:55:52,913 DEBUG [RS:0;jenkins-hbase4:46097] zookeeper.ReadOnlyZKClient(139): Connect 0x07ec06cc to 127.0.0.1:52215 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-03-13 08:55:52,913 DEBUG [RS:1;jenkins-hbase4:46627] zookeeper.ReadOnlyZKClient(139): Connect 0x53aa9f93 to 127.0.0.1:52215 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-03-13 08:55:52,921 DEBUG [RS:0;jenkins-hbase4:46097] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@92be841, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-03-13 08:55:52,922 DEBUG [RS:0;jenkins-hbase4:46097] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@d146dbc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-03-13 08:55:52,922 DEBUG [RS:1;jenkins-hbase4:46627] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5d6d7b96, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-03-13 08:55:52,922 DEBUG [RS:1;jenkins-hbase4:46627] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5952f4e3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-03-13 08:55:52,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver loaded, priority=536870911. 2024-03-13 08:55:52,949 DEBUG [RS:0;jenkins-hbase4:46097] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:46097 2024-03-13 08:55:52,949 DEBUG [RS:1;jenkins-hbase4:46627] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:46627 2024-03-13 08:55:52,953 INFO [RS:1;jenkins-hbase4:46627] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-03-13 08:55:52,953 INFO [RS:0;jenkins-hbase4:46097] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-03-13 08:55:52,953 INFO [RS:0;jenkins-hbase4:46097] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-03-13 08:55:52,953 INFO [RS:1;jenkins-hbase4:46627] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-03-13 08:55:52,954 DEBUG [RS:0;jenkins-hbase4:46097] regionserver.HRegionServer(1025): About to register with Master. 2024-03-13 08:55:52,954 DEBUG [RS:1;jenkins-hbase4:46627] regionserver.HRegionServer(1025): About to register with Master. 2024-03-13 08:55:52,957 INFO [RS:0;jenkins-hbase4:46097] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase4.apache.org,36183,1710320150734 with isa=jenkins-hbase4.apache.org/172.31.14.131:46097, startcode=1710320151924 2024-03-13 08:55:52,957 INFO [RS:1;jenkins-hbase4:46627] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase4.apache.org,36183,1710320150734 with isa=jenkins-hbase4.apache.org/172.31.14.131:46627, startcode=1710320151969 2024-03-13 08:55:52,975 DEBUG [RS:1;jenkins-hbase4:46627] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-03-13 08:55:52,975 DEBUG [RS:0;jenkins-hbase4:46097] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-03-13 08:55:53,021 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2024-03-13 08:55:53,033 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-03-13 08:55:53,033 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52661, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2024-03-13 08:55:53,033 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42943, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2024-03-13 08:55:53,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-03-13 08:55:53,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-03-13 08:55:53,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-03-13 08:55:53,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2024-03-13 08:55:53,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-13 08:55:53,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-03-13 08:55:53,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-13 08:55:53,037 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1710320183037 2024-03-13 08:55:53,040 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2024-03-13 08:55:53,044 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36183] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2838) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15910) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2024-03-13 08:55:53,047 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2024-03-13 08:55:53,047 INFO [PEWorker-2] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2024-03-13 08:55:53,052 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2024-03-13 08:55:53,053 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36183] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2838) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15910) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2024-03-13 08:55:53,054 INFO [PEWorker-2] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-03-13 08:55:53,061 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2024-03-13 08:55:53,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2024-03-13 08:55:53,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2024-03-13 08:55:53,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2024-03-13 08:55:53,063 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:53,067 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2024-03-13 08:55:53,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2024-03-13 08:55:53,069 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2024-03-13 08:55:53,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2024-03-13 08:55:53,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2024-03-13 08:55:53,074 DEBUG [RS:0;jenkins-hbase4:46097] regionserver.HRegionServer(2832): Master is not running yet 2024-03-13 08:55:53,074 DEBUG [RS:1;jenkins-hbase4:46627] regionserver.HRegionServer(2832): Master is not running yet 2024-03-13 08:55:53,075 WARN [RS:0;jenkins-hbase4:46097] regionserver.HRegionServer(1033): reportForDuty failed; sleeping 100 ms and then retrying. 2024-03-13 08:55:53,075 WARN [RS:1;jenkins-hbase4:46627] regionserver.HRegionServer(1033): reportForDuty failed; sleeping 100 ms and then retrying. 2024-03-13 08:55:53,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1710320153075,5,FailOnTimeoutGroup] 2024-03-13 08:55:53,076 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1710320153076,5,FailOnTimeoutGroup] 2024-03-13 08:55:53,076 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:53,076 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1466): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2024-03-13 08:55:53,077 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:53,077 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:53,092 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-03-13 08:55:53,093 INFO [PEWorker-2] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-03-13 08:55:53,094 INFO [PEWorker-2] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4 2024-03-13 08:55:53,111 DEBUG [PEWorker-2] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-13 08:55:53,113 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-03-13 08:55:53,116 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/meta/1588230740/info 2024-03-13 08:55:53,117 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-03-13 08:55:53,118 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-13 08:55:53,118 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-03-13 08:55:53,120 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/meta/1588230740/rep_barrier 2024-03-13 08:55:53,121 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-03-13 08:55:53,122 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-13 08:55:53,122 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-03-13 08:55:53,124 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/meta/1588230740/table 2024-03-13 08:55:53,125 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-03-13 08:55:53,126 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-13 08:55:53,128 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/meta/1588230740 2024-03-13 08:55:53,129 DEBUG [PEWorker-2] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/meta/1588230740 2024-03-13 08:55:53,133 DEBUG [PEWorker-2] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-03-13 08:55:53,135 DEBUG [PEWorker-2] regionserver.HRegion(1055): writing seq id for 1588230740 2024-03-13 08:55:53,139 DEBUG [PEWorker-2] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-13 08:55:53,140 INFO [PEWorker-2] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61580656, jitterRate=-0.08237671852111816}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-03-13 08:55:53,140 DEBUG [PEWorker-2] regionserver.HRegion(965): Region open journal for 1588230740: 2024-03-13 08:55:53,140 DEBUG [PEWorker-2] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-03-13 08:55:53,140 INFO [PEWorker-2] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-03-13 08:55:53,140 DEBUG [PEWorker-2] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-03-13 08:55:53,140 DEBUG [PEWorker-2] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-03-13 08:55:53,140 DEBUG [PEWorker-2] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-03-13 08:55:53,141 INFO [PEWorker-2] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-03-13 08:55:53,141 DEBUG [PEWorker-2] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-03-13 08:55:53,146 DEBUG [PEWorker-2] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2024-03-13 08:55:53,147 INFO [PEWorker-2] procedure.InitMetaProcedure(103): Going to assign meta 2024-03-13 08:55:53,155 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2024-03-13 08:55:53,169 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2024-03-13 08:55:53,171 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2024-03-13 08:55:53,176 INFO [RS:0;jenkins-hbase4:46097] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase4.apache.org,36183,1710320150734 with isa=jenkins-hbase4.apache.org/172.31.14.131:46097, startcode=1710320151924 2024-03-13 08:55:53,176 INFO [RS:1;jenkins-hbase4:46627] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase4.apache.org,36183,1710320150734 with isa=jenkins-hbase4.apache.org/172.31.14.131:46627, startcode=1710320151969 2024-03-13 08:55:53,181 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36183] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,46097,1710320151924 2024-03-13 08:55:53,186 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36183] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,46627,1710320151969 2024-03-13 08:55:53,187 DEBUG [RS:0;jenkins-hbase4:46097] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4 2024-03-13 08:55:53,187 DEBUG [RS:0;jenkins-hbase4:46097] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:45049 2024-03-13 08:55:53,187 DEBUG [RS:0;jenkins-hbase4:46097] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-03-13 08:55:53,187 DEBUG [RS:1;jenkins-hbase4:46627] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4 2024-03-13 08:55:53,187 DEBUG [RS:1;jenkins-hbase4:46627] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:45049 2024-03-13 08:55:53,187 DEBUG [RS:1;jenkins-hbase4:46627] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-03-13 08:55:53,194 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-03-13 08:55:53,195 DEBUG [RS:0;jenkins-hbase4:46097] zookeeper.ZKUtil(163): regionserver:46097-0x1005c672cd60001, quorum=127.0.0.1:52215, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46097,1710320151924 2024-03-13 08:55:53,195 DEBUG [RS:1;jenkins-hbase4:46627] zookeeper.ZKUtil(163): regionserver:46627-0x1005c672cd60002, quorum=127.0.0.1:52215, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46627,1710320151969 2024-03-13 08:55:53,196 WARN [RS:0;jenkins-hbase4:46097] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-03-13 08:55:53,196 WARN [RS:1;jenkins-hbase4:46627] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-03-13 08:55:53,196 INFO [RS:0;jenkins-hbase4:46097] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-03-13 08:55:53,196 INFO [RS:1;jenkins-hbase4:46627] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-03-13 08:55:53,196 DEBUG [RS:0;jenkins-hbase4:46097] regionserver.HRegionServer(1950): logDir=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/WALs/jenkins-hbase4.apache.org,46097,1710320151924 2024-03-13 08:55:53,197 DEBUG [RS:1;jenkins-hbase4:46627] regionserver.HRegionServer(1950): logDir=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/WALs/jenkins-hbase4.apache.org,46627,1710320151969 2024-03-13 08:55:53,197 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46097,1710320151924] 2024-03-13 08:55:53,197 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46627,1710320151969] 2024-03-13 08:55:53,207 DEBUG [RS:1;jenkins-hbase4:46627] zookeeper.ZKUtil(163): regionserver:46627-0x1005c672cd60002, quorum=127.0.0.1:52215, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46097,1710320151924 2024-03-13 08:55:53,207 DEBUG [RS:0;jenkins-hbase4:46097] zookeeper.ZKUtil(163): regionserver:46097-0x1005c672cd60001, quorum=127.0.0.1:52215, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46097,1710320151924 2024-03-13 08:55:53,208 DEBUG [RS:0;jenkins-hbase4:46097] zookeeper.ZKUtil(163): regionserver:46097-0x1005c672cd60001, quorum=127.0.0.1:52215, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46627,1710320151969 2024-03-13 08:55:53,208 DEBUG [RS:1;jenkins-hbase4:46627] zookeeper.ZKUtil(163): regionserver:46627-0x1005c672cd60002, quorum=127.0.0.1:52215, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46627,1710320151969 2024-03-13 08:55:53,218 DEBUG [RS:0;jenkins-hbase4:46097] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-03-13 08:55:53,218 DEBUG [RS:1;jenkins-hbase4:46627] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-03-13 08:55:53,227 INFO [RS:1;jenkins-hbase4:46627] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-03-13 08:55:53,227 INFO [RS:0;jenkins-hbase4:46097] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-03-13 08:55:53,249 INFO [RS:1;jenkins-hbase4:46627] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-03-13 08:55:53,249 INFO [RS:0;jenkins-hbase4:46097] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-03-13 08:55:53,253 INFO [RS:0;jenkins-hbase4:46097] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-03-13 08:55:53,253 INFO [RS:1;jenkins-hbase4:46627] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-03-13 08:55:53,254 INFO [RS:0;jenkins-hbase4:46097] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:53,254 INFO [RS:1;jenkins-hbase4:46627] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:53,255 INFO [RS:0;jenkins-hbase4:46097] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-03-13 08:55:53,255 INFO [RS:1;jenkins-hbase4:46627] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-03-13 08:55:53,262 INFO [RS:0;jenkins-hbase4:46097] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:53,262 INFO [RS:1;jenkins-hbase4:46627] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:53,263 DEBUG [RS:0;jenkins-hbase4:46097] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-13 08:55:53,263 DEBUG [RS:1;jenkins-hbase4:46627] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-13 08:55:53,263 DEBUG [RS:0;jenkins-hbase4:46097] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-13 08:55:53,263 DEBUG [RS:1;jenkins-hbase4:46627] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-13 08:55:53,263 DEBUG [RS:0;jenkins-hbase4:46097] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-13 08:55:53,263 DEBUG [RS:1;jenkins-hbase4:46627] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-13 08:55:53,263 DEBUG [RS:0;jenkins-hbase4:46097] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-13 08:55:53,263 DEBUG [RS:1;jenkins-hbase4:46627] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-13 08:55:53,263 DEBUG [RS:0;jenkins-hbase4:46097] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-13 08:55:53,264 DEBUG [RS:1;jenkins-hbase4:46627] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-13 08:55:53,264 DEBUG [RS:0;jenkins-hbase4:46097] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-03-13 08:55:53,264 DEBUG [RS:1;jenkins-hbase4:46627] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-03-13 08:55:53,264 DEBUG [RS:0;jenkins-hbase4:46097] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-13 08:55:53,264 DEBUG [RS:1;jenkins-hbase4:46627] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-13 08:55:53,264 DEBUG [RS:0;jenkins-hbase4:46097] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-13 08:55:53,264 DEBUG [RS:1;jenkins-hbase4:46627] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-13 08:55:53,264 DEBUG [RS:0;jenkins-hbase4:46097] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-13 08:55:53,264 DEBUG [RS:1;jenkins-hbase4:46627] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-13 08:55:53,264 DEBUG [RS:0;jenkins-hbase4:46097] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-13 08:55:53,264 DEBUG [RS:1;jenkins-hbase4:46627] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-13 08:55:53,266 INFO [RS:1;jenkins-hbase4:46627] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:53,266 INFO [RS:1;jenkins-hbase4:46627] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:53,266 INFO [RS:1;jenkins-hbase4:46627] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:53,266 INFO [RS:1;jenkins-hbase4:46627] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:53,266 INFO [RS:0;jenkins-hbase4:46097] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:53,267 INFO [RS:0;jenkins-hbase4:46097] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:53,267 INFO [RS:0;jenkins-hbase4:46097] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:53,267 INFO [RS:0;jenkins-hbase4:46097] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:53,283 INFO [RS:0;jenkins-hbase4:46097] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-03-13 08:55:53,283 INFO [RS:1;jenkins-hbase4:46627] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-03-13 08:55:53,286 INFO [RS:0;jenkins-hbase4:46097] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46097,1710320151924-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:53,286 INFO [RS:1;jenkins-hbase4:46627] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46627,1710320151969-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:53,309 INFO [RS:0;jenkins-hbase4:46097] regionserver.Replication(203): jenkins-hbase4.apache.org,46097,1710320151924 started 2024-03-13 08:55:53,309 INFO [RS:1;jenkins-hbase4:46627] regionserver.Replication(203): jenkins-hbase4.apache.org,46627,1710320151969 started 2024-03-13 08:55:53,309 INFO [RS:0;jenkins-hbase4:46097] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,46097,1710320151924, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46097, sessionid=0x1005c672cd60001 2024-03-13 08:55:53,309 INFO [RS:1;jenkins-hbase4:46627] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,46627,1710320151969, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46627, sessionid=0x1005c672cd60002 2024-03-13 08:55:53,309 DEBUG [RS:1;jenkins-hbase4:46627] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-03-13 08:55:53,309 DEBUG [RS:0;jenkins-hbase4:46097] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-03-13 08:55:53,309 DEBUG [RS:1;jenkins-hbase4:46627] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46627,1710320151969 2024-03-13 08:55:53,309 DEBUG [RS:0;jenkins-hbase4:46097] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46097,1710320151924 2024-03-13 08:55:53,310 DEBUG [RS:1;jenkins-hbase4:46627] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46627,1710320151969' 2024-03-13 08:55:53,310 DEBUG [RS:0;jenkins-hbase4:46097] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46097,1710320151924' 2024-03-13 08:55:53,310 DEBUG [RS:1;jenkins-hbase4:46627] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-03-13 08:55:53,310 DEBUG [RS:0;jenkins-hbase4:46097] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-03-13 08:55:53,311 DEBUG [RS:1;jenkins-hbase4:46627] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-03-13 08:55:53,311 DEBUG [RS:0;jenkins-hbase4:46097] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-03-13 08:55:53,312 DEBUG [RS:1;jenkins-hbase4:46627] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-03-13 08:55:53,312 DEBUG [RS:0;jenkins-hbase4:46097] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-03-13 08:55:53,312 DEBUG [RS:1;jenkins-hbase4:46627] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-03-13 08:55:53,312 DEBUG [RS:0;jenkins-hbase4:46097] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-03-13 08:55:53,312 DEBUG [RS:1;jenkins-hbase4:46627] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46627,1710320151969 2024-03-13 08:55:53,312 DEBUG [RS:0;jenkins-hbase4:46097] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46097,1710320151924 2024-03-13 08:55:53,313 DEBUG [RS:1;jenkins-hbase4:46627] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46627,1710320151969' 2024-03-13 08:55:53,313 DEBUG [RS:0;jenkins-hbase4:46097] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46097,1710320151924' 2024-03-13 08:55:53,313 DEBUG [RS:0;jenkins-hbase4:46097] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-03-13 08:55:53,313 DEBUG [RS:1;jenkins-hbase4:46627] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-03-13 08:55:53,314 DEBUG [RS:0;jenkins-hbase4:46097] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-03-13 08:55:53,314 DEBUG [RS:1;jenkins-hbase4:46627] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-03-13 08:55:53,314 DEBUG [RS:0;jenkins-hbase4:46097] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-03-13 08:55:53,314 INFO [RS:0;jenkins-hbase4:46097] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-03-13 08:55:53,315 DEBUG [RS:1;jenkins-hbase4:46627] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-03-13 08:55:53,315 INFO [RS:1;jenkins-hbase4:46627] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-03-13 08:55:53,317 INFO [RS:1;jenkins-hbase4:46627] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:53,317 INFO [RS:0;jenkins-hbase4:46097] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:53,318 DEBUG [RS:0;jenkins-hbase4:46097] zookeeper.ZKUtil(399): regionserver:46097-0x1005c672cd60001, quorum=127.0.0.1:52215, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-03-13 08:55:53,318 DEBUG [RS:1;jenkins-hbase4:46627] zookeeper.ZKUtil(399): regionserver:46627-0x1005c672cd60002, quorum=127.0.0.1:52215, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-03-13 08:55:53,318 INFO [RS:0;jenkins-hbase4:46097] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-03-13 08:55:53,318 INFO [RS:1;jenkins-hbase4:46627] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-03-13 08:55:53,318 INFO [RS:1;jenkins-hbase4:46627] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:53,318 INFO [RS:0;jenkins-hbase4:46097] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:53,319 INFO [RS:1;jenkins-hbase4:46627] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:53,319 INFO [RS:0;jenkins-hbase4:46097] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:53,323 DEBUG [jenkins-hbase4:36183] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=2, allServersCount=2 2024-03-13 08:55:53,326 DEBUG [jenkins-hbase4:36183] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-13 08:55:53,332 DEBUG [jenkins-hbase4:36183] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-13 08:55:53,332 DEBUG [jenkins-hbase4:36183] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-13 08:55:53,332 DEBUG [jenkins-hbase4:36183] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-13 08:55:53,335 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46627,1710320151969, state=OPENING 2024-03-13 08:55:53,342 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2024-03-13 08:55:53,344 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-13 08:55:53,345 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-03-13 08:55:53,349 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46627,1710320151969}] 2024-03-13 08:55:53,431 INFO [RS:0;jenkins-hbase4:46097] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46097%2C1710320151924, suffix=, logDir=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/WALs/jenkins-hbase4.apache.org,46097,1710320151924, archiveDir=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/oldWALs, maxLogs=32 2024-03-13 08:55:53,431 INFO [RS:1;jenkins-hbase4:46627] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46627%2C1710320151969, suffix=, logDir=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/WALs/jenkins-hbase4.apache.org,46627,1710320151969, archiveDir=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/oldWALs, maxLogs=32 2024-03-13 08:55:53,454 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35097,DS-33908dab-baab-493f-b2b0-8b37baf8169e,DISK] 2024-03-13 08:55:53,455 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41473,DS-c16e7576-411c-4863-9a82-e8928848bc67,DISK] 2024-03-13 08:55:53,456 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41473,DS-c16e7576-411c-4863-9a82-e8928848bc67,DISK] 2024-03-13 08:55:53,456 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35097,DS-33908dab-baab-493f-b2b0-8b37baf8169e,DISK] 2024-03-13 08:55:53,479 INFO [RS:0;jenkins-hbase4:46097] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/WALs/jenkins-hbase4.apache.org,46097,1710320151924/jenkins-hbase4.apache.org%2C46097%2C1710320151924.1710320153435 2024-03-13 08:55:53,479 INFO [RS:1;jenkins-hbase4:46627] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/WALs/jenkins-hbase4.apache.org,46627,1710320151969/jenkins-hbase4.apache.org%2C46627%2C1710320151969.1710320153435 2024-03-13 08:55:53,480 DEBUG [RS:0;jenkins-hbase4:46097] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35097,DS-33908dab-baab-493f-b2b0-8b37baf8169e,DISK], DatanodeInfoWithStorage[127.0.0.1:41473,DS-c16e7576-411c-4863-9a82-e8928848bc67,DISK]] 2024-03-13 08:55:53,480 DEBUG [RS:1;jenkins-hbase4:46627] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35097,DS-33908dab-baab-493f-b2b0-8b37baf8169e,DISK], DatanodeInfoWithStorage[127.0.0.1:41473,DS-c16e7576-411c-4863-9a82-e8928848bc67,DISK]] 2024-03-13 08:55:53,533 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46627,1710320151969 2024-03-13 08:55:53,536 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-03-13 08:55:53,539 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48682, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-03-13 08:55:53,552 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2024-03-13 08:55:53,552 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-03-13 08:55:53,555 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46627%2C1710320151969.meta, suffix=.meta, logDir=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/WALs/jenkins-hbase4.apache.org,46627,1710320151969, archiveDir=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/oldWALs, maxLogs=32 2024-03-13 08:55:53,573 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35097,DS-33908dab-baab-493f-b2b0-8b37baf8169e,DISK] 2024-03-13 08:55:53,573 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41473,DS-c16e7576-411c-4863-9a82-e8928848bc67,DISK] 2024-03-13 08:55:53,579 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/WALs/jenkins-hbase4.apache.org,46627,1710320151969/jenkins-hbase4.apache.org%2C46627%2C1710320151969.meta.1710320153557.meta 2024-03-13 08:55:53,580 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35097,DS-33908dab-baab-493f-b2b0-8b37baf8169e,DISK], DatanodeInfoWithStorage[127.0.0.1:41473,DS-c16e7576-411c-4863-9a82-e8928848bc67,DISK]] 2024-03-13 08:55:53,580 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2024-03-13 08:55:53,582 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2024-03-13 08:55:53,598 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2024-03-13 08:55:53,602 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2024-03-13 08:55:53,608 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2024-03-13 08:55:53,608 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-13 08:55:53,609 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2024-03-13 08:55:53,609 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2024-03-13 08:55:53,612 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-03-13 08:55:53,614 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/meta/1588230740/info 2024-03-13 08:55:53,614 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/meta/1588230740/info 2024-03-13 08:55:53,614 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-03-13 08:55:53,615 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-13 08:55:53,616 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-03-13 08:55:53,617 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/meta/1588230740/rep_barrier 2024-03-13 08:55:53,617 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/meta/1588230740/rep_barrier 2024-03-13 08:55:53,618 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-03-13 08:55:53,619 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-13 08:55:53,619 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-03-13 08:55:53,621 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/meta/1588230740/table 2024-03-13 08:55:53,621 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/meta/1588230740/table 2024-03-13 08:55:53,621 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-03-13 08:55:53,622 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-13 08:55:53,624 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/meta/1588230740 2024-03-13 08:55:53,627 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/meta/1588230740 2024-03-13 08:55:53,631 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-03-13 08:55:53,633 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2024-03-13 08:55:53,635 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73979237, jitterRate=0.1023765355348587}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-03-13 08:55:53,635 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2024-03-13 08:55:53,645 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1710320153525 2024-03-13 08:55:53,665 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:meta,,1.1588230740 2024-03-13 08:55:53,665 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2024-03-13 08:55:53,666 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,46627,1710320151969, state=OPEN 2024-03-13 08:55:53,669 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2024-03-13 08:55:53,670 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-03-13 08:55:53,674 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=3, resume processing ppid=2 2024-03-13 08:55:53,674 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,46627,1710320151969 in 321 msec 2024-03-13 08:55:53,679 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=2, resume processing ppid=1 2024-03-13 08:55:53,679 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 521 msec 2024-03-13 08:55:53,685 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 743 msec 2024-03-13 08:55:53,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(954): Wait for region servers to report in: status=null, state=RUNNING, startTime=1710320153685, completionTime=-1 2024-03-13 08:55:53,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2024-03-13 08:55:53,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2024-03-13 08:55:53,754 DEBUG [hconnection-0x39ef33d4-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-13 08:55:53,757 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48698, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-03-13 08:55:53,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=2 2024-03-13 08:55:53,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1710320213773 2024-03-13 08:55:53,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1710320273773 2024-03-13 08:55:53,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 88 msec 2024-03-13 08:55:53,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36183,1710320150734-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:53,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36183,1710320150734-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:53,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36183,1710320150734-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:53,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:36183, period=300000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:53,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:53,806 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2024-03-13 08:55:53,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2024-03-13 08:55:53,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-03-13 08:55:53,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2024-03-13 08:55:53,830 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2024-03-13 08:55:53,832 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-13 08:55:53,853 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/hbase/namespace/674a8c26191fd518e6e5b098d2850234 2024-03-13 08:55:53,855 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/hbase/namespace/674a8c26191fd518e6e5b098d2850234 empty. 2024-03-13 08:55:53,856 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/hbase/namespace/674a8c26191fd518e6e5b098d2850234 2024-03-13 08:55:53,856 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2024-03-13 08:55:53,885 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2024-03-13 08:55:53,887 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 674a8c26191fd518e6e5b098d2850234, NAME => 'hbase:namespace,,1710320153816.674a8c26191fd518e6e5b098d2850234.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp 2024-03-13 08:55:53,903 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1710320153816.674a8c26191fd518e6e5b098d2850234.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-13 08:55:53,904 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 674a8c26191fd518e6e5b098d2850234, disabling compactions & flushes 2024-03-13 08:55:53,904 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1710320153816.674a8c26191fd518e6e5b098d2850234. 2024-03-13 08:55:53,904 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1710320153816.674a8c26191fd518e6e5b098d2850234. 2024-03-13 08:55:53,904 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1710320153816.674a8c26191fd518e6e5b098d2850234. after waiting 0 ms 2024-03-13 08:55:53,904 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1710320153816.674a8c26191fd518e6e5b098d2850234. 2024-03-13 08:55:53,904 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1710320153816.674a8c26191fd518e6e5b098d2850234. 2024-03-13 08:55:53,904 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 674a8c26191fd518e6e5b098d2850234: 2024-03-13 08:55:53,908 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2024-03-13 08:55:53,925 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1710320153816.674a8c26191fd518e6e5b098d2850234.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1710320153912"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1710320153912"}]},"ts":"1710320153912"} 2024-03-13 08:55:53,953 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-13 08:55:53,955 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-13 08:55:53,959 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710320153955"}]},"ts":"1710320153955"} 2024-03-13 08:55:53,963 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2024-03-13 08:55:53,968 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-13 08:55:53,969 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-13 08:55:53,969 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-13 08:55:53,969 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-13 08:55:53,972 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=674a8c26191fd518e6e5b098d2850234, ASSIGN}] 2024-03-13 08:55:53,974 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=674a8c26191fd518e6e5b098d2850234, ASSIGN 2024-03-13 08:55:53,977 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=674a8c26191fd518e6e5b098d2850234, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46627,1710320151969; forceNewPlan=false, retain=false 2024-03-13 08:55:54,130 INFO [jenkins-hbase4:36183] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-13 08:55:54,131 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=674a8c26191fd518e6e5b098d2850234, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46627,1710320151969 2024-03-13 08:55:54,131 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1710320153816.674a8c26191fd518e6e5b098d2850234.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1710320154130"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1710320154130"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1710320154130"}]},"ts":"1710320154130"} 2024-03-13 08:55:54,136 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 674a8c26191fd518e6e5b098d2850234, server=jenkins-hbase4.apache.org,46627,1710320151969}] 2024-03-13 08:55:54,290 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46627,1710320151969 2024-03-13 08:55:54,297 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1710320153816.674a8c26191fd518e6e5b098d2850234. 2024-03-13 08:55:54,298 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 674a8c26191fd518e6e5b098d2850234, NAME => 'hbase:namespace,,1710320153816.674a8c26191fd518e6e5b098d2850234.', STARTKEY => '', ENDKEY => ''} 2024-03-13 08:55:54,299 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 674a8c26191fd518e6e5b098d2850234 2024-03-13 08:55:54,299 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1710320153816.674a8c26191fd518e6e5b098d2850234.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-13 08:55:54,299 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 674a8c26191fd518e6e5b098d2850234 2024-03-13 08:55:54,299 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 674a8c26191fd518e6e5b098d2850234 2024-03-13 08:55:54,302 INFO [StoreOpener-674a8c26191fd518e6e5b098d2850234-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 674a8c26191fd518e6e5b098d2850234 2024-03-13 08:55:54,304 DEBUG [StoreOpener-674a8c26191fd518e6e5b098d2850234-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/namespace/674a8c26191fd518e6e5b098d2850234/info 2024-03-13 08:55:54,304 DEBUG [StoreOpener-674a8c26191fd518e6e5b098d2850234-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/namespace/674a8c26191fd518e6e5b098d2850234/info 2024-03-13 08:55:54,305 INFO [StoreOpener-674a8c26191fd518e6e5b098d2850234-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 674a8c26191fd518e6e5b098d2850234 columnFamilyName info 2024-03-13 08:55:54,306 INFO [StoreOpener-674a8c26191fd518e6e5b098d2850234-1] regionserver.HStore(310): Store=674a8c26191fd518e6e5b098d2850234/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-13 08:55:54,307 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/namespace/674a8c26191fd518e6e5b098d2850234 2024-03-13 08:55:54,309 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/namespace/674a8c26191fd518e6e5b098d2850234 2024-03-13 08:55:54,314 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 674a8c26191fd518e6e5b098d2850234 2024-03-13 08:55:54,317 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/namespace/674a8c26191fd518e6e5b098d2850234/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-13 08:55:54,318 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 674a8c26191fd518e6e5b098d2850234; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72410513, jitterRate=0.07900072634220123}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-13 08:55:54,318 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 674a8c26191fd518e6e5b098d2850234: 2024-03-13 08:55:54,320 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:namespace,,1710320153816.674a8c26191fd518e6e5b098d2850234., pid=6, masterSystemTime=1710320154290 2024-03-13 08:55:54,325 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:namespace,,1710320153816.674a8c26191fd518e6e5b098d2850234. 2024-03-13 08:55:54,325 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1710320153816.674a8c26191fd518e6e5b098d2850234. 2024-03-13 08:55:54,327 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=674a8c26191fd518e6e5b098d2850234, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46627,1710320151969 2024-03-13 08:55:54,327 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1710320153816.674a8c26191fd518e6e5b098d2850234.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1710320154326"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1710320154326"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1710320154326"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1710320154326"}]},"ts":"1710320154326"} 2024-03-13 08:55:54,337 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=6, resume processing ppid=5 2024-03-13 08:55:54,338 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 674a8c26191fd518e6e5b098d2850234, server=jenkins-hbase4.apache.org,46627,1710320151969 in 197 msec 2024-03-13 08:55:54,342 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=5, resume processing ppid=4 2024-03-13 08:55:54,342 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=674a8c26191fd518e6e5b098d2850234, ASSIGN in 365 msec 2024-03-13 08:55:54,343 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-13 08:55:54,344 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710320154343"}]},"ts":"1710320154343"} 2024-03-13 08:55:54,347 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2024-03-13 08:55:54,350 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2024-03-13 08:55:54,353 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 532 msec 2024-03-13 08:55:54,431 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2024-03-13 08:55:54,433 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2024-03-13 08:55:54,433 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-13 08:55:54,468 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2024-03-13 08:55:54,485 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-03-13 08:55:54,492 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 30 msec 2024-03-13 08:55:54,503 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2024-03-13 08:55:54,515 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-03-13 08:55:54,520 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2024-03-13 08:55:54,529 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2024-03-13 08:55:54,532 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2024-03-13 08:55:54,532 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1084): Master has completed initialization 2.502sec 2024-03-13 08:55:54,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(103): Quota table not found. Creating... 2024-03-13 08:55:54,535 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-13 08:55:54,537 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:quota 2024-03-13 08:55:54,537 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(107): Initializing quota support 2024-03-13 08:55:54,539 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_PRE_OPERATION 2024-03-13 08:55:54,539 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(59): Namespace State Manager started. 2024-03-13 08:55:54,541 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-13 08:55:54,544 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/hbase/quota/1bd54a37ecf02bc2fd687ebaffa21e28 2024-03-13 08:55:54,545 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/hbase/quota/1bd54a37ecf02bc2fd687ebaffa21e28 empty. 2024-03-13 08:55:54,547 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/hbase/quota/1bd54a37ecf02bc2fd687ebaffa21e28 2024-03-13 08:55:54,547 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:quota regions 2024-03-13 08:55:54,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(222): Finished updating state of 2 namespaces. 2024-03-13 08:55:54,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceAuditor(50): NamespaceAuditor started. 2024-03-13 08:55:54,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:54,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:54,553 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2024-03-13 08:55:54,553 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2024-03-13 08:55:54,555 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36183,1710320150734-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2024-03-13 08:55:54,556 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36183,1710320150734-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2024-03-13 08:55:54,569 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1176): Balancer post startup initialization complete, took 0 seconds 2024-03-13 08:55:54,569 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36183,1710320150734-OldWALsDirSizeChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-13 08:55:54,569 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/hbase/quota/.tabledesc/.tableinfo.0000000001 2024-03-13 08:55:54,571 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1bd54a37ecf02bc2fd687ebaffa21e28, NAME => 'hbase:quota,,1710320154535.1bd54a37ecf02bc2fd687ebaffa21e28.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp 2024-03-13 08:55:54,589 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(866): Instantiated hbase:quota,,1710320154535.1bd54a37ecf02bc2fd687ebaffa21e28.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-13 08:55:54,589 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1604): Closing 1bd54a37ecf02bc2fd687ebaffa21e28, disabling compactions & flushes 2024-03-13 08:55:54,589 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1626): Closing region hbase:quota,,1710320154535.1bd54a37ecf02bc2fd687ebaffa21e28. 2024-03-13 08:55:54,589 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1710320154535.1bd54a37ecf02bc2fd687ebaffa21e28. 2024-03-13 08:55:54,589 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1710320154535.1bd54a37ecf02bc2fd687ebaffa21e28. after waiting 0 ms 2024-03-13 08:55:54,589 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1710320154535.1bd54a37ecf02bc2fd687ebaffa21e28. 2024-03-13 08:55:54,589 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1838): Closed hbase:quota,,1710320154535.1bd54a37ecf02bc2fd687ebaffa21e28. 2024-03-13 08:55:54,589 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1558): Region close journal for 1bd54a37ecf02bc2fd687ebaffa21e28: 2024-03-13 08:55:54,594 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ADD_TO_META 2024-03-13 08:55:54,596 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:quota,,1710320154535.1bd54a37ecf02bc2fd687ebaffa21e28.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1710320154596"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1710320154596"}]},"ts":"1710320154596"} 2024-03-13 08:55:54,597 ERROR [Listener at localhost/37591] master.TableStateManager(95): Unable to get table hbase:quota state org.apache.hadoop.hbase.TableNotFoundException: No state found for hbase:quota at org.apache.hadoop.hbase.master.TableStateManager.getTableState(TableStateManager.java:155) at org.apache.hadoop.hbase.master.TableStateManager.isTableState(TableStateManager.java:92) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.isTableDisabled(AssignmentManager.java:419) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.getRegionStatesCount(AssignmentManager.java:2351) at org.apache.hadoop.hbase.master.HMaster.getClusterMetricsWithoutCoprocessor(HMaster.java:2622) at org.apache.hadoop.hbase.master.HMaster.getClusterMetrics(HMaster.java:2646) at org.apache.hadoop.hbase.master.HMaster.getClusterMetrics(HMaster.java:2639) at org.apache.hadoop.hbase.MiniHBaseCluster.getClusterMetrics(MiniHBaseCluster.java:710) at org.apache.hadoop.hbase.MiniHBaseCluster.(MiniHBaseCluster.java:111) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniHBaseCluster(HBaseTestingUtility.java:1131) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:1094) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:1048) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.setUpBeforeClass(TestClusterScopeQuotaThrottle.java:78) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2024-03-13 08:55:54,599 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-13 08:55:54,600 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-13 08:55:54,601 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710320154601"}]},"ts":"1710320154601"} 2024-03-13 08:55:54,603 DEBUG [Listener at localhost/37591] zookeeper.ReadOnlyZKClient(139): Connect 0x578c3464 to 127.0.0.1:52215 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-03-13 08:55:54,603 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLING in hbase:meta 2024-03-13 08:55:54,609 DEBUG [Listener at localhost/37591] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@141fbce7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-03-13 08:55:54,610 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-13 08:55:54,613 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-13 08:55:54,613 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-13 08:55:54,613 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-13 08:55:54,613 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=1bd54a37ecf02bc2fd687ebaffa21e28, ASSIGN}] 2024-03-13 08:55:54,616 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=1bd54a37ecf02bc2fd687ebaffa21e28, ASSIGN 2024-03-13 08:55:54,618 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:quota, region=1bd54a37ecf02bc2fd687ebaffa21e28, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46097,1710320151924; forceNewPlan=false, retain=false 2024-03-13 08:55:54,624 DEBUG [hconnection-0x62f2a354-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-13 08:55:54,637 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48710, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-03-13 08:55:54,647 INFO [Listener at localhost/37591] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,36183,1710320150734 2024-03-13 08:55:54,648 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:55:54,651 DEBUG [Listener at localhost/37591] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-03-13 08:55:54,753 DEBUG [Listener at localhost/37591] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-03-13 08:55:54,768 INFO [jenkins-hbase4:36183] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-13 08:55:54,769 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=1bd54a37ecf02bc2fd687ebaffa21e28, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46097,1710320151924 2024-03-13 08:55:54,769 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:quota,,1710320154535.1bd54a37ecf02bc2fd687ebaffa21e28.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1710320154769"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1710320154769"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1710320154769"}]},"ts":"1710320154769"} 2024-03-13 08:55:54,772 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 1bd54a37ecf02bc2fd687ebaffa21e28, server=jenkins-hbase4.apache.org,46097,1710320151924}] 2024-03-13 08:55:54,855 DEBUG [Listener at localhost/37591] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-03-13 08:55:54,926 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46097,1710320151924 2024-03-13 08:55:54,927 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-03-13 08:55:54,930 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52580, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-03-13 08:55:54,935 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:quota,,1710320154535.1bd54a37ecf02bc2fd687ebaffa21e28. 2024-03-13 08:55:54,935 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1bd54a37ecf02bc2fd687ebaffa21e28, NAME => 'hbase:quota,,1710320154535.1bd54a37ecf02bc2fd687ebaffa21e28.', STARTKEY => '', ENDKEY => ''} 2024-03-13 08:55:54,936 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table quota 1bd54a37ecf02bc2fd687ebaffa21e28 2024-03-13 08:55:54,936 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:quota,,1710320154535.1bd54a37ecf02bc2fd687ebaffa21e28.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-13 08:55:54,936 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1bd54a37ecf02bc2fd687ebaffa21e28 2024-03-13 08:55:54,936 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1bd54a37ecf02bc2fd687ebaffa21e28 2024-03-13 08:55:54,938 INFO [StoreOpener-1bd54a37ecf02bc2fd687ebaffa21e28-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family q of region 1bd54a37ecf02bc2fd687ebaffa21e28 2024-03-13 08:55:54,940 DEBUG [StoreOpener-1bd54a37ecf02bc2fd687ebaffa21e28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/quota/1bd54a37ecf02bc2fd687ebaffa21e28/q 2024-03-13 08:55:54,940 DEBUG [StoreOpener-1bd54a37ecf02bc2fd687ebaffa21e28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/quota/1bd54a37ecf02bc2fd687ebaffa21e28/q 2024-03-13 08:55:54,941 INFO [StoreOpener-1bd54a37ecf02bc2fd687ebaffa21e28-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1bd54a37ecf02bc2fd687ebaffa21e28 columnFamilyName q 2024-03-13 08:55:54,942 INFO [StoreOpener-1bd54a37ecf02bc2fd687ebaffa21e28-1] regionserver.HStore(310): Store=1bd54a37ecf02bc2fd687ebaffa21e28/q, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-13 08:55:54,942 INFO [StoreOpener-1bd54a37ecf02bc2fd687ebaffa21e28-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family u of region 1bd54a37ecf02bc2fd687ebaffa21e28 2024-03-13 08:55:54,944 DEBUG [StoreOpener-1bd54a37ecf02bc2fd687ebaffa21e28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/quota/1bd54a37ecf02bc2fd687ebaffa21e28/u 2024-03-13 08:55:54,944 DEBUG [StoreOpener-1bd54a37ecf02bc2fd687ebaffa21e28-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/quota/1bd54a37ecf02bc2fd687ebaffa21e28/u 2024-03-13 08:55:54,944 INFO [StoreOpener-1bd54a37ecf02bc2fd687ebaffa21e28-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1bd54a37ecf02bc2fd687ebaffa21e28 columnFamilyName u 2024-03-13 08:55:54,945 INFO [StoreOpener-1bd54a37ecf02bc2fd687ebaffa21e28-1] regionserver.HStore(310): Store=1bd54a37ecf02bc2fd687ebaffa21e28/u, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-13 08:55:54,947 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/quota/1bd54a37ecf02bc2fd687ebaffa21e28 2024-03-13 08:55:54,948 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/quota/1bd54a37ecf02bc2fd687ebaffa21e28 2024-03-13 08:55:54,951 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:quota descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2024-03-13 08:55:54,953 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1bd54a37ecf02bc2fd687ebaffa21e28 2024-03-13 08:55:54,956 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/quota/1bd54a37ecf02bc2fd687ebaffa21e28/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-13 08:55:54,957 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1bd54a37ecf02bc2fd687ebaffa21e28; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61806493, jitterRate=-0.07901148498058319}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2024-03-13 08:55:54,957 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1bd54a37ecf02bc2fd687ebaffa21e28: 2024-03-13 08:55:54,957 DEBUG [Listener at localhost/37591] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-03-13 08:55:54,959 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:quota,,1710320154535.1bd54a37ecf02bc2fd687ebaffa21e28., pid=11, masterSystemTime=1710320154926 2024-03-13 08:55:54,962 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:quota,,1710320154535.1bd54a37ecf02bc2fd687ebaffa21e28. 2024-03-13 08:55:54,962 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:quota,,1710320154535.1bd54a37ecf02bc2fd687ebaffa21e28. 2024-03-13 08:55:54,963 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=1bd54a37ecf02bc2fd687ebaffa21e28, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46097,1710320151924 2024-03-13 08:55:54,964 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:quota,,1710320154535.1bd54a37ecf02bc2fd687ebaffa21e28.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1710320154963"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1710320154963"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1710320154963"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1710320154963"}]},"ts":"1710320154963"} 2024-03-13 08:55:54,969 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=11, resume processing ppid=10 2024-03-13 08:55:54,970 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 1bd54a37ecf02bc2fd687ebaffa21e28, server=jenkins-hbase4.apache.org,46097,1710320151924 in 194 msec 2024-03-13 08:55:54,973 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=10, resume processing ppid=9 2024-03-13 08:55:54,973 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:quota, region=1bd54a37ecf02bc2fd687ebaffa21e28, ASSIGN in 357 msec 2024-03-13 08:55:54,974 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-13 08:55:54,974 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710320154974"}]},"ts":"1710320154974"} 2024-03-13 08:55:54,976 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLED in hbase:meta 2024-03-13 08:55:54,980 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_POST_OPERATION 2024-03-13 08:55:54,982 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:quota in 445 msec 2024-03-13 08:55:55,070 DEBUG [Listener at localhost/37591] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-03-13 08:55:55,073 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38162, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2024-03-13 08:55:55,088 DEBUG [hconnection-0x62f2a354-shared-pool-3] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-13 08:55:55,092 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52584, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-03-13 08:55:55,106 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-13 08:55:55,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1075): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin0 2024-03-13 08:55:55,111 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_PRE_OPERATION 2024-03-13 08:55:55,113 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-13 08:55:55,116 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin0" procId is: 12 2024-03-13 08:55:55,118 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/default/TestQuotaAdmin0/f6346d02b0268607bd7cdba7ed86ddef 2024-03-13 08:55:55,119 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/default/TestQuotaAdmin0/f6346d02b0268607bd7cdba7ed86ddef empty. 2024-03-13 08:55:55,119 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/default/TestQuotaAdmin0/f6346d02b0268607bd7cdba7ed86ddef 2024-03-13 08:55:55,119 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-03-13 08:55:55,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-03-13 08:55:55,140 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/default/TestQuotaAdmin0/.tabledesc/.tableinfo.0000000001 2024-03-13 08:55:55,142 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(7675): creating {ENCODED => f6346d02b0268607bd7cdba7ed86ddef, NAME => 'TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp 2024-03-13 08:55:55,158 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-13 08:55:55,158 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1604): Closing f6346d02b0268607bd7cdba7ed86ddef, disabling compactions & flushes 2024-03-13 08:55:55,158 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef. 2024-03-13 08:55:55,158 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef. 2024-03-13 08:55:55,158 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef. after waiting 0 ms 2024-03-13 08:55:55,159 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef. 2024-03-13 08:55:55,159 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef. 2024-03-13 08:55:55,159 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1558): Region close journal for f6346d02b0268607bd7cdba7ed86ddef: 2024-03-13 08:55:55,164 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ADD_TO_META 2024-03-13 08:55:55,166 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710320155166"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1710320155166"}]},"ts":"1710320155166"} 2024-03-13 08:55:55,169 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-13 08:55:55,171 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-13 08:55:55,171 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710320155171"}]},"ts":"1710320155171"} 2024-03-13 08:55:55,173 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLING in hbase:meta 2024-03-13 08:55:55,177 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-13 08:55:55,178 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-13 08:55:55,179 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-13 08:55:55,179 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-13 08:55:55,179 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=f6346d02b0268607bd7cdba7ed86ddef, ASSIGN}] 2024-03-13 08:55:55,180 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=f6346d02b0268607bd7cdba7ed86ddef, ASSIGN 2024-03-13 08:55:55,182 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin0, region=f6346d02b0268607bd7cdba7ed86ddef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46097,1710320151924; forceNewPlan=false, retain=false 2024-03-13 08:55:55,332 INFO [jenkins-hbase4:36183] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-13 08:55:55,333 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f6346d02b0268607bd7cdba7ed86ddef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46097,1710320151924 2024-03-13 08:55:55,333 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710320155333"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1710320155333"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1710320155333"}]},"ts":"1710320155333"} 2024-03-13 08:55:55,336 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; OpenRegionProcedure f6346d02b0268607bd7cdba7ed86ddef, server=jenkins-hbase4.apache.org,46097,1710320151924}] 2024-03-13 08:55:55,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-03-13 08:55:55,489 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46097,1710320151924 2024-03-13 08:55:55,496 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef. 2024-03-13 08:55:55,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f6346d02b0268607bd7cdba7ed86ddef, NAME => 'TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef.', STARTKEY => '', ENDKEY => ''} 2024-03-13 08:55:55,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin0 f6346d02b0268607bd7cdba7ed86ddef 2024-03-13 08:55:55,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-13 08:55:55,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f6346d02b0268607bd7cdba7ed86ddef 2024-03-13 08:55:55,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f6346d02b0268607bd7cdba7ed86ddef 2024-03-13 08:55:55,499 INFO [StoreOpener-f6346d02b0268607bd7cdba7ed86ddef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f6346d02b0268607bd7cdba7ed86ddef 2024-03-13 08:55:55,501 DEBUG [StoreOpener-f6346d02b0268607bd7cdba7ed86ddef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/default/TestQuotaAdmin0/f6346d02b0268607bd7cdba7ed86ddef/cf 2024-03-13 08:55:55,501 DEBUG [StoreOpener-f6346d02b0268607bd7cdba7ed86ddef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/default/TestQuotaAdmin0/f6346d02b0268607bd7cdba7ed86ddef/cf 2024-03-13 08:55:55,502 INFO [StoreOpener-f6346d02b0268607bd7cdba7ed86ddef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f6346d02b0268607bd7cdba7ed86ddef columnFamilyName cf 2024-03-13 08:55:55,502 INFO [StoreOpener-f6346d02b0268607bd7cdba7ed86ddef-1] regionserver.HStore(310): Store=f6346d02b0268607bd7cdba7ed86ddef/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-13 08:55:55,505 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/default/TestQuotaAdmin0/f6346d02b0268607bd7cdba7ed86ddef 2024-03-13 08:55:55,506 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/default/TestQuotaAdmin0/f6346d02b0268607bd7cdba7ed86ddef 2024-03-13 08:55:55,512 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f6346d02b0268607bd7cdba7ed86ddef 2024-03-13 08:55:55,515 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/default/TestQuotaAdmin0/f6346d02b0268607bd7cdba7ed86ddef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-13 08:55:55,516 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f6346d02b0268607bd7cdba7ed86ddef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67206221, jitterRate=0.0014507323503494263}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-13 08:55:55,516 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f6346d02b0268607bd7cdba7ed86ddef: 2024-03-13 08:55:55,518 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef., pid=14, masterSystemTime=1710320155489 2024-03-13 08:55:55,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef. 2024-03-13 08:55:55,520 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef. 2024-03-13 08:55:55,521 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f6346d02b0268607bd7cdba7ed86ddef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46097,1710320151924 2024-03-13 08:55:55,521 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710320155521"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1710320155521"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1710320155521"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1710320155521"}]},"ts":"1710320155521"} 2024-03-13 08:55:55,527 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=14, resume processing ppid=13 2024-03-13 08:55:55,527 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=14, ppid=13, state=SUCCESS; OpenRegionProcedure f6346d02b0268607bd7cdba7ed86ddef, server=jenkins-hbase4.apache.org,46097,1710320151924 in 188 msec 2024-03-13 08:55:55,531 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=13, resume processing ppid=12 2024-03-13 08:55:55,532 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=f6346d02b0268607bd7cdba7ed86ddef, ASSIGN in 348 msec 2024-03-13 08:55:55,533 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-13 08:55:55,533 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710320155533"}]},"ts":"1710320155533"} 2024-03-13 08:55:55,536 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLED in hbase:meta 2024-03-13 08:55:55,539 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_POST_OPERATION 2024-03-13 08:55:55,541 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=12, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin0 in 433 msec 2024-03-13 08:55:55,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-03-13 08:55:55,881 INFO [Listener at localhost/37591] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin0, procId: 12 completed 2024-03-13 08:55:55,881 DEBUG [Listener at localhost/37591] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin0 get assigned. Timeout = 60000ms 2024-03-13 08:55:55,882 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:55:55,886 INFO [Listener at localhost/37591] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin0 assigned to meta. Checking AM states. 2024-03-13 08:55:55,887 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:55:55,887 INFO [Listener at localhost/37591] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin0 assigned. 2024-03-13 08:55:55,887 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:55:55,901 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-03-13 08:55:55,904 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43058, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService 2024-03-13 08:55:55,904 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-13 08:55:55,906 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1075): Stored pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin1 2024-03-13 08:55:55,908 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_PRE_OPERATION 2024-03-13 08:55:55,909 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin1" procId is: 15 2024-03-13 08:55:55,911 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-13 08:55:55,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-03-13 08:55:55,913 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/default/TestQuotaAdmin1/ba9f757341ebe76352cdc1e5569076bf 2024-03-13 08:55:55,915 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/default/TestQuotaAdmin1/ba9f757341ebe76352cdc1e5569076bf empty. 2024-03-13 08:55:55,916 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/default/TestQuotaAdmin1/ba9f757341ebe76352cdc1e5569076bf 2024-03-13 08:55:55,916 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-03-13 08:55:55,941 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/default/TestQuotaAdmin1/.tabledesc/.tableinfo.0000000001 2024-03-13 08:55:55,943 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(7675): creating {ENCODED => ba9f757341ebe76352cdc1e5569076bf, NAME => 'TestQuotaAdmin1,,1710320155904.ba9f757341ebe76352cdc1e5569076bf.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp 2024-03-13 08:55:55,957 DEBUG [hconnection-0x20999bd0-metaLookup-shared--pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-13 08:55:55,959 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52706, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2024-03-13 08:55:55,960 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1710320155904.ba9f757341ebe76352cdc1e5569076bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-13 08:55:55,960 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1604): Closing ba9f757341ebe76352cdc1e5569076bf, disabling compactions & flushes 2024-03-13 08:55:55,960 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1710320155904.ba9f757341ebe76352cdc1e5569076bf. 2024-03-13 08:55:55,960 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1710320155904.ba9f757341ebe76352cdc1e5569076bf. 2024-03-13 08:55:55,960 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1710320155904.ba9f757341ebe76352cdc1e5569076bf. after waiting 0 ms 2024-03-13 08:55:55,961 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1710320155904.ba9f757341ebe76352cdc1e5569076bf. 2024-03-13 08:55:55,961 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1710320155904.ba9f757341ebe76352cdc1e5569076bf. 2024-03-13 08:55:55,961 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1558): Region close journal for ba9f757341ebe76352cdc1e5569076bf: 2024-03-13 08:55:55,965 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ADD_TO_META 2024-03-13 08:55:55,968 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1710320155904.ba9f757341ebe76352cdc1e5569076bf.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710320155967"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1710320155967"}]},"ts":"1710320155967"} 2024-03-13 08:55:55,970 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-13 08:55:55,971 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-13 08:55:55,971 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710320155971"}]},"ts":"1710320155971"} 2024-03-13 08:55:55,973 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLING in hbase:meta 2024-03-13 08:55:55,978 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-13 08:55:55,979 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-13 08:55:55,980 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-13 08:55:55,980 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-13 08:55:55,980 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=ba9f757341ebe76352cdc1e5569076bf, ASSIGN}] 2024-03-13 08:55:55,981 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=ba9f757341ebe76352cdc1e5569076bf, ASSIGN 2024-03-13 08:55:55,983 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin1, region=ba9f757341ebe76352cdc1e5569076bf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46097,1710320151924; forceNewPlan=false, retain=false 2024-03-13 08:55:56,133 INFO [jenkins-hbase4:36183] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-13 08:55:56,134 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=ba9f757341ebe76352cdc1e5569076bf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46097,1710320151924 2024-03-13 08:55:56,134 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1710320155904.ba9f757341ebe76352cdc1e5569076bf.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710320156134"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1710320156134"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1710320156134"}]},"ts":"1710320156134"} 2024-03-13 08:55:56,137 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure ba9f757341ebe76352cdc1e5569076bf, server=jenkins-hbase4.apache.org,46097,1710320151924}] 2024-03-13 08:55:56,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-03-13 08:55:56,289 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46097,1710320151924 2024-03-13 08:55:56,294 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin1,,1710320155904.ba9f757341ebe76352cdc1e5569076bf. 2024-03-13 08:55:56,294 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ba9f757341ebe76352cdc1e5569076bf, NAME => 'TestQuotaAdmin1,,1710320155904.ba9f757341ebe76352cdc1e5569076bf.', STARTKEY => '', ENDKEY => ''} 2024-03-13 08:55:56,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin1 ba9f757341ebe76352cdc1e5569076bf 2024-03-13 08:55:56,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1710320155904.ba9f757341ebe76352cdc1e5569076bf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-13 08:55:56,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ba9f757341ebe76352cdc1e5569076bf 2024-03-13 08:55:56,295 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ba9f757341ebe76352cdc1e5569076bf 2024-03-13 08:55:56,297 INFO [StoreOpener-ba9f757341ebe76352cdc1e5569076bf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ba9f757341ebe76352cdc1e5569076bf 2024-03-13 08:55:56,299 DEBUG [StoreOpener-ba9f757341ebe76352cdc1e5569076bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/default/TestQuotaAdmin1/ba9f757341ebe76352cdc1e5569076bf/cf 2024-03-13 08:55:56,299 DEBUG [StoreOpener-ba9f757341ebe76352cdc1e5569076bf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/default/TestQuotaAdmin1/ba9f757341ebe76352cdc1e5569076bf/cf 2024-03-13 08:55:56,299 INFO [StoreOpener-ba9f757341ebe76352cdc1e5569076bf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ba9f757341ebe76352cdc1e5569076bf columnFamilyName cf 2024-03-13 08:55:56,300 INFO [StoreOpener-ba9f757341ebe76352cdc1e5569076bf-1] regionserver.HStore(310): Store=ba9f757341ebe76352cdc1e5569076bf/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-13 08:55:56,302 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/default/TestQuotaAdmin1/ba9f757341ebe76352cdc1e5569076bf 2024-03-13 08:55:56,303 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/default/TestQuotaAdmin1/ba9f757341ebe76352cdc1e5569076bf 2024-03-13 08:55:56,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ba9f757341ebe76352cdc1e5569076bf 2024-03-13 08:55:56,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/default/TestQuotaAdmin1/ba9f757341ebe76352cdc1e5569076bf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-13 08:55:56,314 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ba9f757341ebe76352cdc1e5569076bf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70998797, jitterRate=0.057964518666267395}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-13 08:55:56,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ba9f757341ebe76352cdc1e5569076bf: 2024-03-13 08:55:56,316 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin1,,1710320155904.ba9f757341ebe76352cdc1e5569076bf., pid=17, masterSystemTime=1710320156289 2024-03-13 08:55:56,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin1,,1710320155904.ba9f757341ebe76352cdc1e5569076bf. 2024-03-13 08:55:56,318 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin1,,1710320155904.ba9f757341ebe76352cdc1e5569076bf. 2024-03-13 08:55:56,319 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=ba9f757341ebe76352cdc1e5569076bf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46097,1710320151924 2024-03-13 08:55:56,319 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin1,,1710320155904.ba9f757341ebe76352cdc1e5569076bf.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710320156319"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1710320156319"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1710320156319"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1710320156319"}]},"ts":"1710320156319"} 2024-03-13 08:55:56,325 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=17, resume processing ppid=16 2024-03-13 08:55:56,325 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure ba9f757341ebe76352cdc1e5569076bf, server=jenkins-hbase4.apache.org,46097,1710320151924 in 185 msec 2024-03-13 08:55:56,328 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=16, resume processing ppid=15 2024-03-13 08:55:56,330 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=ba9f757341ebe76352cdc1e5569076bf, ASSIGN in 345 msec 2024-03-13 08:55:56,331 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-13 08:55:56,331 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710320156331"}]},"ts":"1710320156331"} 2024-03-13 08:55:56,333 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLED in hbase:meta 2024-03-13 08:55:56,337 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_POST_OPERATION 2024-03-13 08:55:56,339 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=15, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin1 in 432 msec 2024-03-13 08:55:56,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-03-13 08:55:56,665 INFO [Listener at localhost/37591] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin1, procId: 15 completed 2024-03-13 08:55:56,665 DEBUG [Listener at localhost/37591] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin1 get assigned. Timeout = 60000ms 2024-03-13 08:55:56,666 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:55:56,669 INFO [Listener at localhost/37591] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin1 assigned to meta. Checking AM states. 2024-03-13 08:55:56,669 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:55:56,669 INFO [Listener at localhost/37591] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin1 assigned. 2024-03-13 08:55:56,669 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:55:56,682 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-13 08:55:56,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1075): Stored pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin2 2024-03-13 08:55:56,686 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_PRE_OPERATION 2024-03-13 08:55:56,687 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin2" procId is: 18 2024-03-13 08:55:56,688 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-13 08:55:56,688 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-03-13 08:55:56,690 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/default/TestQuotaAdmin2/912b54ba69c1c1aeda52bbf586d77095 2024-03-13 08:55:56,691 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/default/TestQuotaAdmin2/912b54ba69c1c1aeda52bbf586d77095 empty. 2024-03-13 08:55:56,692 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/default/TestQuotaAdmin2/912b54ba69c1c1aeda52bbf586d77095 2024-03-13 08:55:56,692 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-03-13 08:55:56,713 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/default/TestQuotaAdmin2/.tabledesc/.tableinfo.0000000001 2024-03-13 08:55:56,714 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(7675): creating {ENCODED => 912b54ba69c1c1aeda52bbf586d77095, NAME => 'TestQuotaAdmin2,,1710320156682.912b54ba69c1c1aeda52bbf586d77095.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp 2024-03-13 08:55:56,730 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1710320156682.912b54ba69c1c1aeda52bbf586d77095.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-13 08:55:56,730 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1604): Closing 912b54ba69c1c1aeda52bbf586d77095, disabling compactions & flushes 2024-03-13 08:55:56,730 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1710320156682.912b54ba69c1c1aeda52bbf586d77095. 2024-03-13 08:55:56,730 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1710320156682.912b54ba69c1c1aeda52bbf586d77095. 2024-03-13 08:55:56,731 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1710320156682.912b54ba69c1c1aeda52bbf586d77095. after waiting 0 ms 2024-03-13 08:55:56,731 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1710320156682.912b54ba69c1c1aeda52bbf586d77095. 2024-03-13 08:55:56,731 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1710320156682.912b54ba69c1c1aeda52bbf586d77095. 2024-03-13 08:55:56,731 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1558): Region close journal for 912b54ba69c1c1aeda52bbf586d77095: 2024-03-13 08:55:56,735 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ADD_TO_META 2024-03-13 08:55:56,737 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1710320156682.912b54ba69c1c1aeda52bbf586d77095.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710320156737"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1710320156737"}]},"ts":"1710320156737"} 2024-03-13 08:55:56,740 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-13 08:55:56,741 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-13 08:55:56,741 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710320156741"}]},"ts":"1710320156741"} 2024-03-13 08:55:56,743 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLING in hbase:meta 2024-03-13 08:55:56,748 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-13 08:55:56,749 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-13 08:55:56,749 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-13 08:55:56,749 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-13 08:55:56,749 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=912b54ba69c1c1aeda52bbf586d77095, ASSIGN}] 2024-03-13 08:55:56,750 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=912b54ba69c1c1aeda52bbf586d77095, ASSIGN 2024-03-13 08:55:56,752 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin2, region=912b54ba69c1c1aeda52bbf586d77095, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46627,1710320151969; forceNewPlan=false, retain=false 2024-03-13 08:55:56,902 INFO [jenkins-hbase4:36183] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-13 08:55:56,903 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=912b54ba69c1c1aeda52bbf586d77095, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46627,1710320151969 2024-03-13 08:55:56,904 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1710320156682.912b54ba69c1c1aeda52bbf586d77095.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710320156903"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1710320156903"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1710320156903"}]},"ts":"1710320156903"} 2024-03-13 08:55:56,907 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE; OpenRegionProcedure 912b54ba69c1c1aeda52bbf586d77095, server=jenkins-hbase4.apache.org,46627,1710320151969}] 2024-03-13 08:55:56,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-03-13 08:55:57,060 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46627,1710320151969 2024-03-13 08:55:57,066 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin2,,1710320156682.912b54ba69c1c1aeda52bbf586d77095. 2024-03-13 08:55:57,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 912b54ba69c1c1aeda52bbf586d77095, NAME => 'TestQuotaAdmin2,,1710320156682.912b54ba69c1c1aeda52bbf586d77095.', STARTKEY => '', ENDKEY => ''} 2024-03-13 08:55:57,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin2 912b54ba69c1c1aeda52bbf586d77095 2024-03-13 08:55:57,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1710320156682.912b54ba69c1c1aeda52bbf586d77095.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-13 08:55:57,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 912b54ba69c1c1aeda52bbf586d77095 2024-03-13 08:55:57,067 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 912b54ba69c1c1aeda52bbf586d77095 2024-03-13 08:55:57,069 INFO [StoreOpener-912b54ba69c1c1aeda52bbf586d77095-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 912b54ba69c1c1aeda52bbf586d77095 2024-03-13 08:55:57,071 DEBUG [StoreOpener-912b54ba69c1c1aeda52bbf586d77095-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/default/TestQuotaAdmin2/912b54ba69c1c1aeda52bbf586d77095/cf 2024-03-13 08:55:57,071 DEBUG [StoreOpener-912b54ba69c1c1aeda52bbf586d77095-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/default/TestQuotaAdmin2/912b54ba69c1c1aeda52bbf586d77095/cf 2024-03-13 08:55:57,072 INFO [StoreOpener-912b54ba69c1c1aeda52bbf586d77095-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 912b54ba69c1c1aeda52bbf586d77095 columnFamilyName cf 2024-03-13 08:55:57,072 INFO [StoreOpener-912b54ba69c1c1aeda52bbf586d77095-1] regionserver.HStore(310): Store=912b54ba69c1c1aeda52bbf586d77095/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-13 08:55:57,074 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/default/TestQuotaAdmin2/912b54ba69c1c1aeda52bbf586d77095 2024-03-13 08:55:57,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/default/TestQuotaAdmin2/912b54ba69c1c1aeda52bbf586d77095 2024-03-13 08:55:57,081 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 912b54ba69c1c1aeda52bbf586d77095 2024-03-13 08:55:57,084 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/default/TestQuotaAdmin2/912b54ba69c1c1aeda52bbf586d77095/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-13 08:55:57,085 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 912b54ba69c1c1aeda52bbf586d77095; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74855052, jitterRate=0.11542719602584839}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-13 08:55:57,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 912b54ba69c1c1aeda52bbf586d77095: 2024-03-13 08:55:57,086 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin2,,1710320156682.912b54ba69c1c1aeda52bbf586d77095., pid=20, masterSystemTime=1710320157060 2024-03-13 08:55:57,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin2,,1710320156682.912b54ba69c1c1aeda52bbf586d77095. 2024-03-13 08:55:57,089 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin2,,1710320156682.912b54ba69c1c1aeda52bbf586d77095. 2024-03-13 08:55:57,089 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=912b54ba69c1c1aeda52bbf586d77095, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46627,1710320151969 2024-03-13 08:55:57,090 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin2,,1710320156682.912b54ba69c1c1aeda52bbf586d77095.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710320157089"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1710320157089"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1710320157089"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1710320157089"}]},"ts":"1710320157089"} 2024-03-13 08:55:57,095 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=20, resume processing ppid=19 2024-03-13 08:55:57,095 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=20, ppid=19, state=SUCCESS; OpenRegionProcedure 912b54ba69c1c1aeda52bbf586d77095, server=jenkins-hbase4.apache.org,46627,1710320151969 in 185 msec 2024-03-13 08:55:57,098 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=19, resume processing ppid=18 2024-03-13 08:55:57,099 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=19, ppid=18, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=912b54ba69c1c1aeda52bbf586d77095, ASSIGN in 346 msec 2024-03-13 08:55:57,100 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-13 08:55:57,100 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710320157100"}]},"ts":"1710320157100"} 2024-03-13 08:55:57,102 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLED in hbase:meta 2024-03-13 08:55:57,106 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_POST_OPERATION 2024-03-13 08:55:57,108 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=18, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin2 in 424 msec 2024-03-13 08:55:57,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-03-13 08:55:57,443 INFO [Listener at localhost/37591] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin2, procId: 18 completed 2024-03-13 08:55:57,443 DEBUG [Listener at localhost/37591] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin2 get assigned. Timeout = 60000ms 2024-03-13 08:55:57,443 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:55:57,447 INFO [Listener at localhost/37591] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin2 assigned to meta. Checking AM states. 2024-03-13 08:55:57,447 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:55:57,447 INFO [Listener at localhost/37591] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin2 assigned. 2024-03-13 08:55:57,447 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:55:57,457 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-03-13 08:55:57,461 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43068, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=MasterService 2024-03-13 08:55:57,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$15(3020): Client=jenkins//172.31.14.131 creating {NAME => 'TestNs'} 2024-03-13 08:55:57,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1075): Stored pid=21, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=TestNs 2024-03-13 08:55:57,474 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-13 08:55:57,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-03-13 08:55:57,475 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36602, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2024-03-13 08:55:57,481 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-03-13 08:55:57,488 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=21, state=SUCCESS; CreateNamespaceProcedure, namespace=TestNs in 20 msec 2024-03-13 08:55:57,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-03-13 08:55:57,728 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-13 08:55:57,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1075): Stored pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestNs:TestTable 2024-03-13 08:55:57,732 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_PRE_OPERATION 2024-03-13 08:55:57,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "TestNs" qualifier: "TestTable" procId is: 22 2024-03-13 08:55:57,734 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-13 08:55:57,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-03-13 08:55:57,737 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/TestNs/TestTable/0fae0ac94cc227caa598483ceecbd88f 2024-03-13 08:55:57,737 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/TestNs/TestTable/e1e5c459519a2cf7173ca851e8c62095 2024-03-13 08:55:57,738 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/TestNs/TestTable/0fae0ac94cc227caa598483ceecbd88f empty. 2024-03-13 08:55:57,738 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/TestNs/TestTable/e1e5c459519a2cf7173ca851e8c62095 empty. 2024-03-13 08:55:57,739 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/TestNs/TestTable/0fae0ac94cc227caa598483ceecbd88f 2024-03-13 08:55:57,739 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/TestNs/TestTable/e1e5c459519a2cf7173ca851e8c62095 2024-03-13 08:55:57,739 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-03-13 08:55:57,756 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/TestNs/TestTable/.tabledesc/.tableinfo.0000000001 2024-03-13 08:55:57,758 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0fae0ac94cc227caa598483ceecbd88f, NAME => 'TestNs:TestTable,,1710320157728.0fae0ac94cc227caa598483ceecbd88f.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp 2024-03-13 08:55:57,759 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(7675): creating {ENCODED => e1e5c459519a2cf7173ca851e8c62095, NAME => 'TestNs:TestTable,1,1710320157728.e1e5c459519a2cf7173ca851e8c62095.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp 2024-03-13 08:55:57,777 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1710320157728.0fae0ac94cc227caa598483ceecbd88f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-13 08:55:57,777 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1604): Closing 0fae0ac94cc227caa598483ceecbd88f, disabling compactions & flushes 2024-03-13 08:55:57,778 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1710320157728.0fae0ac94cc227caa598483ceecbd88f. 2024-03-13 08:55:57,778 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1710320157728.0fae0ac94cc227caa598483ceecbd88f. 2024-03-13 08:55:57,778 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1710320157728.0fae0ac94cc227caa598483ceecbd88f. after waiting 0 ms 2024-03-13 08:55:57,778 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1710320157728.0fae0ac94cc227caa598483ceecbd88f. 2024-03-13 08:55:57,778 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1710320157728.0fae0ac94cc227caa598483ceecbd88f. 2024-03-13 08:55:57,778 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1558): Region close journal for 0fae0ac94cc227caa598483ceecbd88f: 2024-03-13 08:55:57,780 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1710320157728.e1e5c459519a2cf7173ca851e8c62095.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-13 08:55:57,781 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1604): Closing e1e5c459519a2cf7173ca851e8c62095, disabling compactions & flushes 2024-03-13 08:55:57,781 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1710320157728.e1e5c459519a2cf7173ca851e8c62095. 2024-03-13 08:55:57,781 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1710320157728.e1e5c459519a2cf7173ca851e8c62095. 2024-03-13 08:55:57,781 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1710320157728.e1e5c459519a2cf7173ca851e8c62095. after waiting 0 ms 2024-03-13 08:55:57,781 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1710320157728.e1e5c459519a2cf7173ca851e8c62095. 2024-03-13 08:55:57,781 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1710320157728.e1e5c459519a2cf7173ca851e8c62095. 2024-03-13 08:55:57,781 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1558): Region close journal for e1e5c459519a2cf7173ca851e8c62095: 2024-03-13 08:55:57,785 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ADD_TO_META 2024-03-13 08:55:57,786 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,,1710320157728.0fae0ac94cc227caa598483ceecbd88f.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1710320157786"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1710320157786"}]},"ts":"1710320157786"} 2024-03-13 08:55:57,786 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1710320157728.e1e5c459519a2cf7173ca851e8c62095.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1710320157786"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1710320157786"}]},"ts":"1710320157786"} 2024-03-13 08:55:57,793 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2024-03-13 08:55:57,795 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-13 08:55:57,795 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710320157795"}]},"ts":"1710320157795"} 2024-03-13 08:55:57,797 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLING in hbase:meta 2024-03-13 08:55:57,801 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-13 08:55:57,803 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-13 08:55:57,803 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-13 08:55:57,803 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-13 08:55:57,804 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=0fae0ac94cc227caa598483ceecbd88f, ASSIGN}, {pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=e1e5c459519a2cf7173ca851e8c62095, ASSIGN}] 2024-03-13 08:55:57,805 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=e1e5c459519a2cf7173ca851e8c62095, ASSIGN 2024-03-13 08:55:57,805 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=0fae0ac94cc227caa598483ceecbd88f, ASSIGN 2024-03-13 08:55:57,807 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=0fae0ac94cc227caa598483ceecbd88f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46627,1710320151969; forceNewPlan=false, retain=false 2024-03-13 08:55:57,807 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=e1e5c459519a2cf7173ca851e8c62095, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46097,1710320151924; forceNewPlan=false, retain=false 2024-03-13 08:55:57,957 INFO [jenkins-hbase4:36183] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2024-03-13 08:55:57,958 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=e1e5c459519a2cf7173ca851e8c62095, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46097,1710320151924 2024-03-13 08:55:57,958 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=0fae0ac94cc227caa598483ceecbd88f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46627,1710320151969 2024-03-13 08:55:57,959 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1710320157728.e1e5c459519a2cf7173ca851e8c62095.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1710320157958"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1710320157958"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1710320157958"}]},"ts":"1710320157958"} 2024-03-13 08:55:57,959 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1710320157728.0fae0ac94cc227caa598483ceecbd88f.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1710320157958"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1710320157958"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1710320157958"}]},"ts":"1710320157958"} 2024-03-13 08:55:57,961 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; OpenRegionProcedure 0fae0ac94cc227caa598483ceecbd88f, server=jenkins-hbase4.apache.org,46627,1710320151969}] 2024-03-13 08:55:57,963 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=26, ppid=24, state=RUNNABLE; OpenRegionProcedure e1e5c459519a2cf7173ca851e8c62095, server=jenkins-hbase4.apache.org,46097,1710320151924}] 2024-03-13 08:55:57,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-03-13 08:55:58,114 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46627,1710320151969 2024-03-13 08:55:58,116 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46097,1710320151924 2024-03-13 08:55:58,120 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,,1710320157728.0fae0ac94cc227caa598483ceecbd88f. 2024-03-13 08:55:58,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0fae0ac94cc227caa598483ceecbd88f, NAME => 'TestNs:TestTable,,1710320157728.0fae0ac94cc227caa598483ceecbd88f.', STARTKEY => '', ENDKEY => '1'} 2024-03-13 08:55:58,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable 0fae0ac94cc227caa598483ceecbd88f 2024-03-13 08:55:58,120 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1710320157728.0fae0ac94cc227caa598483ceecbd88f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-13 08:55:58,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0fae0ac94cc227caa598483ceecbd88f 2024-03-13 08:55:58,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0fae0ac94cc227caa598483ceecbd88f 2024-03-13 08:55:58,121 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,1,1710320157728.e1e5c459519a2cf7173ca851e8c62095. 2024-03-13 08:55:58,121 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e1e5c459519a2cf7173ca851e8c62095, NAME => 'TestNs:TestTable,1,1710320157728.e1e5c459519a2cf7173ca851e8c62095.', STARTKEY => '1', ENDKEY => ''} 2024-03-13 08:55:58,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable e1e5c459519a2cf7173ca851e8c62095 2024-03-13 08:55:58,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1710320157728.e1e5c459519a2cf7173ca851e8c62095.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-13 08:55:58,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e1e5c459519a2cf7173ca851e8c62095 2024-03-13 08:55:58,122 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e1e5c459519a2cf7173ca851e8c62095 2024-03-13 08:55:58,122 INFO [StoreOpener-0fae0ac94cc227caa598483ceecbd88f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0fae0ac94cc227caa598483ceecbd88f 2024-03-13 08:55:58,124 INFO [StoreOpener-e1e5c459519a2cf7173ca851e8c62095-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e1e5c459519a2cf7173ca851e8c62095 2024-03-13 08:55:58,125 DEBUG [StoreOpener-0fae0ac94cc227caa598483ceecbd88f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/TestNs/TestTable/0fae0ac94cc227caa598483ceecbd88f/cf 2024-03-13 08:55:58,125 DEBUG [StoreOpener-0fae0ac94cc227caa598483ceecbd88f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/TestNs/TestTable/0fae0ac94cc227caa598483ceecbd88f/cf 2024-03-13 08:55:58,125 INFO [StoreOpener-0fae0ac94cc227caa598483ceecbd88f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0fae0ac94cc227caa598483ceecbd88f columnFamilyName cf 2024-03-13 08:55:58,126 DEBUG [StoreOpener-e1e5c459519a2cf7173ca851e8c62095-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/TestNs/TestTable/e1e5c459519a2cf7173ca851e8c62095/cf 2024-03-13 08:55:58,126 DEBUG [StoreOpener-e1e5c459519a2cf7173ca851e8c62095-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/TestNs/TestTable/e1e5c459519a2cf7173ca851e8c62095/cf 2024-03-13 08:55:58,126 INFO [StoreOpener-0fae0ac94cc227caa598483ceecbd88f-1] regionserver.HStore(310): Store=0fae0ac94cc227caa598483ceecbd88f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-13 08:55:58,128 INFO [StoreOpener-e1e5c459519a2cf7173ca851e8c62095-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e1e5c459519a2cf7173ca851e8c62095 columnFamilyName cf 2024-03-13 08:55:58,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/TestNs/TestTable/0fae0ac94cc227caa598483ceecbd88f 2024-03-13 08:55:58,128 INFO [StoreOpener-e1e5c459519a2cf7173ca851e8c62095-1] regionserver.HStore(310): Store=e1e5c459519a2cf7173ca851e8c62095/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-13 08:55:58,130 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/TestNs/TestTable/0fae0ac94cc227caa598483ceecbd88f 2024-03-13 08:55:58,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/TestNs/TestTable/e1e5c459519a2cf7173ca851e8c62095 2024-03-13 08:55:58,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/TestNs/TestTable/e1e5c459519a2cf7173ca851e8c62095 2024-03-13 08:55:58,134 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0fae0ac94cc227caa598483ceecbd88f 2024-03-13 08:55:58,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e1e5c459519a2cf7173ca851e8c62095 2024-03-13 08:55:58,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/TestNs/TestTable/0fae0ac94cc227caa598483ceecbd88f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-13 08:55:58,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0fae0ac94cc227caa598483ceecbd88f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63228859, jitterRate=-0.057816579937934875}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-13 08:55:58,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0fae0ac94cc227caa598483ceecbd88f: 2024-03-13 08:55:58,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestNs:TestTable,,1710320157728.0fae0ac94cc227caa598483ceecbd88f., pid=25, masterSystemTime=1710320158114 2024-03-13 08:55:58,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/TestNs/TestTable/e1e5c459519a2cf7173ca851e8c62095/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-13 08:55:58,143 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestNs:TestTable,,1710320157728.0fae0ac94cc227caa598483ceecbd88f. 2024-03-13 08:55:58,143 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,,1710320157728.0fae0ac94cc227caa598483ceecbd88f. 2024-03-13 08:55:58,143 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e1e5c459519a2cf7173ca851e8c62095; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74690647, jitterRate=0.11297737061977386}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-13 08:55:58,144 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e1e5c459519a2cf7173ca851e8c62095: 2024-03-13 08:55:58,144 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=0fae0ac94cc227caa598483ceecbd88f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46627,1710320151969 2024-03-13 08:55:58,144 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,,1710320157728.0fae0ac94cc227caa598483ceecbd88f.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1710320158144"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1710320158144"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1710320158144"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1710320158144"}]},"ts":"1710320158144"} 2024-03-13 08:55:58,145 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestNs:TestTable,1,1710320157728.e1e5c459519a2cf7173ca851e8c62095., pid=26, masterSystemTime=1710320158116 2024-03-13 08:55:58,148 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestNs:TestTable,1,1710320157728.e1e5c459519a2cf7173ca851e8c62095. 2024-03-13 08:55:58,148 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,1,1710320157728.e1e5c459519a2cf7173ca851e8c62095. 2024-03-13 08:55:58,150 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=e1e5c459519a2cf7173ca851e8c62095, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46097,1710320151924 2024-03-13 08:55:58,151 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,1,1710320157728.e1e5c459519a2cf7173ca851e8c62095.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1710320158150"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1710320158150"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1710320158150"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1710320158150"}]},"ts":"1710320158150"} 2024-03-13 08:55:58,151 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=25, resume processing ppid=23 2024-03-13 08:55:58,151 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=25, ppid=23, state=SUCCESS; OpenRegionProcedure 0fae0ac94cc227caa598483ceecbd88f, server=jenkins-hbase4.apache.org,46627,1710320151969 in 187 msec 2024-03-13 08:55:58,154 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=23, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=0fae0ac94cc227caa598483ceecbd88f, ASSIGN in 347 msec 2024-03-13 08:55:58,157 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=26, resume processing ppid=24 2024-03-13 08:55:58,157 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=26, ppid=24, state=SUCCESS; OpenRegionProcedure e1e5c459519a2cf7173ca851e8c62095, server=jenkins-hbase4.apache.org,46097,1710320151924 in 191 msec 2024-03-13 08:55:58,159 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=24, resume processing ppid=22 2024-03-13 08:55:58,160 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=24, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=e1e5c459519a2cf7173ca851e8c62095, ASSIGN in 353 msec 2024-03-13 08:55:58,160 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-13 08:55:58,161 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710320158161"}]},"ts":"1710320158161"} 2024-03-13 08:55:58,162 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLED in hbase:meta 2024-03-13 08:55:58,166 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_POST_OPERATION 2024-03-13 08:55:58,168 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=22, state=SUCCESS; CreateTableProcedure table=TestNs:TestTable in 437 msec 2024-03-13 08:55:58,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-03-13 08:55:58,488 INFO [Listener at localhost/37591] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: TestNs:TestTable, procId: 22 completed 2024-03-13 08:55:58,488 DEBUG [Listener at localhost/37591] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestNs:TestTable get assigned. Timeout = 60000ms 2024-03-13 08:55:58,489 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:55:58,493 INFO [Listener at localhost/37591] hbase.HBaseTestingUtility(3484): All regions for table TestNs:TestTable assigned to meta. Checking AM states. 2024-03-13 08:55:58,493 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:55:58,493 INFO [Listener at localhost/37591] hbase.HBaseTestingUtility(3504): All regions for table TestNs:TestTable assigned. 2024-03-13 08:55:58,493 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:55:58,539 INFO [Listener at localhost/37591] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=309, OpenFileDescriptor=626, MaxFileDescriptor=60000, SystemLoadAverage=156, ProcessCount=168, AvailableMemoryMB=10546 2024-03-13 08:55:58,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-13 08:55:58,564 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36612, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-03-13 08:55:58,843 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:55:58,844 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-13 08:55:58,845 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710323758581 bypass), TestNs=QuotaState(ts=1710323758581 bypass)} 2024-03-13 08:55:58,845 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1710323758581 bypass), TestNs:TestTable=QuotaState(ts=1710323758581 bypass), TestQuotaAdmin1=QuotaState(ts=1710323758581 bypass)} 2024-03-13 08:55:58,845 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1710323758581 [ TestNs:TestTable ])} 2024-03-13 08:55:58,845 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710323758581 bypass)} 2024-03-13 08:55:59,095 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:55:59,096 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-13 08:55:59,096 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710323758581 bypass), TestNs=QuotaState(ts=1710323758581 bypass)} 2024-03-13 08:55:59,096 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1710323758581 bypass), TestQuotaAdmin2=QuotaState(ts=1710323758581 bypass)} 2024-03-13 08:55:59,096 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1710323758581 [ TestNs:TestTable ])} 2024-03-13 08:55:59,096 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710323758581 bypass)} 2024-03-13 08:55:59,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:55:59,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 90 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:52584 deadline: 1710320169111, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:55:59,131 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2024-03-13 08:55:59,225 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2024-03-13 08:55:59,226 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2024-03-13 08:55:59,227 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestNs:TestTable' 2024-03-13 08:55:59,227 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin2' 2024-03-13 08:55:59,228 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin0' 2024-03-13 08:55:59,229 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin1' 2024-03-13 08:55:59,230 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:quota' 2024-03-13 08:55:59,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:55:59,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 92 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:52584 deadline: 1710320169112, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:55:59,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:55:59,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 94 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:52584 deadline: 1710320169112, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:00,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:00,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 96 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:52584 deadline: 1710320169111, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:00,900 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-03-13 08:56:00,900 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver Metrics about HBase MasterObservers 2024-03-13 08:56:00,901 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-03-13 08:56:00,901 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2024-03-13 08:56:01,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:01,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 98 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:52584 deadline: 1710320169112, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:04,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:04,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 100 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:52584 deadline: 1710320169111, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:04,406 ERROR [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10311: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1710320157728.e1e5c459519a2cf7173ca851e8c62095., hostname=jenkins-hbase4.apache.org,46097,1710320151924, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-13 08:56:04,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:04,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 101 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:52584 deadline: 1710320174409, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:04,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:04,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 103 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:52584 deadline: 1710320174410, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:05,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:05,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 105 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:52584 deadline: 1710320174409, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:05,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:05,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 107 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:52584 deadline: 1710320174410, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:07,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:07,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 109 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:52584 deadline: 1710320174410, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:09,725 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:09,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 111 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:52584 deadline: 1710320174409, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:09,727 ERROR [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10342: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1710320157728.e1e5c459519a2cf7173ca851e8c62095., hostname=jenkins-hbase4.apache.org,46097,1710320151924, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-13 08:56:09,986 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:56:09,987 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-13 08:56:09,987 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710327358581 bypass), TestNs=QuotaState(ts=1710327358581 bypass)} 2024-03-13 08:56:09,987 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1710327358581 bypass), TestNs:TestTable=QuotaState(ts=1710327358581 bypass), TestQuotaAdmin1=QuotaState(ts=1710327358581 bypass)} 2024-03-13 08:56:09,987 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1710327358581 bypass)} 2024-03-13 08:56:09,987 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710327358581 bypass)} 2024-03-13 08:56:10,237 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:56:10,237 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-13 08:56:10,237 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710327358581 bypass), TestNs=QuotaState(ts=1710327358581 bypass)} 2024-03-13 08:56:10,237 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1710327358581 bypass), TestQuotaAdmin2=QuotaState(ts=1710327358581 bypass)} 2024-03-13 08:56:10,237 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1710327358581 bypass)} 2024-03-13 08:56:10,237 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710327358581 bypass)} 2024-03-13 08:56:10,254 INFO [Listener at localhost/37591] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=292 (was 309), OpenFileDescriptor=603 (was 626), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=154 (was 156), ProcessCount=168 (was 168), AvailableMemoryMB=10483 (was 10546) 2024-03-13 08:56:10,268 INFO [Listener at localhost/37591] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=292, OpenFileDescriptor=603, MaxFileDescriptor=60000, SystemLoadAverage=154, ProcessCount=168, AvailableMemoryMB=10482 2024-03-13 08:56:10,533 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:56:10,533 INFO [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-03-13 08:56:10,784 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-13 08:56:10,785 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710330958681 bypass), TestNs=QuotaState(ts=1710330958681 bypass)} 2024-03-13 08:56:10,786 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1710330958681 bypass), TestNs:TestTable=QuotaState(ts=1710330958681 bypass), TestQuotaAdmin1=QuotaState(ts=1710330958681 bypass)} 2024-03-13 08:56:10,786 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1710330958681 [ default ])} 2024-03-13 08:56:10,786 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710330958681 bypass)} 2024-03-13 08:56:11,036 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:56:11,037 INFO [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-03-13 08:56:11,287 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-13 08:56:11,288 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710330958781 bypass), TestNs=QuotaState(ts=1710330958781 bypass)} 2024-03-13 08:56:11,290 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1710330958781 bypass), TestQuotaAdmin2=QuotaState(ts=1710330958781 bypass)} 2024-03-13 08:56:11,291 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1710330958781 [ default ])} 2024-03-13 08:56:11,291 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710330958781 bypass)} 2024-03-13 08:56:11,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-13 08:56:11,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 123 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:52584 deadline: 1710320181300, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-13 08:56:11,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-13 08:56:11,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 125 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:52584 deadline: 1710320181299, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-13 08:56:12,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-13 08:56:12,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 127 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:52584 deadline: 1710320181300, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-13 08:56:12,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-13 08:56:12,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 129 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52584 deadline: 1710320181299, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-13 08:56:14,079 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-13 08:56:14,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 131 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52584 deadline: 1710320181299, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-13 08:56:16,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-13 08:56:16,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 133 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52584 deadline: 1710320181300, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-13 08:56:16,596 ERROR [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10339: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef., hostname=jenkins-hbase4.apache.org,46097,1710320151924, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:199) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-13 08:56:16,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:16,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 140 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52584 deadline: 1710320186621, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:16,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:16,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 142 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52584 deadline: 1710320186621, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:17,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:17,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 144 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52584 deadline: 1710320186620, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:18,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:18,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 146 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52584 deadline: 1710320186621, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:19,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:19,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 148 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52584 deadline: 1710320186621, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:21,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:21,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 150 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52584 deadline: 1710320186621, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:21,929 ERROR [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10331: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef., hostname=jenkins-hbase4.apache.org,46097,1710320151924, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:200) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-13 08:56:22,188 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:56:22,189 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-13 08:56:22,189 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710334558781 bypass), TestNs=QuotaState(ts=1710334558781 bypass)} 2024-03-13 08:56:22,189 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1710334558781 bypass), TestNs:TestTable=QuotaState(ts=1710334558781 bypass), TestQuotaAdmin1=QuotaState(ts=1710334558781 bypass)} 2024-03-13 08:56:22,189 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1710334558781 bypass)} 2024-03-13 08:56:22,189 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710334558781 bypass)} 2024-03-13 08:56:22,439 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:56:22,439 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-13 08:56:22,439 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710334558781 bypass), TestNs=QuotaState(ts=1710334558781 bypass)} 2024-03-13 08:56:22,440 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1710334558781 bypass), TestQuotaAdmin2=QuotaState(ts=1710334558781 bypass)} 2024-03-13 08:56:22,440 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1710334558781 bypass)} 2024-03-13 08:56:22,440 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710334558781 bypass)} 2024-03-13 08:56:22,453 INFO [Listener at localhost/37591] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=292 (was 292), OpenFileDescriptor=599 (was 603), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=162 (was 154) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=10425 (was 10482) 2024-03-13 08:56:22,466 INFO [Listener at localhost/37591] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=292, OpenFileDescriptor=599, MaxFileDescriptor=60000, SystemLoadAverage=162, ProcessCount=168, AvailableMemoryMB=10425 2024-03-13 08:56:22,728 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:56:22,728 INFO [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-03-13 08:56:22,979 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-13 08:56:22,980 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710338158881 bypass), TestNs=QuotaState(ts=1710338158881 bypass)} 2024-03-13 08:56:22,980 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1710338158881 bypass), TestNs:TestTable=QuotaState(ts=1710338158881 bypass), TestQuotaAdmin1=QuotaState(ts=1710338158881 bypass)} 2024-03-13 08:56:22,980 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1710338158881 global-limiter)} 2024-03-13 08:56:22,981 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710338158881 bypass)} 2024-03-13 08:56:23,231 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:56:23,231 INFO [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-03-13 08:56:23,482 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-13 08:56:23,483 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710338158981 bypass), TestNs=QuotaState(ts=1710338158981 bypass)} 2024-03-13 08:56:23,483 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1710338158981 bypass), TestQuotaAdmin2=QuotaState(ts=1710338158981 bypass)} 2024-03-13 08:56:23,483 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1710338158981 global-limiter)} 2024-03-13 08:56:23,484 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710338158981 bypass)} 2024-03-13 08:56:23,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:23,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 163 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52584 deadline: 1710320193503, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:23,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:23,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 165 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52584 deadline: 1710320193503, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:24,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:24,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 167 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52584 deadline: 1710320193503, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:25,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:25,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 169 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52584 deadline: 1710320193502, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:26,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:26,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 171 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52584 deadline: 1710320193503, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:28,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:28,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 173 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52584 deadline: 1710320193503, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:28,813 ERROR [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10333: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef., hostname=jenkins-hbase4.apache.org,46097,1710320151924, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:178) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-13 08:56:28,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-13 08:56:28,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 177 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52584 deadline: 1710320198820, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-13 08:56:29,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-13 08:56:29,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 179 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52584 deadline: 1710320198820, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-13 08:56:29,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-13 08:56:29,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 181 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52584 deadline: 1710320198820, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-13 08:56:30,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-13 08:56:30,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 183 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52584 deadline: 1710320198821, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-13 08:56:31,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-13 08:56:31,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 185 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52584 deadline: 1710320198821, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-13 08:56:34,119 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-13 08:56:34,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 187 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52584 deadline: 1710320198821, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-13 08:56:34,120 ERROR [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=3 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10306: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-3' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef., hostname=jenkins-hbase4.apache.org,46097,1710320151924, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-13 08:56:34,378 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:56:34,379 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-13 08:56:34,379 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710341758981 bypass), TestNs=QuotaState(ts=1710341758981 bypass)} 2024-03-13 08:56:34,379 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1710341758981 bypass), TestNs:TestTable=QuotaState(ts=1710341758981 bypass), TestQuotaAdmin1=QuotaState(ts=1710341758981 bypass)} 2024-03-13 08:56:34,379 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1710341758981 bypass)} 2024-03-13 08:56:34,379 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710341758981 bypass)} 2024-03-13 08:56:34,629 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:56:34,630 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-13 08:56:34,630 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710341758981 bypass), TestNs=QuotaState(ts=1710341758981 bypass)} 2024-03-13 08:56:34,630 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1710341758981 bypass), TestQuotaAdmin2=QuotaState(ts=1710341758981 bypass)} 2024-03-13 08:56:34,630 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1710341758981 bypass)} 2024-03-13 08:56:34,630 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710341758981 bypass)} 2024-03-13 08:56:34,645 INFO [Listener at localhost/37591] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=283 (was 292), OpenFileDescriptor=597 (was 599), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=140 (was 162), ProcessCount=168 (was 168), AvailableMemoryMB=10399 (was 10425) 2024-03-13 08:56:34,675 INFO [Listener at localhost/37591] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=283, OpenFileDescriptor=597, MaxFileDescriptor=60000, SystemLoadAverage=140, ProcessCount=168, AvailableMemoryMB=10398 2024-03-13 08:56:34,933 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:56:34,934 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-13 08:56:34,935 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710345358981 bypass), TestNs=QuotaState(ts=1710345358981 bypass)} 2024-03-13 08:56:34,937 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1710345358981 bypass), TestNs:TestTable=QuotaState(ts=1710345358981 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin1=QuotaState(ts=1710345358981 bypass)} 2024-03-13 08:56:34,937 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-13 08:56:34,938 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710345358981 bypass)} 2024-03-13 08:56:35,189 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:56:35,189 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-13 08:56:35,189 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710345358981 bypass), TestNs=QuotaState(ts=1710345358981 bypass)} 2024-03-13 08:56:35,190 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1710345358981 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin2=QuotaState(ts=1710345358981 bypass)} 2024-03-13 08:56:35,190 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-13 08:56:35,190 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710345358981 bypass)} 2024-03-13 08:56:35,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:35,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 202 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:52584 deadline: 1710320205208, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:35,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:35,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 204 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:52584 deadline: 1710320205208, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:35,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:35,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 206 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:52584 deadline: 1710320205208, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:36,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:36,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 208 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:52584 deadline: 1710320205208, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:37,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:37,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 210 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:52584 deadline: 1710320205207, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:40,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:40,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 212 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:52584 deadline: 1710320205208, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:40,492 ERROR [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10326: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1710320157728.e1e5c459519a2cf7173ca851e8c62095., hostname=jenkins-hbase4.apache.org,46097,1710320151924, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-13 08:56:40,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:40,494 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 213 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:52584 deadline: 1710320210493, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:40,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:40,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 215 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:52584 deadline: 1710320210493, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:41,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:41,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 217 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:52584 deadline: 1710320210494, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:42,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:42,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 219 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:52584 deadline: 1710320210493, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:43,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:43,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 221 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:52584 deadline: 1710320210494, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:45,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:45,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 223 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:52584 deadline: 1710320210494, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-13 08:56:45,778 ERROR [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10315: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1710320157728.e1e5c459519a2cf7173ca851e8c62095., hostname=jenkins-hbase4.apache.org,46097,1710320151924, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-13 08:56:46,037 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:56:46,037 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-13 08:56:46,037 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710348958981 bypass), TestNs=QuotaState(ts=1710348958981 bypass)} 2024-03-13 08:56:46,037 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1710348958981 bypass), TestNs:TestTable=QuotaState(ts=1710348958981 bypass), TestQuotaAdmin1=QuotaState(ts=1710348958981 bypass)} 2024-03-13 08:56:46,037 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1710348958981 bypass)} 2024-03-13 08:56:46,037 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710348958981 bypass)} 2024-03-13 08:56:46,288 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:56:46,288 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-13 08:56:46,288 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710348958981 bypass), TestNs=QuotaState(ts=1710348958981 bypass)} 2024-03-13 08:56:46,288 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1710348958981 bypass), TestQuotaAdmin2=QuotaState(ts=1710348958981 bypass)} 2024-03-13 08:56:46,288 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-13 08:56:46,288 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710348958981 bypass)} 2024-03-13 08:56:46,303 INFO [Listener at localhost/37591] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=282 (was 283), OpenFileDescriptor=597 (was 597), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=187 (was 140) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=10368 (was 10398) 2024-03-13 08:56:46,319 INFO [Listener at localhost/37591] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=282, OpenFileDescriptor=597, MaxFileDescriptor=60000, SystemLoadAverage=187, ProcessCount=168, AvailableMemoryMB=10367 2024-03-13 08:56:46,582 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:56:46,583 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-13 08:56:46,584 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710352558981 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1710352558981 bypass)} 2024-03-13 08:56:46,584 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1710352558981 bypass), TestNs:TestTable=QuotaState(ts=1710352558981 bypass), TestQuotaAdmin1=QuotaState(ts=1710352558981 bypass)} 2024-03-13 08:56:46,584 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-13 08:56:46,584 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710352558981 bypass)} 2024-03-13 08:56:46,834 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:56:46,835 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-13 08:56:46,836 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710352558981 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1710352558981 bypass)} 2024-03-13 08:56:46,836 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1710352558981 bypass), TestQuotaAdmin2=QuotaState(ts=1710352558981 bypass)} 2024-03-13 08:56:46,836 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-13 08:56:46,836 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710352558981 bypass)} 2024-03-13 08:56:46,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-13 08:56:46,850 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 235 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52584 deadline: 1710320216850, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-13 08:56:47,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-13 08:56:47,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 237 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52584 deadline: 1710320216851, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-13 08:56:47,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-13 08:56:47,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 239 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52584 deadline: 1710320216851, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-13 08:56:48,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-13 08:56:48,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 241 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52584 deadline: 1710320216851, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-13 08:56:49,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-13 08:56:49,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 243 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52584 deadline: 1710320216851, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-13 08:56:52,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-13 08:56:52,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 245 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:52584 deadline: 1710320216851, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-13 08:56:52,138 ERROR [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10295: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef., hostname=jenkins-hbase4.apache.org,46097,1710320151924, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:128) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-13 08:56:52,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:52,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 252 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52584 deadline: 1710320222148, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:52,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:52,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 254 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52584 deadline: 1710320222148, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:52,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:52,910 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 256 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52584 deadline: 1710320222148, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:53,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:53,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 258 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52584 deadline: 1710320222148, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:54,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:54,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 260 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52584 deadline: 1710320222149, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:57,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:57,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46097] ipc.CallRunner(144): callId: 262 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:52584 deadline: 1710320222149, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-13 08:56:57,441 ERROR [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10328: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef., hostname=jenkins-hbase4.apache.org,46097,1710320151924, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-13 08:56:57,699 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:56:57,700 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-13 08:56:57,700 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710356158981 bypass), TestNs=QuotaState(ts=1710356158981 bypass)} 2024-03-13 08:56:57,700 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1710356158981 bypass), TestNs:TestTable=QuotaState(ts=1710356158981 bypass), TestQuotaAdmin1=QuotaState(ts=1710356158981 bypass)} 2024-03-13 08:56:57,700 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1710356158981 bypass)} 2024-03-13 08:56:57,700 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710356158981 bypass)} 2024-03-13 08:56:57,950 INFO [Listener at localhost/37591] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-13 08:56:57,950 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-13 08:56:57,950 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710356158981 bypass), TestNs=QuotaState(ts=1710356158981 bypass)} 2024-03-13 08:56:57,951 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1710356158981 bypass), TestQuotaAdmin2=QuotaState(ts=1710356158981 bypass)} 2024-03-13 08:56:57,951 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-13 08:56:57,951 DEBUG [Listener at localhost/37591] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710356158981 bypass)} 2024-03-13 08:56:57,966 INFO [Listener at localhost/37591] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=267 (was 282), OpenFileDescriptor=588 (was 597), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=235 (was 187) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=10338 (was 10367) 2024-03-13 08:56:57,969 INFO [Listener at localhost/37591] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin0 2024-03-13 08:56:57,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin0 2024-03-13 08:56:57,982 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1075): Stored pid=27, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin0 2024-03-13 08:56:57,987 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710320217987"}]},"ts":"1710320217987"} 2024-03-13 08:56:57,989 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLING in hbase:meta 2024-03-13 08:56:57,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-03-13 08:56:57,991 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set TestQuotaAdmin0 to state=DISABLING 2024-03-13 08:56:57,993 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=f6346d02b0268607bd7cdba7ed86ddef, UNASSIGN}] 2024-03-13 08:56:57,994 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=f6346d02b0268607bd7cdba7ed86ddef, UNASSIGN 2024-03-13 08:56:57,995 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=f6346d02b0268607bd7cdba7ed86ddef, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46097,1710320151924 2024-03-13 08:56:57,995 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710320217995"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1710320217995"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1710320217995"}]},"ts":"1710320217995"} 2024-03-13 08:56:57,997 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure f6346d02b0268607bd7cdba7ed86ddef, server=jenkins-hbase4.apache.org,46097,1710320151924}] 2024-03-13 08:56:58,117 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase4.apache.org,46097,1710320151924, timeout=1710320218154, delay=37, operations=[pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure f6346d02b0268607bd7cdba7ed86ddef, server=jenkins-hbase4.apache.org,46097,1710320151924]] 2024-03-13 08:56:58,157 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46097,1710320151924 2024-03-13 08:56:58,160 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f6346d02b0268607bd7cdba7ed86ddef 2024-03-13 08:56:58,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f6346d02b0268607bd7cdba7ed86ddef, disabling compactions & flushes 2024-03-13 08:56:58,161 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef. 2024-03-13 08:56:58,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef. 2024-03-13 08:56:58,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef. after waiting 0 ms 2024-03-13 08:56:58,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef. 2024-03-13 08:56:58,162 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f6346d02b0268607bd7cdba7ed86ddef 1/1 column families, dataSize=578 B heapSize=2.11 KB 2024-03-13 08:56:58,237 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=578 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/default/TestQuotaAdmin0/f6346d02b0268607bd7cdba7ed86ddef/.tmp/cf/281ee6927eb743ee93aff23e1b61e5e2 2024-03-13 08:56:58,242 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-03-13 08:56:58,282 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/default/TestQuotaAdmin0/f6346d02b0268607bd7cdba7ed86ddef/.tmp/cf/281ee6927eb743ee93aff23e1b61e5e2 as hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/default/TestQuotaAdmin0/f6346d02b0268607bd7cdba7ed86ddef/cf/281ee6927eb743ee93aff23e1b61e5e2 2024-03-13 08:56:58,295 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/default/TestQuotaAdmin0/f6346d02b0268607bd7cdba7ed86ddef/cf/281ee6927eb743ee93aff23e1b61e5e2, entries=6, sequenceid=21, filesize=4.7 K 2024-03-13 08:56:58,298 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~578 B/578, heapSize ~2.09 KB/2144, currentSize=0 B/0 for f6346d02b0268607bd7cdba7ed86ddef in 136ms, sequenceid=21, compaction requested=false 2024-03-13 08:56:58,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/default/TestQuotaAdmin0/f6346d02b0268607bd7cdba7ed86ddef/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2024-03-13 08:56:58,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef. 2024-03-13 08:56:58,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f6346d02b0268607bd7cdba7ed86ddef: 2024-03-13 08:56:58,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f6346d02b0268607bd7cdba7ed86ddef 2024-03-13 08:56:58,311 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=f6346d02b0268607bd7cdba7ed86ddef, regionState=CLOSED 2024-03-13 08:56:58,311 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710320218311"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1710320218311"}]},"ts":"1710320218311"} 2024-03-13 08:56:58,315 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=29, resume processing ppid=28 2024-03-13 08:56:58,315 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=29, ppid=28, state=SUCCESS; CloseRegionProcedure f6346d02b0268607bd7cdba7ed86ddef, server=jenkins-hbase4.apache.org,46097,1710320151924 in 315 msec 2024-03-13 08:56:58,317 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=28, resume processing ppid=27 2024-03-13 08:56:58,317 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=f6346d02b0268607bd7cdba7ed86ddef, UNASSIGN in 322 msec 2024-03-13 08:56:58,318 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710320218318"}]},"ts":"1710320218318"} 2024-03-13 08:56:58,320 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLED in hbase:meta 2024-03-13 08:56:58,322 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set TestQuotaAdmin0 to state=DISABLED 2024-03-13 08:56:58,325 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=27, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin0 in 347 msec 2024-03-13 08:56:58,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-03-13 08:56:58,743 INFO [Listener at localhost/37591] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin0, procId: 27 completed 2024-03-13 08:56:58,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin0 2024-03-13 08:56:58,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1075): Stored pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-13 08:56:58,757 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-13 08:56:58,759 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=30, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-13 08:56:58,762 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-03-13 08:56:58,765 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/default/TestQuotaAdmin0/f6346d02b0268607bd7cdba7ed86ddef 2024-03-13 08:56:58,769 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/default/TestQuotaAdmin0/f6346d02b0268607bd7cdba7ed86ddef/cf, FileablePath, hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/default/TestQuotaAdmin0/f6346d02b0268607bd7cdba7ed86ddef/recovered.edits] 2024-03-13 08:56:58,779 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/default/TestQuotaAdmin0/f6346d02b0268607bd7cdba7ed86ddef/cf/281ee6927eb743ee93aff23e1b61e5e2 to hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/archive/data/default/TestQuotaAdmin0/f6346d02b0268607bd7cdba7ed86ddef/cf/281ee6927eb743ee93aff23e1b61e5e2 2024-03-13 08:56:58,785 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/default/TestQuotaAdmin0/f6346d02b0268607bd7cdba7ed86ddef/recovered.edits/24.seqid to hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/archive/data/default/TestQuotaAdmin0/f6346d02b0268607bd7cdba7ed86ddef/recovered.edits/24.seqid 2024-03-13 08:56:58,785 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/default/TestQuotaAdmin0/f6346d02b0268607bd7cdba7ed86ddef 2024-03-13 08:56:58,786 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-03-13 08:56:58,789 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=30, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-13 08:56:58,809 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin0 from hbase:meta 2024-03-13 08:56:58,812 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin0' descriptor. 2024-03-13 08:56:58,813 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=30, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-13 08:56:58,813 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin0' from region states. 2024-03-13 08:56:58,814 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1710320218814"}]},"ts":"9223372036854775807"} 2024-03-13 08:56:58,816 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-03-13 08:56:58,816 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f6346d02b0268607bd7cdba7ed86ddef, NAME => 'TestQuotaAdmin0,,1710320155101.f6346d02b0268607bd7cdba7ed86ddef.', STARTKEY => '', ENDKEY => ''}] 2024-03-13 08:56:58,816 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin0' as deleted. 2024-03-13 08:56:58,816 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1710320218816"}]},"ts":"9223372036854775807"} 2024-03-13 08:56:58,818 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin0 state from META 2024-03-13 08:56:58,821 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=30, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-13 08:56:58,822 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=30, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin0 in 72 msec 2024-03-13 08:56:59,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-03-13 08:56:59,014 INFO [Listener at localhost/37591] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin0, procId: 30 completed 2024-03-13 08:56:59,015 INFO [Listener at localhost/37591] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin1 2024-03-13 08:56:59,015 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin1 2024-03-13 08:56:59,016 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1075): Stored pid=31, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin1 2024-03-13 08:56:59,019 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-03-13 08:56:59,020 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710320219020"}]},"ts":"1710320219020"} 2024-03-13 08:56:59,022 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLING in hbase:meta 2024-03-13 08:56:59,024 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set TestQuotaAdmin1 to state=DISABLING 2024-03-13 08:56:59,026 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=ba9f757341ebe76352cdc1e5569076bf, UNASSIGN}] 2024-03-13 08:56:59,027 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=ba9f757341ebe76352cdc1e5569076bf, UNASSIGN 2024-03-13 08:56:59,028 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=ba9f757341ebe76352cdc1e5569076bf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46097,1710320151924 2024-03-13 08:56:59,028 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1710320155904.ba9f757341ebe76352cdc1e5569076bf.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710320219027"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1710320219027"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1710320219027"}]},"ts":"1710320219027"} 2024-03-13 08:56:59,029 WARN [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36183] assignment.AssignmentManager(1312): Unable to acquire lock for regionNode state=CLOSING, location=jenkins-hbase4.apache.org,46097,1710320151924, table=TestQuotaAdmin1, region=ba9f757341ebe76352cdc1e5569076bf. It is likely that another thread is currently holding the lock. To avoid deadlock, skip execution for now. 2024-03-13 08:56:59,029 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=33, ppid=32, state=RUNNABLE; CloseRegionProcedure ba9f757341ebe76352cdc1e5569076bf, server=jenkins-hbase4.apache.org,46097,1710320151924}] 2024-03-13 08:56:59,182 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46097,1710320151924 2024-03-13 08:56:59,183 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ba9f757341ebe76352cdc1e5569076bf 2024-03-13 08:56:59,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ba9f757341ebe76352cdc1e5569076bf, disabling compactions & flushes 2024-03-13 08:56:59,184 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1710320155904.ba9f757341ebe76352cdc1e5569076bf. 2024-03-13 08:56:59,184 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1710320155904.ba9f757341ebe76352cdc1e5569076bf. 2024-03-13 08:56:59,184 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1710320155904.ba9f757341ebe76352cdc1e5569076bf. after waiting 0 ms 2024-03-13 08:56:59,184 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1710320155904.ba9f757341ebe76352cdc1e5569076bf. 2024-03-13 08:56:59,190 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/default/TestQuotaAdmin1/ba9f757341ebe76352cdc1e5569076bf/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-03-13 08:56:59,192 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1710320155904.ba9f757341ebe76352cdc1e5569076bf. 2024-03-13 08:56:59,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ba9f757341ebe76352cdc1e5569076bf: 2024-03-13 08:56:59,195 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ba9f757341ebe76352cdc1e5569076bf 2024-03-13 08:56:59,195 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=ba9f757341ebe76352cdc1e5569076bf, regionState=CLOSED 2024-03-13 08:56:59,196 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1710320155904.ba9f757341ebe76352cdc1e5569076bf.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710320219195"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1710320219195"}]},"ts":"1710320219195"} 2024-03-13 08:56:59,200 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=33, resume processing ppid=32 2024-03-13 08:56:59,200 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=33, ppid=32, state=SUCCESS; CloseRegionProcedure ba9f757341ebe76352cdc1e5569076bf, server=jenkins-hbase4.apache.org,46097,1710320151924 in 169 msec 2024-03-13 08:56:59,205 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=32, resume processing ppid=31 2024-03-13 08:56:59,205 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=32, ppid=31, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=ba9f757341ebe76352cdc1e5569076bf, UNASSIGN in 175 msec 2024-03-13 08:56:59,206 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710320219206"}]},"ts":"1710320219206"} 2024-03-13 08:56:59,207 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLED in hbase:meta 2024-03-13 08:56:59,210 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set TestQuotaAdmin1 to state=DISABLED 2024-03-13 08:56:59,216 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=31, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin1 in 196 msec 2024-03-13 08:56:59,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-03-13 08:56:59,271 INFO [Listener at localhost/37591] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin1, procId: 31 completed 2024-03-13 08:56:59,273 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin1 2024-03-13 08:56:59,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1075): Stored pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-13 08:56:59,277 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-13 08:56:59,278 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=34, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-13 08:56:59,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-03-13 08:56:59,283 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/default/TestQuotaAdmin1/ba9f757341ebe76352cdc1e5569076bf 2024-03-13 08:56:59,286 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/default/TestQuotaAdmin1/ba9f757341ebe76352cdc1e5569076bf/cf, FileablePath, hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/default/TestQuotaAdmin1/ba9f757341ebe76352cdc1e5569076bf/recovered.edits] 2024-03-13 08:56:59,296 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/default/TestQuotaAdmin1/ba9f757341ebe76352cdc1e5569076bf/recovered.edits/4.seqid to hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/archive/data/default/TestQuotaAdmin1/ba9f757341ebe76352cdc1e5569076bf/recovered.edits/4.seqid 2024-03-13 08:56:59,297 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/default/TestQuotaAdmin1/ba9f757341ebe76352cdc1e5569076bf 2024-03-13 08:56:59,297 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-03-13 08:56:59,301 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=34, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-13 08:56:59,304 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin1 from hbase:meta 2024-03-13 08:56:59,306 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin1' descriptor. 2024-03-13 08:56:59,308 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=34, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-13 08:56:59,308 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin1' from region states. 2024-03-13 08:56:59,308 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1,,1710320155904.ba9f757341ebe76352cdc1e5569076bf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1710320219308"}]},"ts":"9223372036854775807"} 2024-03-13 08:56:59,310 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-03-13 08:56:59,310 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ba9f757341ebe76352cdc1e5569076bf, NAME => 'TestQuotaAdmin1,,1710320155904.ba9f757341ebe76352cdc1e5569076bf.', STARTKEY => '', ENDKEY => ''}] 2024-03-13 08:56:59,310 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin1' as deleted. 2024-03-13 08:56:59,310 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1710320219310"}]},"ts":"9223372036854775807"} 2024-03-13 08:56:59,312 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin1 state from META 2024-03-13 08:56:59,315 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=34, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-13 08:56:59,317 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=34, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin1 in 42 msec 2024-03-13 08:56:59,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-03-13 08:56:59,532 INFO [Listener at localhost/37591] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin1, procId: 34 completed 2024-03-13 08:56:59,533 INFO [Listener at localhost/37591] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin2 2024-03-13 08:56:59,533 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin2 2024-03-13 08:56:59,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1075): Stored pid=35, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin2 2024-03-13 08:56:59,539 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-03-13 08:56:59,540 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710320219540"}]},"ts":"1710320219540"} 2024-03-13 08:56:59,542 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLING in hbase:meta 2024-03-13 08:56:59,544 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set TestQuotaAdmin2 to state=DISABLING 2024-03-13 08:56:59,545 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=912b54ba69c1c1aeda52bbf586d77095, UNASSIGN}] 2024-03-13 08:56:59,547 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=912b54ba69c1c1aeda52bbf586d77095, UNASSIGN 2024-03-13 08:56:59,547 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=912b54ba69c1c1aeda52bbf586d77095, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46627,1710320151969 2024-03-13 08:56:59,548 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1710320156682.912b54ba69c1c1aeda52bbf586d77095.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710320219547"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1710320219547"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1710320219547"}]},"ts":"1710320219547"} 2024-03-13 08:56:59,550 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; CloseRegionProcedure 912b54ba69c1c1aeda52bbf586d77095, server=jenkins-hbase4.apache.org,46627,1710320151969}] 2024-03-13 08:56:59,702 DEBUG [RSProcedureDispatcher-pool-5] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46627,1710320151969 2024-03-13 08:56:59,703 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 912b54ba69c1c1aeda52bbf586d77095 2024-03-13 08:56:59,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 912b54ba69c1c1aeda52bbf586d77095, disabling compactions & flushes 2024-03-13 08:56:59,704 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1710320156682.912b54ba69c1c1aeda52bbf586d77095. 2024-03-13 08:56:59,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1710320156682.912b54ba69c1c1aeda52bbf586d77095. 2024-03-13 08:56:59,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1710320156682.912b54ba69c1c1aeda52bbf586d77095. after waiting 0 ms 2024-03-13 08:56:59,704 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1710320156682.912b54ba69c1c1aeda52bbf586d77095. 2024-03-13 08:56:59,711 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/default/TestQuotaAdmin2/912b54ba69c1c1aeda52bbf586d77095/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-03-13 08:56:59,713 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1710320156682.912b54ba69c1c1aeda52bbf586d77095. 2024-03-13 08:56:59,713 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 912b54ba69c1c1aeda52bbf586d77095: 2024-03-13 08:56:59,715 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 912b54ba69c1c1aeda52bbf586d77095 2024-03-13 08:56:59,716 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=912b54ba69c1c1aeda52bbf586d77095, regionState=CLOSED 2024-03-13 08:56:59,716 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1710320156682.912b54ba69c1c1aeda52bbf586d77095.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710320219716"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1710320219716"}]},"ts":"1710320219716"} 2024-03-13 08:56:59,721 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=37, resume processing ppid=36 2024-03-13 08:56:59,721 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=37, ppid=36, state=SUCCESS; CloseRegionProcedure 912b54ba69c1c1aeda52bbf586d77095, server=jenkins-hbase4.apache.org,46627,1710320151969 in 168 msec 2024-03-13 08:56:59,724 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=36, resume processing ppid=35 2024-03-13 08:56:59,724 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=912b54ba69c1c1aeda52bbf586d77095, UNASSIGN in 176 msec 2024-03-13 08:56:59,725 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710320219725"}]},"ts":"1710320219725"} 2024-03-13 08:56:59,726 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLED in hbase:meta 2024-03-13 08:56:59,729 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set TestQuotaAdmin2 to state=DISABLED 2024-03-13 08:56:59,732 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=35, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin2 in 196 msec 2024-03-13 08:56:59,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-03-13 08:56:59,791 INFO [Listener at localhost/37591] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin2, procId: 35 completed 2024-03-13 08:56:59,792 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin2 2024-03-13 08:56:59,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1075): Stored pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-13 08:56:59,795 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-13 08:56:59,796 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=38, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-13 08:56:59,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-03-13 08:56:59,801 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/default/TestQuotaAdmin2/912b54ba69c1c1aeda52bbf586d77095 2024-03-13 08:56:59,803 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/default/TestQuotaAdmin2/912b54ba69c1c1aeda52bbf586d77095/cf, FileablePath, hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/default/TestQuotaAdmin2/912b54ba69c1c1aeda52bbf586d77095/recovered.edits] 2024-03-13 08:56:59,812 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/default/TestQuotaAdmin2/912b54ba69c1c1aeda52bbf586d77095/recovered.edits/4.seqid to hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/archive/data/default/TestQuotaAdmin2/912b54ba69c1c1aeda52bbf586d77095/recovered.edits/4.seqid 2024-03-13 08:56:59,813 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/default/TestQuotaAdmin2/912b54ba69c1c1aeda52bbf586d77095 2024-03-13 08:56:59,813 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-03-13 08:56:59,816 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=38, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-13 08:56:59,818 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin2 from hbase:meta 2024-03-13 08:56:59,820 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin2' descriptor. 2024-03-13 08:56:59,821 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=38, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-13 08:56:59,822 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin2' from region states. 2024-03-13 08:56:59,822 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2,,1710320156682.912b54ba69c1c1aeda52bbf586d77095.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1710320219822"}]},"ts":"9223372036854775807"} 2024-03-13 08:56:59,823 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-03-13 08:56:59,823 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 912b54ba69c1c1aeda52bbf586d77095, NAME => 'TestQuotaAdmin2,,1710320156682.912b54ba69c1c1aeda52bbf586d77095.', STARTKEY => '', ENDKEY => ''}] 2024-03-13 08:56:59,823 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin2' as deleted. 2024-03-13 08:56:59,824 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1710320219824"}]},"ts":"9223372036854775807"} 2024-03-13 08:56:59,825 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin2 state from META 2024-03-13 08:56:59,828 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=38, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-13 08:56:59,829 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=38, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin2 in 36 msec 2024-03-13 08:57:00,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-03-13 08:57:00,050 INFO [Listener at localhost/37591] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin2, procId: 38 completed 2024-03-13 08:57:00,050 INFO [Listener at localhost/37591] client.HBaseAdmin$15(890): Started disable of TestNs:TestTable 2024-03-13 08:57:00,051 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestNs:TestTable 2024-03-13 08:57:00,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1075): Stored pid=39, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestNs:TestTable 2024-03-13 08:57:00,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-03-13 08:57:00,055 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710320220055"}]},"ts":"1710320220055"} 2024-03-13 08:57:00,057 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLING in hbase:meta 2024-03-13 08:57:00,059 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set TestNs:TestTable to state=DISABLING 2024-03-13 08:57:00,060 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=0fae0ac94cc227caa598483ceecbd88f, UNASSIGN}, {pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=e1e5c459519a2cf7173ca851e8c62095, UNASSIGN}] 2024-03-13 08:57:00,061 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=0fae0ac94cc227caa598483ceecbd88f, UNASSIGN 2024-03-13 08:57:00,061 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=e1e5c459519a2cf7173ca851e8c62095, UNASSIGN 2024-03-13 08:57:00,062 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=0fae0ac94cc227caa598483ceecbd88f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46627,1710320151969 2024-03-13 08:57:00,062 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=e1e5c459519a2cf7173ca851e8c62095, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46097,1710320151924 2024-03-13 08:57:00,062 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1710320157728.0fae0ac94cc227caa598483ceecbd88f.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1710320220062"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1710320220062"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1710320220062"}]},"ts":"1710320220062"} 2024-03-13 08:57:00,063 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1710320157728.e1e5c459519a2cf7173ca851e8c62095.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1710320220062"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1710320220062"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1710320220062"}]},"ts":"1710320220062"} 2024-03-13 08:57:00,064 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=42, ppid=40, state=RUNNABLE; CloseRegionProcedure 0fae0ac94cc227caa598483ceecbd88f, server=jenkins-hbase4.apache.org,46627,1710320151969}] 2024-03-13 08:57:00,065 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=43, ppid=41, state=RUNNABLE; CloseRegionProcedure e1e5c459519a2cf7173ca851e8c62095, server=jenkins-hbase4.apache.org,46097,1710320151924}] 2024-03-13 08:57:00,216 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46627,1710320151969 2024-03-13 08:57:00,217 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0fae0ac94cc227caa598483ceecbd88f 2024-03-13 08:57:00,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0fae0ac94cc227caa598483ceecbd88f, disabling compactions & flushes 2024-03-13 08:57:00,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1710320157728.0fae0ac94cc227caa598483ceecbd88f. 2024-03-13 08:57:00,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1710320157728.0fae0ac94cc227caa598483ceecbd88f. 2024-03-13 08:57:00,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1710320157728.0fae0ac94cc227caa598483ceecbd88f. after waiting 0 ms 2024-03-13 08:57:00,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1710320157728.0fae0ac94cc227caa598483ceecbd88f. 2024-03-13 08:57:00,219 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46097,1710320151924 2024-03-13 08:57:00,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e1e5c459519a2cf7173ca851e8c62095 2024-03-13 08:57:00,220 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e1e5c459519a2cf7173ca851e8c62095, disabling compactions & flushes 2024-03-13 08:57:00,220 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1710320157728.e1e5c459519a2cf7173ca851e8c62095. 2024-03-13 08:57:00,220 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1710320157728.e1e5c459519a2cf7173ca851e8c62095. 2024-03-13 08:57:00,220 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1710320157728.e1e5c459519a2cf7173ca851e8c62095. after waiting 0 ms 2024-03-13 08:57:00,220 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1710320157728.e1e5c459519a2cf7173ca851e8c62095. 2024-03-13 08:57:00,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/TestNs/TestTable/0fae0ac94cc227caa598483ceecbd88f/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-03-13 08:57:00,228 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/TestNs/TestTable/e1e5c459519a2cf7173ca851e8c62095/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-03-13 08:57:00,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1710320157728.0fae0ac94cc227caa598483ceecbd88f. 2024-03-13 08:57:00,229 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0fae0ac94cc227caa598483ceecbd88f: 2024-03-13 08:57:00,230 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1710320157728.e1e5c459519a2cf7173ca851e8c62095. 2024-03-13 08:57:00,230 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e1e5c459519a2cf7173ca851e8c62095: 2024-03-13 08:57:00,232 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0fae0ac94cc227caa598483ceecbd88f 2024-03-13 08:57:00,232 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=0fae0ac94cc227caa598483ceecbd88f, regionState=CLOSED 2024-03-13 08:57:00,232 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,,1710320157728.0fae0ac94cc227caa598483ceecbd88f.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1710320220232"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1710320220232"}]},"ts":"1710320220232"} 2024-03-13 08:57:00,233 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e1e5c459519a2cf7173ca851e8c62095 2024-03-13 08:57:00,233 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=e1e5c459519a2cf7173ca851e8c62095, regionState=CLOSED 2024-03-13 08:57:00,233 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1710320157728.e1e5c459519a2cf7173ca851e8c62095.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1710320220233"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1710320220233"}]},"ts":"1710320220233"} 2024-03-13 08:57:00,236 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=42, resume processing ppid=40 2024-03-13 08:57:00,236 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=42, ppid=40, state=SUCCESS; CloseRegionProcedure 0fae0ac94cc227caa598483ceecbd88f, server=jenkins-hbase4.apache.org,46627,1710320151969 in 170 msec 2024-03-13 08:57:00,237 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=43, resume processing ppid=41 2024-03-13 08:57:00,237 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=43, ppid=41, state=SUCCESS; CloseRegionProcedure e1e5c459519a2cf7173ca851e8c62095, server=jenkins-hbase4.apache.org,46097,1710320151924 in 170 msec 2024-03-13 08:57:00,238 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=0fae0ac94cc227caa598483ceecbd88f, UNASSIGN in 176 msec 2024-03-13 08:57:00,240 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=41, resume processing ppid=39 2024-03-13 08:57:00,240 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=41, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=e1e5c459519a2cf7173ca851e8c62095, UNASSIGN in 177 msec 2024-03-13 08:57:00,240 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710320220240"}]},"ts":"1710320220240"} 2024-03-13 08:57:00,242 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLED in hbase:meta 2024-03-13 08:57:00,244 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set TestNs:TestTable to state=DISABLED 2024-03-13 08:57:00,246 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=39, state=SUCCESS; DisableTableProcedure table=TestNs:TestTable in 194 msec 2024-03-13 08:57:00,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-03-13 08:57:00,307 INFO [Listener at localhost/37591] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: TestNs:TestTable, procId: 39 completed 2024-03-13 08:57:00,307 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestNs:TestTable 2024-03-13 08:57:00,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1075): Stored pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestNs:TestTable 2024-03-13 08:57:00,311 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-13 08:57:00,312 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=44, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-13 08:57:00,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-03-13 08:57:00,318 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/TestNs/TestTable/0fae0ac94cc227caa598483ceecbd88f 2024-03-13 08:57:00,318 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/TestNs/TestTable/e1e5c459519a2cf7173ca851e8c62095 2024-03-13 08:57:00,321 DEBUG [HFileArchiver-11] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/TestNs/TestTable/0fae0ac94cc227caa598483ceecbd88f/cf, FileablePath, hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/TestNs/TestTable/0fae0ac94cc227caa598483ceecbd88f/recovered.edits] 2024-03-13 08:57:00,321 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/TestNs/TestTable/e1e5c459519a2cf7173ca851e8c62095/cf, FileablePath, hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/TestNs/TestTable/e1e5c459519a2cf7173ca851e8c62095/recovered.edits] 2024-03-13 08:57:00,332 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/TestNs/TestTable/e1e5c459519a2cf7173ca851e8c62095/recovered.edits/4.seqid to hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/archive/data/TestNs/TestTable/e1e5c459519a2cf7173ca851e8c62095/recovered.edits/4.seqid 2024-03-13 08:57:00,333 DEBUG [HFileArchiver-11] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/TestNs/TestTable/0fae0ac94cc227caa598483ceecbd88f/recovered.edits/4.seqid to hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/archive/data/TestNs/TestTable/0fae0ac94cc227caa598483ceecbd88f/recovered.edits/4.seqid 2024-03-13 08:57:00,334 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/TestNs/TestTable/e1e5c459519a2cf7173ca851e8c62095 2024-03-13 08:57:00,334 DEBUG [HFileArchiver-11] backup.HFileArchiver(596): Deleted hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/.tmp/data/TestNs/TestTable/0fae0ac94cc227caa598483ceecbd88f 2024-03-13 08:57:00,334 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-03-13 08:57:00,339 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=44, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-13 08:57:00,341 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of TestNs:TestTable from hbase:meta 2024-03-13 08:57:00,344 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'TestNs:TestTable' descriptor. 2024-03-13 08:57:00,347 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=44, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-13 08:57:00,347 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'TestNs:TestTable' from region states. 2024-03-13 08:57:00,347 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,,1710320157728.0fae0ac94cc227caa598483ceecbd88f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1710320220347"}]},"ts":"9223372036854775807"} 2024-03-13 08:57:00,347 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,1,1710320157728.e1e5c459519a2cf7173ca851e8c62095.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1710320220347"}]},"ts":"9223372036854775807"} 2024-03-13 08:57:00,353 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2024-03-13 08:57:00,353 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0fae0ac94cc227caa598483ceecbd88f, NAME => 'TestNs:TestTable,,1710320157728.0fae0ac94cc227caa598483ceecbd88f.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e1e5c459519a2cf7173ca851e8c62095, NAME => 'TestNs:TestTable,1,1710320157728.e1e5c459519a2cf7173ca851e8c62095.', STARTKEY => '1', ENDKEY => ''}] 2024-03-13 08:57:00,354 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'TestNs:TestTable' as deleted. 2024-03-13 08:57:00,354 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1710320220354"}]},"ts":"9223372036854775807"} 2024-03-13 08:57:00,356 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table TestNs:TestTable state from META 2024-03-13 08:57:00,360 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=44, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-13 08:57:00,363 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=44, state=SUCCESS; DeleteTableProcedure table=TestNs:TestTable in 53 msec 2024-03-13 08:57:00,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-03-13 08:57:00,566 INFO [Listener at localhost/37591] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: TestNs:TestTable, procId: 44 completed 2024-03-13 08:57:00,571 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.HMaster$17(3092): Client=jenkins//172.31.14.131 delete TestNs 2024-03-13 08:57:00,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] procedure2.ProcedureExecutor(1075): Stored pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE; DeleteNamespaceProcedure, namespace=TestNs 2024-03-13 08:57:00,580 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-13 08:57:00,583 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_FROM_NS_TABLE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-13 08:57:00,585 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_FROM_ZK, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-13 08:57:00,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-03-13 08:57:00,587 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace/TestNs 2024-03-13 08:57:00,587 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-03-13 08:57:00,588 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_DIRECTORIES, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-13 08:57:00,591 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_NAMESPACE_QUOTA, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-13 08:57:00,592 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=45, state=SUCCESS; DeleteNamespaceProcedure, namespace=TestNs in 20 msec 2024-03-13 08:57:00,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36183] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-03-13 08:57:00,837 INFO [Listener at localhost/37591] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2024-03-13 08:57:00,838 INFO [Listener at localhost/37591] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-03-13 08:57:00,838 DEBUG [Listener at localhost/37591] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x578c3464 to 127.0.0.1:52215 2024-03-13 08:57:00,838 DEBUG [Listener at localhost/37591] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-13 08:57:00,838 DEBUG [Listener at localhost/37591] util.JVMClusterUtil(237): Shutting down HBase Cluster 2024-03-13 08:57:00,839 DEBUG [Listener at localhost/37591] util.JVMClusterUtil(257): Found active master hash=1619759069, stopped=false 2024-03-13 08:57:00,839 DEBUG [Listener at localhost/37591] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-03-13 08:57:00,839 INFO [Listener at localhost/37591] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,36183,1710320150734 2024-03-13 08:57:00,842 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): regionserver:46097-0x1005c672cd60001, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-03-13 08:57:00,842 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): regionserver:46627-0x1005c672cd60002, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-03-13 08:57:00,842 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-03-13 08:57:00,842 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-13 08:57:00,842 INFO [Listener at localhost/37591] procedure2.ProcedureExecutor(675): Stopping 2024-03-13 08:57:00,842 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:46627-0x1005c672cd60002, quorum=127.0.0.1:52215, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-13 08:57:00,843 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:46097-0x1005c672cd60001, quorum=127.0.0.1:52215, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-13 08:57:00,842 DEBUG [Listener at localhost/37591] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x597869bf to 127.0.0.1:52215 2024-03-13 08:57:00,843 DEBUG [Listener at localhost/37591] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-13 08:57:00,843 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-13 08:57:00,843 INFO [Listener at localhost/37591] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,46097,1710320151924' ***** 2024-03-13 08:57:00,843 INFO [Listener at localhost/37591] regionserver.HRegionServer(2313): STOPPED: Shutdown requested 2024-03-13 08:57:00,843 INFO [Listener at localhost/37591] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,46627,1710320151969' ***** 2024-03-13 08:57:00,843 INFO [Listener at localhost/37591] regionserver.HRegionServer(2313): STOPPED: Shutdown requested 2024-03-13 08:57:00,843 INFO [RS:1;jenkins-hbase4:46627] regionserver.HeapMemoryManager(220): Stopping 2024-03-13 08:57:00,843 INFO [RS:0;jenkins-hbase4:46097] regionserver.HeapMemoryManager(220): Stopping 2024-03-13 08:57:00,844 INFO [RS:1;jenkins-hbase4:46627] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-03-13 08:57:00,844 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-03-13 08:57:00,844 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-03-13 08:57:00,844 INFO [RS:0;jenkins-hbase4:46097] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-03-13 08:57:00,844 INFO [RS:0;jenkins-hbase4:46097] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-03-13 08:57:00,844 INFO [RS:0;jenkins-hbase4:46097] regionserver.HRegionServer(3307): Received CLOSE for 1bd54a37ecf02bc2fd687ebaffa21e28 2024-03-13 08:57:00,844 INFO [RS:0;jenkins-hbase4:46097] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,46097,1710320151924 2024-03-13 08:57:00,844 INFO [RS:0;jenkins-hbase4:46097] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-03-13 08:57:00,844 DEBUG [RS:0;jenkins-hbase4:46097] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x07ec06cc to 127.0.0.1:52215 2024-03-13 08:57:00,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1bd54a37ecf02bc2fd687ebaffa21e28, disabling compactions & flushes 2024-03-13 08:57:00,844 INFO [RS:1;jenkins-hbase4:46627] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-03-13 08:57:00,845 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:quota,,1710320154535.1bd54a37ecf02bc2fd687ebaffa21e28. 2024-03-13 08:57:00,845 INFO [RS:1;jenkins-hbase4:46627] regionserver.HRegionServer(3307): Received CLOSE for 674a8c26191fd518e6e5b098d2850234 2024-03-13 08:57:00,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1710320154535.1bd54a37ecf02bc2fd687ebaffa21e28. 2024-03-13 08:57:00,845 INFO [RS:1;jenkins-hbase4:46627] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,46627,1710320151969 2024-03-13 08:57:00,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1710320154535.1bd54a37ecf02bc2fd687ebaffa21e28. after waiting 0 ms 2024-03-13 08:57:00,845 DEBUG [RS:0;jenkins-hbase4:46097] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-13 08:57:00,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 674a8c26191fd518e6e5b098d2850234, disabling compactions & flushes 2024-03-13 08:57:00,845 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1710320154535.1bd54a37ecf02bc2fd687ebaffa21e28. 2024-03-13 08:57:00,845 INFO [RS:1;jenkins-hbase4:46627] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-03-13 08:57:00,846 INFO [RS:0;jenkins-hbase4:46097] regionserver.HRegionServer(1477): Waiting on 1 regions to close 2024-03-13 08:57:00,846 DEBUG [RS:1;jenkins-hbase4:46627] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x53aa9f93 to 127.0.0.1:52215 2024-03-13 08:57:00,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1710320153816.674a8c26191fd518e6e5b098d2850234. 2024-03-13 08:57:00,846 DEBUG [RS:1;jenkins-hbase4:46627] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-13 08:57:00,846 DEBUG [RS:0;jenkins-hbase4:46097] regionserver.HRegionServer(1481): Online Regions={1bd54a37ecf02bc2fd687ebaffa21e28=hbase:quota,,1710320154535.1bd54a37ecf02bc2fd687ebaffa21e28.} 2024-03-13 08:57:00,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1bd54a37ecf02bc2fd687ebaffa21e28 2/2 column families, dataSize=726 B heapSize=2.44 KB 2024-03-13 08:57:00,846 INFO [RS:1;jenkins-hbase4:46627] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-03-13 08:57:00,846 INFO [RS:1;jenkins-hbase4:46627] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-03-13 08:57:00,846 INFO [RS:1;jenkins-hbase4:46627] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-03-13 08:57:00,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1710320153816.674a8c26191fd518e6e5b098d2850234. 2024-03-13 08:57:00,846 INFO [RS:1;jenkins-hbase4:46627] regionserver.HRegionServer(3307): Received CLOSE for 1588230740 2024-03-13 08:57:00,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1710320153816.674a8c26191fd518e6e5b098d2850234. after waiting 0 ms 2024-03-13 08:57:00,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1710320153816.674a8c26191fd518e6e5b098d2850234. 2024-03-13 08:57:00,847 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 674a8c26191fd518e6e5b098d2850234 1/1 column families, dataSize=147 B heapSize=704 B 2024-03-13 08:57:00,847 INFO [RS:1;jenkins-hbase4:46627] regionserver.HRegionServer(1477): Waiting on 2 regions to close 2024-03-13 08:57:00,847 DEBUG [RS:1;jenkins-hbase4:46627] regionserver.HRegionServer(1481): Online Regions={674a8c26191fd518e6e5b098d2850234=hbase:namespace,,1710320153816.674a8c26191fd518e6e5b098d2850234., 1588230740=hbase:meta,,1.1588230740} 2024-03-13 08:57:00,848 DEBUG [RS:0;jenkins-hbase4:46097] regionserver.HRegionServer(1507): Waiting on 1bd54a37ecf02bc2fd687ebaffa21e28 2024-03-13 08:57:00,848 DEBUG [RS:1;jenkins-hbase4:46627] regionserver.HRegionServer(1507): Waiting on 1588230740, 674a8c26191fd518e6e5b098d2850234 2024-03-13 08:57:00,848 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-03-13 08:57:00,848 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-03-13 08:57:00,848 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-03-13 08:57:00,848 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-03-13 08:57:00,848 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-03-13 08:57:00,848 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=14.15 KB heapSize=25.10 KB 2024-03-13 08:57:00,885 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=12.16 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/meta/1588230740/.tmp/info/4178166b788c4edbb7241af6f720c55d 2024-03-13 08:57:00,899 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=147 B at sequenceid=8 (bloomFilter=true), to=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/namespace/674a8c26191fd518e6e5b098d2850234/.tmp/info/aef931738daa48de9e91e63a834053d1 2024-03-13 08:57:00,900 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-03-13 08:57:00,901 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=597 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/quota/1bd54a37ecf02bc2fd687ebaffa21e28/.tmp/q/73ab4e9e1fdd48e69dd2fdd5a306f518 2024-03-13 08:57:00,904 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4178166b788c4edbb7241af6f720c55d 2024-03-13 08:57:00,909 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aef931738daa48de9e91e63a834053d1 2024-03-13 08:57:00,910 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 73ab4e9e1fdd48e69dd2fdd5a306f518 2024-03-13 08:57:00,911 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/namespace/674a8c26191fd518e6e5b098d2850234/.tmp/info/aef931738daa48de9e91e63a834053d1 as hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/namespace/674a8c26191fd518e6e5b098d2850234/info/aef931738daa48de9e91e63a834053d1 2024-03-13 08:57:00,919 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-03-13 08:57:00,919 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-03-13 08:57:00,920 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=478 B at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/meta/1588230740/.tmp/rep_barrier/b5bc18dee3f8448b89b1c2975fb6cd7f 2024-03-13 08:57:00,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aef931738daa48de9e91e63a834053d1 2024-03-13 08:57:00,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/namespace/674a8c26191fd518e6e5b098d2850234/info/aef931738daa48de9e91e63a834053d1, entries=3, sequenceid=8, filesize=5.0 K 2024-03-13 08:57:00,928 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=129 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/quota/1bd54a37ecf02bc2fd687ebaffa21e28/.tmp/u/483b8928e9e94a5ba3a84e9315275b01 2024-03-13 08:57:00,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~147 B/147, heapSize ~688 B/688, currentSize=0 B/0 for 674a8c26191fd518e6e5b098d2850234 in 82ms, sequenceid=8, compaction requested=false 2024-03-13 08:57:00,931 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b5bc18dee3f8448b89b1c2975fb6cd7f 2024-03-13 08:57:00,938 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 483b8928e9e94a5ba3a84e9315275b01 2024-03-13 08:57:00,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/namespace/674a8c26191fd518e6e5b098d2850234/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=1 2024-03-13 08:57:00,940 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/quota/1bd54a37ecf02bc2fd687ebaffa21e28/.tmp/q/73ab4e9e1fdd48e69dd2fdd5a306f518 as hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/quota/1bd54a37ecf02bc2fd687ebaffa21e28/q/73ab4e9e1fdd48e69dd2fdd5a306f518 2024-03-13 08:57:00,941 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1710320153816.674a8c26191fd518e6e5b098d2850234. 2024-03-13 08:57:00,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 674a8c26191fd518e6e5b098d2850234: 2024-03-13 08:57:00,941 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1710320153816.674a8c26191fd518e6e5b098d2850234. 2024-03-13 08:57:00,950 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 73ab4e9e1fdd48e69dd2fdd5a306f518 2024-03-13 08:57:00,951 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/quota/1bd54a37ecf02bc2fd687ebaffa21e28/q/73ab4e9e1fdd48e69dd2fdd5a306f518, entries=5, sequenceid=17, filesize=5.1 K 2024-03-13 08:57:00,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/quota/1bd54a37ecf02bc2fd687ebaffa21e28/.tmp/u/483b8928e9e94a5ba3a84e9315275b01 as hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/quota/1bd54a37ecf02bc2fd687ebaffa21e28/u/483b8928e9e94a5ba3a84e9315275b01 2024-03-13 08:57:00,967 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.53 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/meta/1588230740/.tmp/table/5e555209a5054f369e7760c35680d6bf 2024-03-13 08:57:00,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 483b8928e9e94a5ba3a84e9315275b01 2024-03-13 08:57:00,974 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/quota/1bd54a37ecf02bc2fd687ebaffa21e28/u/483b8928e9e94a5ba3a84e9315275b01, entries=4, sequenceid=17, filesize=5.0 K 2024-03-13 08:57:00,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~726 B/726, heapSize ~2.41 KB/2464, currentSize=0 B/0 for 1bd54a37ecf02bc2fd687ebaffa21e28 in 129ms, sequenceid=17, compaction requested=false 2024-03-13 08:57:00,980 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5e555209a5054f369e7760c35680d6bf 2024-03-13 08:57:00,984 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/meta/1588230740/.tmp/info/4178166b788c4edbb7241af6f720c55d as hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/meta/1588230740/info/4178166b788c4edbb7241af6f720c55d 2024-03-13 08:57:00,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/quota/1bd54a37ecf02bc2fd687ebaffa21e28/recovered.edits/20.seqid, newMaxSeqId=20, maxSeqId=1 2024-03-13 08:57:00,991 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:quota,,1710320154535.1bd54a37ecf02bc2fd687ebaffa21e28. 2024-03-13 08:57:00,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1bd54a37ecf02bc2fd687ebaffa21e28: 2024-03-13 08:57:00,991 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:quota,,1710320154535.1bd54a37ecf02bc2fd687ebaffa21e28. 2024-03-13 08:57:00,994 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4178166b788c4edbb7241af6f720c55d 2024-03-13 08:57:00,995 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/meta/1588230740/info/4178166b788c4edbb7241af6f720c55d, entries=30, sequenceid=66, filesize=8.0 K 2024-03-13 08:57:00,996 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/meta/1588230740/.tmp/rep_barrier/b5bc18dee3f8448b89b1c2975fb6cd7f as hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/meta/1588230740/rep_barrier/b5bc18dee3f8448b89b1c2975fb6cd7f 2024-03-13 08:57:01,005 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b5bc18dee3f8448b89b1c2975fb6cd7f 2024-03-13 08:57:01,005 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/meta/1588230740/rep_barrier/b5bc18dee3f8448b89b1c2975fb6cd7f, entries=5, sequenceid=66, filesize=5.3 K 2024-03-13 08:57:01,006 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/meta/1588230740/.tmp/table/5e555209a5054f369e7760c35680d6bf as hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/meta/1588230740/table/5e555209a5054f369e7760c35680d6bf 2024-03-13 08:57:01,015 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5e555209a5054f369e7760c35680d6bf 2024-03-13 08:57:01,015 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/meta/1588230740/table/5e555209a5054f369e7760c35680d6bf, entries=13, sequenceid=66, filesize=5.6 K 2024-03-13 08:57:01,016 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~14.15 KB/14494, heapSize ~25.05 KB/25656, currentSize=0 B/0 for 1588230740 in 168ms, sequenceid=66, compaction requested=false 2024-03-13 08:57:01,037 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/data/hbase/meta/1588230740/recovered.edits/69.seqid, newMaxSeqId=69, maxSeqId=1 2024-03-13 08:57:01,039 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-03-13 08:57:01,040 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-03-13 08:57:01,040 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-03-13 08:57:01,040 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2024-03-13 08:57:01,048 INFO [RS:0;jenkins-hbase4:46097] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,46097,1710320151924; all regions closed. 2024-03-13 08:57:01,048 INFO [RS:1;jenkins-hbase4:46627] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,46627,1710320151969; all regions closed. 2024-03-13 08:57:01,048 DEBUG [RS:0;jenkins-hbase4:46097] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-03-13 08:57:01,048 DEBUG [RS:1;jenkins-hbase4:46627] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-03-13 08:57:01,069 DEBUG [RS:1;jenkins-hbase4:46627] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/oldWALs 2024-03-13 08:57:01,070 INFO [RS:1;jenkins-hbase4:46627] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46627%2C1710320151969.meta:.meta(num 1710320153557) 2024-03-13 08:57:01,070 DEBUG [RS:0;jenkins-hbase4:46097] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/oldWALs 2024-03-13 08:57:01,070 INFO [RS:0;jenkins-hbase4:46097] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46097%2C1710320151924:(num 1710320153435) 2024-03-13 08:57:01,070 DEBUG [RS:0;jenkins-hbase4:46097] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-13 08:57:01,070 INFO [RS:0;jenkins-hbase4:46097] regionserver.LeaseManager(133): Closed leases 2024-03-13 08:57:01,071 INFO [RS:0;jenkins-hbase4:46097] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2024-03-13 08:57:01,071 INFO [RS:0;jenkins-hbase4:46097] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-03-13 08:57:01,071 INFO [RS:0;jenkins-hbase4:46097] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-03-13 08:57:01,072 INFO [RS:0;jenkins-hbase4:46097] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-03-13 08:57:01,072 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-03-13 08:57:01,073 INFO [RS:0;jenkins-hbase4:46097] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46097 2024-03-13 08:57:01,082 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): regionserver:46627-0x1005c672cd60002, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46097,1710320151924 2024-03-13 08:57:01,082 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-03-13 08:57:01,082 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): regionserver:46627-0x1005c672cd60002, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-03-13 08:57:01,082 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): regionserver:46097-0x1005c672cd60001, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46097,1710320151924 2024-03-13 08:57:01,082 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): regionserver:46097-0x1005c672cd60001, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-03-13 08:57:01,083 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46097,1710320151924] 2024-03-13 08:57:01,083 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46097,1710320151924; numProcessing=1 2024-03-13 08:57:01,085 DEBUG [RS:1;jenkins-hbase4:46627] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/oldWALs 2024-03-13 08:57:01,085 INFO [RS:1;jenkins-hbase4:46627] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46627%2C1710320151969:(num 1710320153435) 2024-03-13 08:57:01,085 DEBUG [RS:1;jenkins-hbase4:46627] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-13 08:57:01,085 INFO [RS:1;jenkins-hbase4:46627] regionserver.LeaseManager(133): Closed leases 2024-03-13 08:57:01,085 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46097,1710320151924 already deleted, retry=false 2024-03-13 08:57:01,085 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,46097,1710320151924 expired; onlineServers=1 2024-03-13 08:57:01,085 INFO [RS:1;jenkins-hbase4:46627] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2024-03-13 08:57:01,086 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-03-13 08:57:01,087 INFO [RS:1;jenkins-hbase4:46627] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46627 2024-03-13 08:57:01,089 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): regionserver:46627-0x1005c672cd60002, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46627,1710320151969 2024-03-13 08:57:01,089 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-03-13 08:57:01,090 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46627,1710320151969] 2024-03-13 08:57:01,090 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46627,1710320151969; numProcessing=2 2024-03-13 08:57:01,092 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46627,1710320151969 already deleted, retry=false 2024-03-13 08:57:01,092 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,46627,1710320151969 expired; onlineServers=0 2024-03-13 08:57:01,092 INFO [RegionServerTracker-0] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,36183,1710320150734' ***** 2024-03-13 08:57:01,092 INFO [RegionServerTracker-0] regionserver.HRegionServer(2313): STOPPED: Cluster shutdown set; onlineServer=0 2024-03-13 08:57:01,093 DEBUG [M:0;jenkins-hbase4:36183] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c1462e8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-03-13 08:57:01,094 INFO [M:0;jenkins-hbase4:36183] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,36183,1710320150734 2024-03-13 08:57:01,094 INFO [M:0;jenkins-hbase4:36183] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,36183,1710320150734; all regions closed. 2024-03-13 08:57:01,094 DEBUG [M:0;jenkins-hbase4:36183] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-13 08:57:01,094 DEBUG [M:0;jenkins-hbase4:36183] cleaner.LogCleaner(198): Cancelling LogCleaner 2024-03-13 08:57:01,094 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2024-03-13 08:57:01,094 DEBUG [M:0;jenkins-hbase4:36183] cleaner.HFileCleaner(317): Stopping file delete threads 2024-03-13 08:57:01,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1710320153076] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1710320153076,5,FailOnTimeoutGroup] 2024-03-13 08:57:01,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1710320153075] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1710320153075,5,FailOnTimeoutGroup] 2024-03-13 08:57:01,094 INFO [M:0;jenkins-hbase4:36183] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2024-03-13 08:57:01,094 INFO [M:0;jenkins-hbase4:36183] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2024-03-13 08:57:01,094 INFO [M:0;jenkins-hbase4:36183] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS] on shutdown 2024-03-13 08:57:01,095 DEBUG [M:0;jenkins-hbase4:36183] master.HMaster(1517): Stopping service threads 2024-03-13 08:57:01,095 INFO [M:0;jenkins-hbase4:36183] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2024-03-13 08:57:01,095 ERROR [M:0;jenkins-hbase4:36183] procedure2.ProcedureExecutor(699): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-8,5,PEWorkerGroup] Thread[HFileArchiver-9,5,PEWorkerGroup] Thread[HFileArchiver-10,5,PEWorkerGroup] Thread[HFileArchiver-11,5,PEWorkerGroup] Thread[HFileArchiver-12,5,PEWorkerGroup] 2024-03-13 08:57:01,096 INFO [M:0;jenkins-hbase4:36183] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2024-03-13 08:57:01,096 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2024-03-13 08:57:01,096 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2024-03-13 08:57:01,096 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-13 08:57:01,097 DEBUG [M:0;jenkins-hbase4:36183] zookeeper.ZKUtil(399): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2024-03-13 08:57:01,097 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-03-13 08:57:01,097 WARN [M:0;jenkins-hbase4:36183] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2024-03-13 08:57:01,097 INFO [M:0;jenkins-hbase4:36183] assignment.AssignmentManager(315): Stopping assignment manager 2024-03-13 08:57:01,098 INFO [M:0;jenkins-hbase4:36183] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2024-03-13 08:57:01,098 DEBUG [M:0;jenkins-hbase4:36183] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-03-13 08:57:01,098 INFO [M:0;jenkins-hbase4:36183] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-13 08:57:01,098 DEBUG [M:0;jenkins-hbase4:36183] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-13 08:57:01,098 DEBUG [M:0;jenkins-hbase4:36183] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-03-13 08:57:01,099 DEBUG [M:0;jenkins-hbase4:36183] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-13 08:57:01,099 INFO [M:0;jenkins-hbase4:36183] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=152.89 KB heapSize=184.70 KB 2024-03-13 08:57:01,134 INFO [M:0;jenkins-hbase4:36183] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=152.89 KB at sequenceid=376 (bloomFilter=true), to=hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4f53b99e9b844e0e9c0fe01a4e97f33e 2024-03-13 08:57:01,141 INFO [M:0;jenkins-hbase4:36183] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4f53b99e9b844e0e9c0fe01a4e97f33e 2024-03-13 08:57:01,143 DEBUG [M:0;jenkins-hbase4:36183] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/4f53b99e9b844e0e9c0fe01a4e97f33e as hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4f53b99e9b844e0e9c0fe01a4e97f33e 2024-03-13 08:57:01,151 INFO [M:0;jenkins-hbase4:36183] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4f53b99e9b844e0e9c0fe01a4e97f33e 2024-03-13 08:57:01,151 INFO [M:0;jenkins-hbase4:36183] regionserver.HStore(1080): Added hdfs://localhost:45049/user/jenkins/test-data/985a85ea-b916-051e-0f33-2db5b1777aa4/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/4f53b99e9b844e0e9c0fe01a4e97f33e, entries=45, sequenceid=376, filesize=12.0 K 2024-03-13 08:57:01,152 INFO [M:0;jenkins-hbase4:36183] regionserver.HRegion(2948): Finished flush of dataSize ~152.89 KB/156562, heapSize ~184.69 KB/189120, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 53ms, sequenceid=376, compaction requested=false 2024-03-13 08:57:01,153 INFO [M:0;jenkins-hbase4:36183] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-13 08:57:01,154 DEBUG [M:0;jenkins-hbase4:36183] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-03-13 08:57:01,159 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-03-13 08:57:01,159 INFO [M:0;jenkins-hbase4:36183] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2024-03-13 08:57:01,159 INFO [M:0;jenkins-hbase4:36183] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36183 2024-03-13 08:57:01,162 DEBUG [M:0;jenkins-hbase4:36183] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,36183,1710320150734 already deleted, retry=false 2024-03-13 08:57:01,185 INFO [RS:0;jenkins-hbase4:46097] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,46097,1710320151924; zookeeper connection closed. 2024-03-13 08:57:01,185 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): regionserver:46097-0x1005c672cd60001, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-13 08:57:01,185 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): regionserver:46097-0x1005c672cd60001, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-13 08:57:01,185 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6ef1a756] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6ef1a756 2024-03-13 08:57:01,191 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): regionserver:46627-0x1005c672cd60002, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-13 08:57:01,191 INFO [RS:1;jenkins-hbase4:46627] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,46627,1710320151969; zookeeper connection closed. 2024-03-13 08:57:01,191 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): regionserver:46627-0x1005c672cd60002, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-13 08:57:01,191 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3f07e2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3f07e2 2024-03-13 08:57:01,191 INFO [Listener at localhost/37591] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2024-03-13 08:57:01,265 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-13 08:57:01,265 INFO [M:0;jenkins-hbase4:36183] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,36183,1710320150734; zookeeper connection closed. 2024-03-13 08:57:01,265 DEBUG [Listener at localhost/37591-EventThread] zookeeper.ZKWatcher(600): master:36183-0x1005c672cd60000, quorum=127.0.0.1:52215, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-13 08:57:01,267 WARN [Listener at localhost/37591] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-03-13 08:57:01,270 INFO [Listener at localhost/37591] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-03-13 08:57:01,376 WARN [BP-1489169000-172.31.14.131-1710320147643 heartbeating to localhost/127.0.0.1:45049] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-03-13 08:57:01,376 WARN [BP-1489169000-172.31.14.131-1710320147643 heartbeating to localhost/127.0.0.1:45049] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1489169000-172.31.14.131-1710320147643 (Datanode Uuid f20fe36f-929e-42a6-84e3-52b95f086d20) service to localhost/127.0.0.1:45049 2024-03-13 08:57:01,378 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/cluster_a0027e9f-97f8-3313-69aa-0deddba9a82b/dfs/data/data3/current/BP-1489169000-172.31.14.131-1710320147643] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-03-13 08:57:01,379 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/cluster_a0027e9f-97f8-3313-69aa-0deddba9a82b/dfs/data/data4/current/BP-1489169000-172.31.14.131-1710320147643] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-03-13 08:57:01,380 WARN [Listener at localhost/37591] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-03-13 08:57:01,384 INFO [Listener at localhost/37591] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-03-13 08:57:01,488 WARN [BP-1489169000-172.31.14.131-1710320147643 heartbeating to localhost/127.0.0.1:45049] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-03-13 08:57:01,488 WARN [BP-1489169000-172.31.14.131-1710320147643 heartbeating to localhost/127.0.0.1:45049] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1489169000-172.31.14.131-1710320147643 (Datanode Uuid 29a1450e-3a1a-459b-96e1-e18efacd6aa9) service to localhost/127.0.0.1:45049 2024-03-13 08:57:01,489 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/cluster_a0027e9f-97f8-3313-69aa-0deddba9a82b/dfs/data/data1/current/BP-1489169000-172.31.14.131-1710320147643] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-03-13 08:57:01,489 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bbbd1d89-0214-2fc6-7b5a-e6dbc236ba4d/cluster_a0027e9f-97f8-3313-69aa-0deddba9a82b/dfs/data/data2/current/BP-1489169000-172.31.14.131-1710320147643] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-03-13 08:57:01,532 INFO [Listener at localhost/37591] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-03-13 08:57:01,649 INFO [Listener at localhost/37591] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2024-03-13 08:57:01,696 INFO [Listener at localhost/37591] hbase.HBaseTestingUtility(1293): Minicluster is down