2024-03-02 14:55:34,461 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle timeout: 13 mins 2024-03-02 14:55:34,693 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494 2024-03-02 14:55:34,705 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2024-03-02 14:55:34,706 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/cluster_eba173ae-247f-1258-82b9-7b9b8add7c95, deleteOnExit=true 2024-03-02 14:55:34,706 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2024-03-02 14:55:34,706 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/test.cache.data in system properties and HBase conf 2024-03-02 14:55:34,707 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/hadoop.tmp.dir in system properties and HBase conf 2024-03-02 14:55:34,707 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/hadoop.log.dir in system properties and HBase conf 2024-03-02 14:55:34,708 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/mapreduce.cluster.local.dir in system properties and HBase conf 2024-03-02 14:55:34,708 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/mapreduce.cluster.temp.dir in system properties and HBase conf 2024-03-02 14:55:34,708 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2024-03-02 14:55:34,816 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2024-03-02 14:55:35,202 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-03-02 14:55:35,206 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2024-03-02 14:55:35,207 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2024-03-02 14:55:35,207 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/yarn.nodemanager.log-dirs in system properties and HBase conf 2024-03-02 14:55:35,207 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-03-02 14:55:35,208 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2024-03-02 14:55:35,208 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2024-03-02 14:55:35,208 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-03-02 14:55:35,209 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/dfs.journalnode.edits.dir in system properties and HBase conf 2024-03-02 14:55:35,209 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2024-03-02 14:55:35,210 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/nfs.dump.dir in system properties and HBase conf 2024-03-02 14:55:35,210 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/java.io.tmpdir in system properties and HBase conf 2024-03-02 14:55:35,210 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/dfs.journalnode.edits.dir in system properties and HBase conf 2024-03-02 14:55:35,211 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2024-03-02 14:55:35,211 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2024-03-02 14:55:35,741 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-03-02 14:55:35,746 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-03-02 14:55:36,030 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2024-03-02 14:55:36,191 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2024-03-02 14:55:36,206 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-03-02 14:55:36,243 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2024-03-02 14:55:36,277 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/java.io.tmpdir/Jetty_localhost_39783_hdfs____t1fe9i/webapp 2024-03-02 14:55:36,418 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39783 2024-03-02 14:55:36,428 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-03-02 14:55:36,428 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-03-02 14:55:36,883 WARN [Listener at localhost/37505] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-03-02 14:55:36,945 WARN [Listener at localhost/37505] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-03-02 14:55:36,964 WARN [Listener at localhost/37505] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-03-02 14:55:36,971 INFO [Listener at localhost/37505] log.Slf4jLog(67): jetty-6.1.26 2024-03-02 14:55:36,975 INFO [Listener at localhost/37505] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/java.io.tmpdir/Jetty_localhost_40751_datanode____.11yphe/webapp 2024-03-02 14:55:37,073 INFO [Listener at localhost/37505] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40751 2024-03-02 14:55:37,388 WARN [Listener at localhost/43135] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-03-02 14:55:37,404 WARN [Listener at localhost/43135] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-03-02 14:55:37,408 WARN [Listener at localhost/43135] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-03-02 14:55:37,410 INFO [Listener at localhost/43135] log.Slf4jLog(67): jetty-6.1.26 2024-03-02 14:55:37,416 INFO [Listener at localhost/43135] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/java.io.tmpdir/Jetty_localhost_46353_datanode____.j339sa/webapp 2024-03-02 14:55:37,532 INFO [Listener at localhost/43135] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46353 2024-03-02 14:55:37,541 WARN [Listener at localhost/45685] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-03-02 14:55:37,880 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd4e5565674cbbd28: Processing first storage report for DS-a6c0d3ae-6663-47d4-a760-55e04a8c5a79 from datanode 60b42497-6431-47ae-b4d0-9b93a6d3af21 2024-03-02 14:55:37,882 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd4e5565674cbbd28: from storage DS-a6c0d3ae-6663-47d4-a760-55e04a8c5a79 node DatanodeRegistration(127.0.0.1:40059, datanodeUuid=60b42497-6431-47ae-b4d0-9b93a6d3af21, infoPort=39309, infoSecurePort=0, ipcPort=45685, storageInfo=lv=-57;cid=testClusterID;nsid=369283517;c=1709391335824), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2024-03-02 14:55:37,882 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5bb829fcb5092f0c: Processing first storage report for DS-a2cf3635-889a-4da9-871e-5cd006a1b3fc from datanode 140be842-71c2-4410-b57d-16a32eda4bc8 2024-03-02 14:55:37,882 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5bb829fcb5092f0c: from storage DS-a2cf3635-889a-4da9-871e-5cd006a1b3fc node DatanodeRegistration(127.0.0.1:38291, datanodeUuid=140be842-71c2-4410-b57d-16a32eda4bc8, infoPort=34933, infoSecurePort=0, ipcPort=43135, storageInfo=lv=-57;cid=testClusterID;nsid=369283517;c=1709391335824), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2024-03-02 14:55:37,882 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xd4e5565674cbbd28: Processing first storage report for DS-74872b29-7814-4b20-9497-e942e1d82969 from datanode 60b42497-6431-47ae-b4d0-9b93a6d3af21 2024-03-02 14:55:37,882 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xd4e5565674cbbd28: from storage DS-74872b29-7814-4b20-9497-e942e1d82969 node DatanodeRegistration(127.0.0.1:40059, datanodeUuid=60b42497-6431-47ae-b4d0-9b93a6d3af21, infoPort=39309, infoSecurePort=0, ipcPort=45685, storageInfo=lv=-57;cid=testClusterID;nsid=369283517;c=1709391335824), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2024-03-02 14:55:37,882 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5bb829fcb5092f0c: Processing first storage report for DS-03e71842-8483-4640-a62d-a105d719e78a from datanode 140be842-71c2-4410-b57d-16a32eda4bc8 2024-03-02 14:55:37,883 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5bb829fcb5092f0c: from storage DS-03e71842-8483-4640-a62d-a105d719e78a node DatanodeRegistration(127.0.0.1:38291, datanodeUuid=140be842-71c2-4410-b57d-16a32eda4bc8, infoPort=34933, infoSecurePort=0, ipcPort=43135, storageInfo=lv=-57;cid=testClusterID;nsid=369283517;c=1709391335824), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-03-02 14:55:37,941 DEBUG [Listener at localhost/45685] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494 2024-03-02 14:55:38,050 INFO [Listener at localhost/45685] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/cluster_eba173ae-247f-1258-82b9-7b9b8add7c95/zookeeper_0, clientPort=58480, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/cluster_eba173ae-247f-1258-82b9-7b9b8add7c95/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/cluster_eba173ae-247f-1258-82b9-7b9b8add7c95/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2024-03-02 14:55:38,066 INFO [Listener at localhost/45685] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58480 2024-03-02 14:55:38,088 INFO [Listener at localhost/45685] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-02 14:55:38,092 INFO [Listener at localhost/45685] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-02 14:55:38,747 INFO [Listener at localhost/45685] util.FSUtils(471): Created version file at hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7 with version=8 2024-03-02 14:55:38,748 INFO [Listener at localhost/45685] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/hbase-staging 2024-03-02 14:55:39,073 INFO [Listener at localhost/45685] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2024-03-02 14:55:39,556 INFO [Listener at localhost/45685] client.ConnectionUtils(126): master/jenkins-hbase4:0 server-side Connection retries=45 2024-03-02 14:55:39,590 INFO [Listener at localhost/45685] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-02 14:55:39,591 INFO [Listener at localhost/45685] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-03-02 14:55:39,591 INFO [Listener at localhost/45685] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-03-02 14:55:39,591 INFO [Listener at localhost/45685] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-02 14:55:39,591 INFO [Listener at localhost/45685] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-03-02 14:55:39,737 INFO [Listener at localhost/45685] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2024-03-02 14:55:39,820 DEBUG [Listener at localhost/45685] util.ClassSize(228): Using Unsafe to estimate memory layout 2024-03-02 14:55:39,915 INFO [Listener at localhost/45685] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39587 2024-03-02 14:55:39,925 INFO [Listener at localhost/45685] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-02 14:55:39,927 INFO [Listener at localhost/45685] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-02 14:55:39,947 INFO [Listener at localhost/45685] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39587 connecting to ZooKeeper ensemble=127.0.0.1:58480 2024-03-02 14:55:39,990 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:395870x0, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-03-02 14:55:39,992 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:39587-0x100250aa1ae0000 connected 2024-03-02 14:55:40,022 DEBUG [Listener at localhost/45685] zookeeper.ZKUtil(165): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-03-02 14:55:40,023 DEBUG [Listener at localhost/45685] zookeeper.ZKUtil(165): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-02 14:55:40,026 DEBUG [Listener at localhost/45685] zookeeper.ZKUtil(165): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-03-02 14:55:40,034 DEBUG [Listener at localhost/45685] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39587 2024-03-02 14:55:40,035 DEBUG [Listener at localhost/45685] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39587 2024-03-02 14:55:40,035 DEBUG [Listener at localhost/45685] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39587 2024-03-02 14:55:40,036 DEBUG [Listener at localhost/45685] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39587 2024-03-02 14:55:40,036 DEBUG [Listener at localhost/45685] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39587 2024-03-02 14:55:40,042 INFO [Listener at localhost/45685] master.HMaster(445): hbase.rootdir=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7, hbase.cluster.distributed=false 2024-03-02 14:55:40,113 INFO [Listener at localhost/45685] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-03-02 14:55:40,113 INFO [Listener at localhost/45685] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-02 14:55:40,113 INFO [Listener at localhost/45685] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-03-02 14:55:40,113 INFO [Listener at localhost/45685] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-03-02 14:55:40,113 INFO [Listener at localhost/45685] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-02 14:55:40,114 INFO [Listener at localhost/45685] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-03-02 14:55:40,119 INFO [Listener at localhost/45685] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-03-02 14:55:40,121 INFO [Listener at localhost/45685] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36719 2024-03-02 14:55:40,124 INFO [Listener at localhost/45685] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-03-02 14:55:40,130 DEBUG [Listener at localhost/45685] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-03-02 14:55:40,131 INFO [Listener at localhost/45685] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-02 14:55:40,133 INFO [Listener at localhost/45685] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-02 14:55:40,135 INFO [Listener at localhost/45685] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36719 connecting to ZooKeeper ensemble=127.0.0.1:58480 2024-03-02 14:55:40,138 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): regionserver:367190x0, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-03-02 14:55:40,139 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36719-0x100250aa1ae0001 connected 2024-03-02 14:55:40,140 DEBUG [Listener at localhost/45685] zookeeper.ZKUtil(165): regionserver:36719-0x100250aa1ae0001, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-03-02 14:55:40,141 DEBUG [Listener at localhost/45685] zookeeper.ZKUtil(165): regionserver:36719-0x100250aa1ae0001, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-02 14:55:40,142 DEBUG [Listener at localhost/45685] zookeeper.ZKUtil(165): regionserver:36719-0x100250aa1ae0001, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-03-02 14:55:40,143 DEBUG [Listener at localhost/45685] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36719 2024-03-02 14:55:40,143 DEBUG [Listener at localhost/45685] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36719 2024-03-02 14:55:40,143 DEBUG [Listener at localhost/45685] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36719 2024-03-02 14:55:40,144 DEBUG [Listener at localhost/45685] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36719 2024-03-02 14:55:40,144 DEBUG [Listener at localhost/45685] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36719 2024-03-02 14:55:40,157 INFO [Listener at localhost/45685] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-03-02 14:55:40,157 INFO [Listener at localhost/45685] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-02 14:55:40,157 INFO [Listener at localhost/45685] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-03-02 14:55:40,157 INFO [Listener at localhost/45685] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-03-02 14:55:40,158 INFO [Listener at localhost/45685] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-02 14:55:40,158 INFO [Listener at localhost/45685] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-03-02 14:55:40,158 INFO [Listener at localhost/45685] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-03-02 14:55:40,159 INFO [Listener at localhost/45685] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41195 2024-03-02 14:55:40,160 INFO [Listener at localhost/45685] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-03-02 14:55:40,161 DEBUG [Listener at localhost/45685] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-03-02 14:55:40,161 INFO [Listener at localhost/45685] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-02 14:55:40,163 INFO [Listener at localhost/45685] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-02 14:55:40,165 INFO [Listener at localhost/45685] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41195 connecting to ZooKeeper ensemble=127.0.0.1:58480 2024-03-02 14:55:40,168 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): regionserver:411950x0, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-03-02 14:55:40,169 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41195-0x100250aa1ae0002 connected 2024-03-02 14:55:40,170 DEBUG [Listener at localhost/45685] zookeeper.ZKUtil(165): regionserver:41195-0x100250aa1ae0002, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-03-02 14:55:40,171 DEBUG [Listener at localhost/45685] zookeeper.ZKUtil(165): regionserver:41195-0x100250aa1ae0002, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-02 14:55:40,171 DEBUG [Listener at localhost/45685] zookeeper.ZKUtil(165): regionserver:41195-0x100250aa1ae0002, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-03-02 14:55:40,172 DEBUG [Listener at localhost/45685] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41195 2024-03-02 14:55:40,172 DEBUG [Listener at localhost/45685] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41195 2024-03-02 14:55:40,172 DEBUG [Listener at localhost/45685] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41195 2024-03-02 14:55:40,173 DEBUG [Listener at localhost/45685] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41195 2024-03-02 14:55:40,174 DEBUG [Listener at localhost/45685] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41195 2024-03-02 14:55:40,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2174): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39587,1709391338894 2024-03-02 14:55:40,185 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-03-02 14:55:40,187 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39587,1709391338894 2024-03-02 14:55:40,207 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): regionserver:36719-0x100250aa1ae0001, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-03-02 14:55:40,207 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): regionserver:41195-0x100250aa1ae0002, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-03-02 14:55:40,207 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-03-02 14:55:40,208 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-02 14:55:40,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-03-02 14:55:40,210 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39587,1709391338894 from backup master directory 2024-03-02 14:55:40,210 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(163): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-03-02 14:55:40,213 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39587,1709391338894 2024-03-02 14:55:40,213 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-03-02 14:55:40,214 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-03-02 14:55:40,214 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,39587,1709391338894 2024-03-02 14:55:40,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2024-03-02 14:55:40,218 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2024-03-02 14:55:40,303 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/hbase.id with ID: 8e103800-679f-4e9e-b4fe-3ff4c6b4bcb8 2024-03-02 14:55:40,346 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-02 14:55:40,360 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-02 14:55:40,404 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x0acd0a85 to 127.0.0.1:58480 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-03-02 14:55:40,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@176ff9d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-03-02 14:55:40,461 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-02 14:55:40,462 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2024-03-02 14:55:40,481 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2024-03-02 14:55:40,481 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2024-03-02 14:55:40,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-03-02 14:55:40,487 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-03-02 14:55:40,489 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-03-02 14:55:40,528 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/MasterData/data/master/store-tmp 2024-03-02 14:55:40,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-02 14:55:40,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-03-02 14:55:40,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-02 14:55:40,565 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-02 14:55:40,565 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-03-02 14:55:40,565 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-02 14:55:40,565 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-02 14:55:40,565 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-03-02 14:55:40,567 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/MasterData/WALs/jenkins-hbase4.apache.org,39587,1709391338894 2024-03-02 14:55:40,588 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39587%2C1709391338894, suffix=, logDir=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/MasterData/WALs/jenkins-hbase4.apache.org,39587,1709391338894, archiveDir=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/MasterData/oldWALs, maxLogs=10 2024-03-02 14:55:40,648 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38291,DS-a2cf3635-889a-4da9-871e-5cd006a1b3fc,DISK] 2024-03-02 14:55:40,648 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40059,DS-a6c0d3ae-6663-47d4-a760-55e04a8c5a79,DISK] 2024-03-02 14:55:40,656 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2024-03-02 14:55:40,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/MasterData/WALs/jenkins-hbase4.apache.org,39587,1709391338894/jenkins-hbase4.apache.org%2C39587%2C1709391338894.1709391340599 2024-03-02 14:55:40,725 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40059,DS-a6c0d3ae-6663-47d4-a760-55e04a8c5a79,DISK], DatanodeInfoWithStorage[127.0.0.1:38291,DS-a2cf3635-889a-4da9-871e-5cd006a1b3fc,DISK]] 2024-03-02 14:55:40,726 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2024-03-02 14:55:40,726 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-02 14:55:40,730 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2024-03-02 14:55:40,731 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2024-03-02 14:55:40,788 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2024-03-02 14:55:40,796 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2024-03-02 14:55:40,820 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2024-03-02 14:55:40,831 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-02 14:55:40,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-03-02 14:55:40,839 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-03-02 14:55:40,853 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2024-03-02 14:55:40,857 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-02 14:55:40,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61759213, jitterRate=-0.07971601188182831}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-02 14:55:40,858 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2024-03-02 14:55:40,861 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2024-03-02 14:55:40,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2024-03-02 14:55:40,880 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(608): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2024-03-02 14:55:40,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2024-03-02 14:55:40,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(628): Recovered RegionProcedureStore lease in 1 msec 2024-03-02 14:55:40,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(642): Loaded RegionProcedureStore in 32 msec 2024-03-02 14:55:40,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2024-03-02 14:55:40,943 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2024-03-02 14:55:40,948 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2024-03-02 14:55:40,972 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2024-03-02 14:55:40,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2024-03-02 14:55:40,977 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2024-03-02 14:55:40,982 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2024-03-02 14:55:40,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2024-03-02 14:55:40,989 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-02 14:55:40,991 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2024-03-02 14:55:40,992 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2024-03-02 14:55:41,003 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2024-03-02 14:55:41,008 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): regionserver:36719-0x100250aa1ae0001, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-03-02 14:55:41,008 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-03-02 14:55:41,008 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): regionserver:41195-0x100250aa1ae0002, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-03-02 14:55:41,008 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-02 14:55:41,009 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(745): Active/primary master=jenkins-hbase4.apache.org,39587,1709391338894, sessionid=0x100250aa1ae0000, setting cluster-up flag (Was=false) 2024-03-02 14:55:41,031 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-02 14:55:41,039 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2024-03-02 14:55:41,040 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39587,1709391338894 2024-03-02 14:55:41,046 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-02 14:55:41,052 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2024-03-02 14:55:41,054 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39587,1709391338894 2024-03-02 14:55:41,056 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.hbase-snapshot/.tmp 2024-03-02 14:55:41,077 INFO [RS:1;jenkins-hbase4:41195] regionserver.HRegionServer(954): ClusterId : 8e103800-679f-4e9e-b4fe-3ff4c6b4bcb8 2024-03-02 14:55:41,077 INFO [RS:0;jenkins-hbase4:36719] regionserver.HRegionServer(954): ClusterId : 8e103800-679f-4e9e-b4fe-3ff4c6b4bcb8 2024-03-02 14:55:41,083 DEBUG [RS:1;jenkins-hbase4:41195] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-03-02 14:55:41,083 DEBUG [RS:0;jenkins-hbase4:36719] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-03-02 14:55:41,089 DEBUG [RS:1;jenkins-hbase4:41195] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-03-02 14:55:41,089 DEBUG [RS:0;jenkins-hbase4:36719] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-03-02 14:55:41,089 DEBUG [RS:1;jenkins-hbase4:41195] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-03-02 14:55:41,090 DEBUG [RS:0;jenkins-hbase4:36719] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-03-02 14:55:41,094 DEBUG [RS:1;jenkins-hbase4:41195] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-03-02 14:55:41,095 DEBUG [RS:0;jenkins-hbase4:36719] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-03-02 14:55:41,096 DEBUG [RS:1;jenkins-hbase4:41195] zookeeper.ReadOnlyZKClient(139): Connect 0x71381fe9 to 127.0.0.1:58480 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-03-02 14:55:41,098 DEBUG [RS:0;jenkins-hbase4:36719] zookeeper.ReadOnlyZKClient(139): Connect 0x26f08827 to 127.0.0.1:58480 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-03-02 14:55:41,102 DEBUG [RS:1;jenkins-hbase4:41195] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7fffefbe, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-03-02 14:55:41,103 DEBUG [RS:0;jenkins-hbase4:36719] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28376289, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-03-02 14:55:41,103 DEBUG [RS:1;jenkins-hbase4:41195] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7bc07499, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-03-02 14:55:41,103 DEBUG [RS:0;jenkins-hbase4:36719] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c08e357, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-03-02 14:55:41,111 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver loaded, priority=536870911. 2024-03-02 14:55:41,126 DEBUG [RS:1;jenkins-hbase4:41195] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:41195 2024-03-02 14:55:41,126 DEBUG [RS:0;jenkins-hbase4:36719] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36719 2024-03-02 14:55:41,130 INFO [RS:1;jenkins-hbase4:41195] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-03-02 14:55:41,130 INFO [RS:0;jenkins-hbase4:36719] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-03-02 14:55:41,131 INFO [RS:0;jenkins-hbase4:36719] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-03-02 14:55:41,131 INFO [RS:1;jenkins-hbase4:41195] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-03-02 14:55:41,131 DEBUG [RS:0;jenkins-hbase4:36719] regionserver.HRegionServer(1025): About to register with Master. 2024-03-02 14:55:41,131 DEBUG [RS:1;jenkins-hbase4:41195] regionserver.HRegionServer(1025): About to register with Master. 2024-03-02 14:55:41,134 INFO [RS:0;jenkins-hbase4:36719] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase4.apache.org,39587,1709391338894 with isa=jenkins-hbase4.apache.org/172.31.14.131:36719, startcode=1709391340112 2024-03-02 14:55:41,134 INFO [RS:1;jenkins-hbase4:41195] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase4.apache.org,39587,1709391338894 with isa=jenkins-hbase4.apache.org/172.31.14.131:41195, startcode=1709391340156 2024-03-02 14:55:41,152 DEBUG [RS:1;jenkins-hbase4:41195] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-03-02 14:55:41,152 DEBUG [RS:0;jenkins-hbase4:36719] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-03-02 14:55:41,197 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2024-03-02 14:55:41,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-03-02 14:55:41,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-03-02 14:55:41,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-03-02 14:55:41,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-03-02 14:55:41,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2024-03-02 14:55:41,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-02 14:55:41,208 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-03-02 14:55:41,209 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-02 14:55:41,211 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48443, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2024-03-02 14:55:41,211 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1709391371211 2024-03-02 14:55:41,211 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49133, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2024-03-02 14:55:41,213 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2024-03-02 14:55:41,221 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2024-03-02 14:55:41,221 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2024-03-02 14:55:41,221 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39587] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2838) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15910) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2024-03-02 14:55:41,225 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2024-03-02 14:55:41,227 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-03-02 14:55:41,231 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39587] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2838) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15910) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2024-03-02 14:55:41,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2024-03-02 14:55:41,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2024-03-02 14:55:41,234 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2024-03-02 14:55:41,235 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2024-03-02 14:55:41,235 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:41,237 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2024-03-02 14:55:41,238 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2024-03-02 14:55:41,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2024-03-02 14:55:41,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2024-03-02 14:55:41,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2024-03-02 14:55:41,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1709391341243,5,FailOnTimeoutGroup] 2024-03-02 14:55:41,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1709391341245,5,FailOnTimeoutGroup] 2024-03-02 14:55:41,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:41,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1466): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2024-03-02 14:55:41,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:41,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:41,252 DEBUG [RS:0;jenkins-hbase4:36719] regionserver.HRegionServer(2832): Master is not running yet 2024-03-02 14:55:41,252 DEBUG [RS:1;jenkins-hbase4:41195] regionserver.HRegionServer(2832): Master is not running yet 2024-03-02 14:55:41,252 WARN [RS:0;jenkins-hbase4:36719] regionserver.HRegionServer(1033): reportForDuty failed; sleeping 100 ms and then retrying. 2024-03-02 14:55:41,252 WARN [RS:1;jenkins-hbase4:41195] regionserver.HRegionServer(1033): reportForDuty failed; sleeping 100 ms and then retrying. 2024-03-02 14:55:41,267 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-03-02 14:55:41,268 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-03-02 14:55:41,269 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7 2024-03-02 14:55:41,287 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-02 14:55:41,289 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-03-02 14:55:41,292 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/meta/1588230740/info 2024-03-02 14:55:41,293 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-03-02 14:55:41,294 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-02 14:55:41,294 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-03-02 14:55:41,297 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/meta/1588230740/rep_barrier 2024-03-02 14:55:41,298 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-03-02 14:55:41,299 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-02 14:55:41,299 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-03-02 14:55:41,301 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/meta/1588230740/table 2024-03-02 14:55:41,302 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-03-02 14:55:41,302 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-02 14:55:41,304 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/meta/1588230740 2024-03-02 14:55:41,305 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/meta/1588230740 2024-03-02 14:55:41,309 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-03-02 14:55:41,311 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2024-03-02 14:55:41,314 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-02 14:55:41,315 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59738949, jitterRate=-0.10982029139995575}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-03-02 14:55:41,315 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2024-03-02 14:55:41,316 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-03-02 14:55:41,316 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-03-02 14:55:41,316 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-03-02 14:55:41,316 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-03-02 14:55:41,316 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-03-02 14:55:41,317 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-03-02 14:55:41,317 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-03-02 14:55:41,323 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2024-03-02 14:55:41,323 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2024-03-02 14:55:41,331 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2024-03-02 14:55:41,342 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2024-03-02 14:55:41,345 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2024-03-02 14:55:41,353 INFO [RS:0;jenkins-hbase4:36719] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase4.apache.org,39587,1709391338894 with isa=jenkins-hbase4.apache.org/172.31.14.131:36719, startcode=1709391340112 2024-03-02 14:55:41,353 INFO [RS:1;jenkins-hbase4:41195] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase4.apache.org,39587,1709391338894 with isa=jenkins-hbase4.apache.org/172.31.14.131:41195, startcode=1709391340156 2024-03-02 14:55:41,358 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39587] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:55:41,364 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39587] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,36719,1709391340112 2024-03-02 14:55:41,364 DEBUG [RS:1;jenkins-hbase4:41195] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7 2024-03-02 14:55:41,365 DEBUG [RS:1;jenkins-hbase4:41195] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:37505 2024-03-02 14:55:41,365 DEBUG [RS:1;jenkins-hbase4:41195] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-03-02 14:55:41,365 DEBUG [RS:0;jenkins-hbase4:36719] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7 2024-03-02 14:55:41,365 DEBUG [RS:0;jenkins-hbase4:36719] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:37505 2024-03-02 14:55:41,365 DEBUG [RS:0;jenkins-hbase4:36719] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-03-02 14:55:41,372 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-03-02 14:55:41,373 DEBUG [RS:1;jenkins-hbase4:41195] zookeeper.ZKUtil(163): regionserver:41195-0x100250aa1ae0002, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:55:41,373 DEBUG [RS:0;jenkins-hbase4:36719] zookeeper.ZKUtil(163): regionserver:36719-0x100250aa1ae0001, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36719,1709391340112 2024-03-02 14:55:41,373 WARN [RS:1;jenkins-hbase4:41195] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-03-02 14:55:41,374 WARN [RS:0;jenkins-hbase4:36719] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-03-02 14:55:41,374 INFO [RS:1;jenkins-hbase4:41195] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-03-02 14:55:41,375 INFO [RS:0;jenkins-hbase4:36719] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-03-02 14:55:41,375 DEBUG [RS:1;jenkins-hbase4:41195] regionserver.HRegionServer(1950): logDir=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/WALs/jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:55:41,375 DEBUG [RS:0;jenkins-hbase4:36719] regionserver.HRegionServer(1950): logDir=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/WALs/jenkins-hbase4.apache.org,36719,1709391340112 2024-03-02 14:55:41,376 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41195,1709391340156] 2024-03-02 14:55:41,376 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36719,1709391340112] 2024-03-02 14:55:41,386 DEBUG [RS:1;jenkins-hbase4:41195] zookeeper.ZKUtil(163): regionserver:41195-0x100250aa1ae0002, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:55:41,386 DEBUG [RS:0;jenkins-hbase4:36719] zookeeper.ZKUtil(163): regionserver:36719-0x100250aa1ae0001, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:55:41,387 DEBUG [RS:1;jenkins-hbase4:41195] zookeeper.ZKUtil(163): regionserver:41195-0x100250aa1ae0002, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36719,1709391340112 2024-03-02 14:55:41,387 DEBUG [RS:0;jenkins-hbase4:36719] zookeeper.ZKUtil(163): regionserver:36719-0x100250aa1ae0001, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36719,1709391340112 2024-03-02 14:55:41,397 DEBUG [RS:0;jenkins-hbase4:36719] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-03-02 14:55:41,397 DEBUG [RS:1;jenkins-hbase4:41195] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-03-02 14:55:41,407 INFO [RS:0;jenkins-hbase4:36719] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-03-02 14:55:41,407 INFO [RS:1;jenkins-hbase4:41195] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-03-02 14:55:41,426 INFO [RS:1;jenkins-hbase4:41195] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-03-02 14:55:41,426 INFO [RS:0;jenkins-hbase4:36719] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-03-02 14:55:41,430 INFO [RS:0;jenkins-hbase4:36719] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-03-02 14:55:41,430 INFO [RS:1;jenkins-hbase4:41195] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-03-02 14:55:41,430 INFO [RS:0;jenkins-hbase4:36719] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:41,430 INFO [RS:1;jenkins-hbase4:41195] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:41,432 INFO [RS:1;jenkins-hbase4:41195] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-03-02 14:55:41,432 INFO [RS:0;jenkins-hbase4:36719] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-03-02 14:55:41,439 INFO [RS:1;jenkins-hbase4:41195] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:41,439 INFO [RS:0;jenkins-hbase4:36719] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:41,440 DEBUG [RS:1;jenkins-hbase4:41195] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-02 14:55:41,440 DEBUG [RS:0;jenkins-hbase4:36719] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-02 14:55:41,440 DEBUG [RS:1;jenkins-hbase4:41195] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-02 14:55:41,440 DEBUG [RS:0;jenkins-hbase4:36719] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-02 14:55:41,440 DEBUG [RS:1;jenkins-hbase4:41195] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-02 14:55:41,440 DEBUG [RS:0;jenkins-hbase4:36719] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-02 14:55:41,440 DEBUG [RS:1;jenkins-hbase4:41195] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-02 14:55:41,440 DEBUG [RS:0;jenkins-hbase4:36719] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-02 14:55:41,440 DEBUG [RS:1;jenkins-hbase4:41195] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-02 14:55:41,440 DEBUG [RS:0;jenkins-hbase4:36719] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-02 14:55:41,441 DEBUG [RS:1;jenkins-hbase4:41195] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-03-02 14:55:41,441 DEBUG [RS:0;jenkins-hbase4:36719] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-03-02 14:55:41,441 DEBUG [RS:1;jenkins-hbase4:41195] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-02 14:55:41,441 DEBUG [RS:0;jenkins-hbase4:36719] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-02 14:55:41,441 DEBUG [RS:1;jenkins-hbase4:41195] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-02 14:55:41,441 DEBUG [RS:0;jenkins-hbase4:36719] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-02 14:55:41,441 DEBUG [RS:1;jenkins-hbase4:41195] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-02 14:55:41,441 DEBUG [RS:0;jenkins-hbase4:36719] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-02 14:55:41,441 DEBUG [RS:1;jenkins-hbase4:41195] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-02 14:55:41,441 DEBUG [RS:0;jenkins-hbase4:36719] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-02 14:55:41,443 INFO [RS:0;jenkins-hbase4:36719] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:41,444 INFO [RS:1;jenkins-hbase4:41195] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:41,444 INFO [RS:0;jenkins-hbase4:36719] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:41,444 INFO [RS:1;jenkins-hbase4:41195] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:41,444 INFO [RS:0;jenkins-hbase4:36719] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:41,444 INFO [RS:1;jenkins-hbase4:41195] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:41,444 INFO [RS:0;jenkins-hbase4:36719] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:41,444 INFO [RS:1;jenkins-hbase4:41195] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:41,463 INFO [RS:0;jenkins-hbase4:36719] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-03-02 14:55:41,463 INFO [RS:1;jenkins-hbase4:41195] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-03-02 14:55:41,467 INFO [RS:0;jenkins-hbase4:36719] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36719,1709391340112-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:41,467 INFO [RS:1;jenkins-hbase4:41195] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41195,1709391340156-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:41,488 INFO [RS:0;jenkins-hbase4:36719] regionserver.Replication(203): jenkins-hbase4.apache.org,36719,1709391340112 started 2024-03-02 14:55:41,488 INFO [RS:0;jenkins-hbase4:36719] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,36719,1709391340112, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36719, sessionid=0x100250aa1ae0001 2024-03-02 14:55:41,489 DEBUG [RS:0;jenkins-hbase4:36719] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-03-02 14:55:41,489 DEBUG [RS:0;jenkins-hbase4:36719] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36719,1709391340112 2024-03-02 14:55:41,489 DEBUG [RS:0;jenkins-hbase4:36719] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36719,1709391340112' 2024-03-02 14:55:41,489 DEBUG [RS:0;jenkins-hbase4:36719] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-03-02 14:55:41,489 INFO [RS:1;jenkins-hbase4:41195] regionserver.Replication(203): jenkins-hbase4.apache.org,41195,1709391340156 started 2024-03-02 14:55:41,489 INFO [RS:1;jenkins-hbase4:41195] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,41195,1709391340156, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41195, sessionid=0x100250aa1ae0002 2024-03-02 14:55:41,490 DEBUG [RS:1;jenkins-hbase4:41195] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-03-02 14:55:41,490 DEBUG [RS:1;jenkins-hbase4:41195] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:55:41,490 DEBUG [RS:1;jenkins-hbase4:41195] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41195,1709391340156' 2024-03-02 14:55:41,491 DEBUG [RS:1;jenkins-hbase4:41195] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-03-02 14:55:41,491 DEBUG [RS:0;jenkins-hbase4:36719] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-03-02 14:55:41,491 DEBUG [RS:1;jenkins-hbase4:41195] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-03-02 14:55:41,492 DEBUG [RS:0;jenkins-hbase4:36719] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-03-02 14:55:41,492 DEBUG [RS:0;jenkins-hbase4:36719] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-03-02 14:55:41,492 DEBUG [RS:0;jenkins-hbase4:36719] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36719,1709391340112 2024-03-02 14:55:41,492 DEBUG [RS:0;jenkins-hbase4:36719] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36719,1709391340112' 2024-03-02 14:55:41,492 DEBUG [RS:0;jenkins-hbase4:36719] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-03-02 14:55:41,492 DEBUG [RS:1;jenkins-hbase4:41195] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-03-02 14:55:41,492 DEBUG [RS:1;jenkins-hbase4:41195] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-03-02 14:55:41,492 DEBUG [RS:1;jenkins-hbase4:41195] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:55:41,493 DEBUG [RS:1;jenkins-hbase4:41195] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41195,1709391340156' 2024-03-02 14:55:41,493 DEBUG [RS:1;jenkins-hbase4:41195] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-03-02 14:55:41,493 DEBUG [RS:0;jenkins-hbase4:36719] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-03-02 14:55:41,494 DEBUG [RS:1;jenkins-hbase4:41195] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-03-02 14:55:41,494 DEBUG [RS:0;jenkins-hbase4:36719] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-03-02 14:55:41,494 INFO [RS:0;jenkins-hbase4:36719] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-03-02 14:55:41,494 DEBUG [RS:1;jenkins-hbase4:41195] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-03-02 14:55:41,494 INFO [RS:1;jenkins-hbase4:41195] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-03-02 14:55:41,497 INFO [RS:0;jenkins-hbase4:36719] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:41,497 INFO [RS:1;jenkins-hbase4:41195] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:41,497 DEBUG [jenkins-hbase4:39587] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=2, allServersCount=2 2024-03-02 14:55:41,497 DEBUG [RS:0;jenkins-hbase4:36719] zookeeper.ZKUtil(399): regionserver:36719-0x100250aa1ae0001, quorum=127.0.0.1:58480, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-03-02 14:55:41,498 INFO [RS:0;jenkins-hbase4:36719] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-03-02 14:55:41,498 INFO [RS:0;jenkins-hbase4:36719] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:41,499 INFO [RS:0;jenkins-hbase4:36719] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:41,501 DEBUG [RS:1;jenkins-hbase4:41195] zookeeper.ZKUtil(399): regionserver:41195-0x100250aa1ae0002, quorum=127.0.0.1:58480, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-03-02 14:55:41,501 INFO [RS:1;jenkins-hbase4:41195] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-03-02 14:55:41,501 INFO [RS:1;jenkins-hbase4:41195] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:41,501 INFO [RS:1;jenkins-hbase4:41195] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:41,501 DEBUG [jenkins-hbase4:39587] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-02 14:55:41,508 DEBUG [jenkins-hbase4:39587] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-02 14:55:41,508 DEBUG [jenkins-hbase4:39587] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-02 14:55:41,508 DEBUG [jenkins-hbase4:39587] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-02 14:55:41,510 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41195,1709391340156, state=OPENING 2024-03-02 14:55:41,517 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2024-03-02 14:55:41,519 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-02 14:55:41,520 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-03-02 14:55:41,523 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41195,1709391340156}] 2024-03-02 14:55:41,611 INFO [RS:0;jenkins-hbase4:36719] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36719%2C1709391340112, suffix=, logDir=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/WALs/jenkins-hbase4.apache.org,36719,1709391340112, archiveDir=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/oldWALs, maxLogs=32 2024-03-02 14:55:41,611 INFO [RS:1;jenkins-hbase4:41195] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41195%2C1709391340156, suffix=, logDir=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/WALs/jenkins-hbase4.apache.org,41195,1709391340156, archiveDir=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/oldWALs, maxLogs=32 2024-03-02 14:55:41,677 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38291,DS-a2cf3635-889a-4da9-871e-5cd006a1b3fc,DISK] 2024-03-02 14:55:41,677 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40059,DS-a6c0d3ae-6663-47d4-a760-55e04a8c5a79,DISK] 2024-03-02 14:55:41,677 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40059,DS-a6c0d3ae-6663-47d4-a760-55e04a8c5a79,DISK] 2024-03-02 14:55:41,678 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38291,DS-a2cf3635-889a-4da9-871e-5cd006a1b3fc,DISK] 2024-03-02 14:55:41,685 INFO [RS:0;jenkins-hbase4:36719] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/WALs/jenkins-hbase4.apache.org,36719,1709391340112/jenkins-hbase4.apache.org%2C36719%2C1709391340112.1709391341614 2024-03-02 14:55:41,685 INFO [RS:1;jenkins-hbase4:41195] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/WALs/jenkins-hbase4.apache.org,41195,1709391340156/jenkins-hbase4.apache.org%2C41195%2C1709391340156.1709391341614 2024-03-02 14:55:41,685 DEBUG [RS:0;jenkins-hbase4:36719] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38291,DS-a2cf3635-889a-4da9-871e-5cd006a1b3fc,DISK], DatanodeInfoWithStorage[127.0.0.1:40059,DS-a6c0d3ae-6663-47d4-a760-55e04a8c5a79,DISK]] 2024-03-02 14:55:41,687 DEBUG [RS:1;jenkins-hbase4:41195] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40059,DS-a6c0d3ae-6663-47d4-a760-55e04a8c5a79,DISK], DatanodeInfoWithStorage[127.0.0.1:38291,DS-a2cf3635-889a-4da9-871e-5cd006a1b3fc,DISK]] 2024-03-02 14:55:41,711 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:55:41,713 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-03-02 14:55:41,716 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53642, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-03-02 14:55:41,727 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2024-03-02 14:55:41,727 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-03-02 14:55:41,731 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41195%2C1709391340156.meta, suffix=.meta, logDir=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/WALs/jenkins-hbase4.apache.org,41195,1709391340156, archiveDir=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/oldWALs, maxLogs=32 2024-03-02 14:55:41,748 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38291,DS-a2cf3635-889a-4da9-871e-5cd006a1b3fc,DISK] 2024-03-02 14:55:41,749 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40059,DS-a6c0d3ae-6663-47d4-a760-55e04a8c5a79,DISK] 2024-03-02 14:55:41,754 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/WALs/jenkins-hbase4.apache.org,41195,1709391340156/jenkins-hbase4.apache.org%2C41195%2C1709391340156.meta.1709391341732.meta 2024-03-02 14:55:41,754 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38291,DS-a2cf3635-889a-4da9-871e-5cd006a1b3fc,DISK], DatanodeInfoWithStorage[127.0.0.1:40059,DS-a6c0d3ae-6663-47d4-a760-55e04a8c5a79,DISK]] 2024-03-02 14:55:41,755 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2024-03-02 14:55:41,757 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2024-03-02 14:55:41,781 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2024-03-02 14:55:41,785 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2024-03-02 14:55:41,790 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2024-03-02 14:55:41,790 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-02 14:55:41,790 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2024-03-02 14:55:41,790 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2024-03-02 14:55:41,793 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-03-02 14:55:41,795 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/meta/1588230740/info 2024-03-02 14:55:41,795 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/meta/1588230740/info 2024-03-02 14:55:41,796 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-03-02 14:55:41,797 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-02 14:55:41,797 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-03-02 14:55:41,799 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/meta/1588230740/rep_barrier 2024-03-02 14:55:41,799 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/meta/1588230740/rep_barrier 2024-03-02 14:55:41,800 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-03-02 14:55:41,801 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-02 14:55:41,801 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-03-02 14:55:41,803 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/meta/1588230740/table 2024-03-02 14:55:41,803 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/meta/1588230740/table 2024-03-02 14:55:41,803 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-03-02 14:55:41,804 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-02 14:55:41,806 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/meta/1588230740 2024-03-02 14:55:41,809 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/meta/1588230740 2024-03-02 14:55:41,814 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-03-02 14:55:41,817 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2024-03-02 14:55:41,819 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69960135, jitterRate=0.0424872487783432}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-03-02 14:55:41,819 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2024-03-02 14:55:41,829 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1709391341702 2024-03-02 14:55:41,846 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:meta,,1.1588230740 2024-03-02 14:55:41,847 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2024-03-02 14:55:41,847 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41195,1709391340156, state=OPEN 2024-03-02 14:55:41,850 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2024-03-02 14:55:41,851 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-03-02 14:55:41,855 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=3, resume processing ppid=2 2024-03-02 14:55:41,855 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41195,1709391340156 in 328 msec 2024-03-02 14:55:41,860 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=2, resume processing ppid=1 2024-03-02 14:55:41,860 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 526 msec 2024-03-02 14:55:41,866 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 746 msec 2024-03-02 14:55:41,866 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(954): Wait for region servers to report in: status=null, state=RUNNING, startTime=1709391341866, completionTime=-1 2024-03-02 14:55:41,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2024-03-02 14:55:41,867 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2024-03-02 14:55:41,934 DEBUG [hconnection-0x217cca0d-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-02 14:55:41,936 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53654, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-03-02 14:55:41,951 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=2 2024-03-02 14:55:41,951 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1709391401951 2024-03-02 14:55:41,951 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1709391461951 2024-03-02 14:55:41,952 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 84 msec 2024-03-02 14:55:41,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39587,1709391338894-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:41,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39587,1709391338894-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:41,973 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39587,1709391338894-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:41,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39587, period=300000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:41,975 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:41,981 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2024-03-02 14:55:41,990 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2024-03-02 14:55:41,991 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-03-02 14:55:42,000 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2024-03-02 14:55:42,003 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2024-03-02 14:55:42,006 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-02 14:55:42,027 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/hbase/namespace/c61265fbb35c30a3859441251ce33c62 2024-03-02 14:55:42,030 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/hbase/namespace/c61265fbb35c30a3859441251ce33c62 empty. 2024-03-02 14:55:42,031 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/hbase/namespace/c61265fbb35c30a3859441251ce33c62 2024-03-02 14:55:42,031 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2024-03-02 14:55:42,058 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2024-03-02 14:55:42,060 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => c61265fbb35c30a3859441251ce33c62, NAME => 'hbase:namespace,,1709391341990.c61265fbb35c30a3859441251ce33c62.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp 2024-03-02 14:55:42,078 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1709391341990.c61265fbb35c30a3859441251ce33c62.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-02 14:55:42,078 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing c61265fbb35c30a3859441251ce33c62, disabling compactions & flushes 2024-03-02 14:55:42,078 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1709391341990.c61265fbb35c30a3859441251ce33c62. 2024-03-02 14:55:42,078 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1709391341990.c61265fbb35c30a3859441251ce33c62. 2024-03-02 14:55:42,078 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1709391341990.c61265fbb35c30a3859441251ce33c62. after waiting 0 ms 2024-03-02 14:55:42,078 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1709391341990.c61265fbb35c30a3859441251ce33c62. 2024-03-02 14:55:42,079 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1709391341990.c61265fbb35c30a3859441251ce33c62. 2024-03-02 14:55:42,079 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for c61265fbb35c30a3859441251ce33c62: 2024-03-02 14:55:42,083 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2024-03-02 14:55:42,099 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1709391341990.c61265fbb35c30a3859441251ce33c62.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1709391342086"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709391342086"}]},"ts":"1709391342086"} 2024-03-02 14:55:42,128 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-02 14:55:42,130 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-02 14:55:42,135 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709391342130"}]},"ts":"1709391342130"} 2024-03-02 14:55:42,139 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2024-03-02 14:55:42,144 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-02 14:55:42,145 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-02 14:55:42,145 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-02 14:55:42,145 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-02 14:55:42,148 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c61265fbb35c30a3859441251ce33c62, ASSIGN}] 2024-03-02 14:55:42,150 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=c61265fbb35c30a3859441251ce33c62, ASSIGN 2024-03-02 14:55:42,152 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=c61265fbb35c30a3859441251ce33c62, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41195,1709391340156; forceNewPlan=false, retain=false 2024-03-02 14:55:42,304 INFO [jenkins-hbase4:39587] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-02 14:55:42,305 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c61265fbb35c30a3859441251ce33c62, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:55:42,306 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1709391341990.c61265fbb35c30a3859441251ce33c62.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1709391342305"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709391342305"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709391342305"}]},"ts":"1709391342305"} 2024-03-02 14:55:42,310 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure c61265fbb35c30a3859441251ce33c62, server=jenkins-hbase4.apache.org,41195,1709391340156}] 2024-03-02 14:55:42,464 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:55:42,470 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1709391341990.c61265fbb35c30a3859441251ce33c62. 2024-03-02 14:55:42,472 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c61265fbb35c30a3859441251ce33c62, NAME => 'hbase:namespace,,1709391341990.c61265fbb35c30a3859441251ce33c62.', STARTKEY => '', ENDKEY => ''} 2024-03-02 14:55:42,472 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace c61265fbb35c30a3859441251ce33c62 2024-03-02 14:55:42,473 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1709391341990.c61265fbb35c30a3859441251ce33c62.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-02 14:55:42,473 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c61265fbb35c30a3859441251ce33c62 2024-03-02 14:55:42,473 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c61265fbb35c30a3859441251ce33c62 2024-03-02 14:55:42,475 INFO [StoreOpener-c61265fbb35c30a3859441251ce33c62-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region c61265fbb35c30a3859441251ce33c62 2024-03-02 14:55:42,477 DEBUG [StoreOpener-c61265fbb35c30a3859441251ce33c62-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/namespace/c61265fbb35c30a3859441251ce33c62/info 2024-03-02 14:55:42,477 DEBUG [StoreOpener-c61265fbb35c30a3859441251ce33c62-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/namespace/c61265fbb35c30a3859441251ce33c62/info 2024-03-02 14:55:42,478 INFO [StoreOpener-c61265fbb35c30a3859441251ce33c62-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c61265fbb35c30a3859441251ce33c62 columnFamilyName info 2024-03-02 14:55:42,479 INFO [StoreOpener-c61265fbb35c30a3859441251ce33c62-1] regionserver.HStore(310): Store=c61265fbb35c30a3859441251ce33c62/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-02 14:55:42,480 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/namespace/c61265fbb35c30a3859441251ce33c62 2024-03-02 14:55:42,481 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/namespace/c61265fbb35c30a3859441251ce33c62 2024-03-02 14:55:42,485 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c61265fbb35c30a3859441251ce33c62 2024-03-02 14:55:42,489 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/namespace/c61265fbb35c30a3859441251ce33c62/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-02 14:55:42,490 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c61265fbb35c30a3859441251ce33c62; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75069250, jitterRate=0.11861899495124817}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-02 14:55:42,490 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c61265fbb35c30a3859441251ce33c62: 2024-03-02 14:55:42,492 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:namespace,,1709391341990.c61265fbb35c30a3859441251ce33c62., pid=6, masterSystemTime=1709391342464 2024-03-02 14:55:42,495 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:namespace,,1709391341990.c61265fbb35c30a3859441251ce33c62. 2024-03-02 14:55:42,495 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1709391341990.c61265fbb35c30a3859441251ce33c62. 2024-03-02 14:55:42,497 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=c61265fbb35c30a3859441251ce33c62, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:55:42,497 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1709391341990.c61265fbb35c30a3859441251ce33c62.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1709391342496"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1709391342496"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1709391342496"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1709391342496"}]},"ts":"1709391342496"} 2024-03-02 14:55:42,505 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=6, resume processing ppid=5 2024-03-02 14:55:42,505 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure c61265fbb35c30a3859441251ce33c62, server=jenkins-hbase4.apache.org,41195,1709391340156 in 191 msec 2024-03-02 14:55:42,509 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=5, resume processing ppid=4 2024-03-02 14:55:42,510 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=c61265fbb35c30a3859441251ce33c62, ASSIGN in 357 msec 2024-03-02 14:55:42,511 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-02 14:55:42,511 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709391342511"}]},"ts":"1709391342511"} 2024-03-02 14:55:42,514 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2024-03-02 14:55:42,518 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2024-03-02 14:55:42,521 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 526 msec 2024-03-02 14:55:42,603 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2024-03-02 14:55:42,605 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2024-03-02 14:55:42,605 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-02 14:55:42,641 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2024-03-02 14:55:42,659 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-03-02 14:55:42,665 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 32 msec 2024-03-02 14:55:42,674 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2024-03-02 14:55:42,684 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-03-02 14:55:42,690 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 15 msec 2024-03-02 14:55:42,700 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2024-03-02 14:55:42,702 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2024-03-02 14:55:42,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1084): Master has completed initialization 2.490sec 2024-03-02 14:55:42,706 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(103): Quota table not found. Creating... 2024-03-02 14:55:42,707 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-02 14:55:42,708 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:quota 2024-03-02 14:55:42,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(107): Initializing quota support 2024-03-02 14:55:42,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(59): Namespace State Manager started. 2024-03-02 14:55:42,711 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_PRE_OPERATION 2024-03-02 14:55:42,713 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-02 14:55:42,716 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/hbase/quota/4c7f546d8e2dbb235856f58354193507 2024-03-02 14:55:42,717 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/hbase/quota/4c7f546d8e2dbb235856f58354193507 empty. 2024-03-02 14:55:42,720 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/hbase/quota/4c7f546d8e2dbb235856f58354193507 2024-03-02 14:55:42,720 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:quota regions 2024-03-02 14:55:42,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(222): Finished updating state of 2 namespaces. 2024-03-02 14:55:42,721 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceAuditor(50): NamespaceAuditor started. 2024-03-02 14:55:42,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:42,723 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:42,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2024-03-02 14:55:42,725 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2024-03-02 14:55:42,727 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39587,1709391338894-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2024-03-02 14:55:42,727 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39587,1709391338894-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2024-03-02 14:55:42,742 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1176): Balancer post startup initialization complete, took 0 seconds 2024-03-02 14:55:42,742 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39587,1709391338894-OldWALsDirSizeChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-02 14:55:42,743 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/hbase/quota/.tabledesc/.tableinfo.0000000001 2024-03-02 14:55:42,745 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4c7f546d8e2dbb235856f58354193507, NAME => 'hbase:quota,,1709391342707.4c7f546d8e2dbb235856f58354193507.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp 2024-03-02 14:55:42,765 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(866): Instantiated hbase:quota,,1709391342707.4c7f546d8e2dbb235856f58354193507.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-02 14:55:42,765 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1604): Closing 4c7f546d8e2dbb235856f58354193507, disabling compactions & flushes 2024-03-02 14:55:42,765 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1626): Closing region hbase:quota,,1709391342707.4c7f546d8e2dbb235856f58354193507. 2024-03-02 14:55:42,765 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1709391342707.4c7f546d8e2dbb235856f58354193507. 2024-03-02 14:55:42,765 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1709391342707.4c7f546d8e2dbb235856f58354193507. after waiting 0 ms 2024-03-02 14:55:42,765 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1709391342707.4c7f546d8e2dbb235856f58354193507. 2024-03-02 14:55:42,765 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1838): Closed hbase:quota,,1709391342707.4c7f546d8e2dbb235856f58354193507. 2024-03-02 14:55:42,765 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1558): Region close journal for 4c7f546d8e2dbb235856f58354193507: 2024-03-02 14:55:42,769 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ADD_TO_META 2024-03-02 14:55:42,771 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:quota,,1709391342707.4c7f546d8e2dbb235856f58354193507.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1709391342771"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709391342771"}]},"ts":"1709391342771"} 2024-03-02 14:55:42,774 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-02 14:55:42,775 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-02 14:55:42,776 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709391342775"}]},"ts":"1709391342775"} 2024-03-02 14:55:42,778 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLING in hbase:meta 2024-03-02 14:55:42,783 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-02 14:55:42,784 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-02 14:55:42,784 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-02 14:55:42,784 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-02 14:55:42,785 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=4c7f546d8e2dbb235856f58354193507, ASSIGN}] 2024-03-02 14:55:42,786 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=4c7f546d8e2dbb235856f58354193507, ASSIGN 2024-03-02 14:55:42,788 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:quota, region=4c7f546d8e2dbb235856f58354193507, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41195,1709391340156; forceNewPlan=false, retain=false 2024-03-02 14:55:42,790 DEBUG [Listener at localhost/45685] zookeeper.ReadOnlyZKClient(139): Connect 0x11e514a4 to 127.0.0.1:58480 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-03-02 14:55:42,794 DEBUG [Listener at localhost/45685] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28f76208, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-03-02 14:55:42,808 DEBUG [hconnection-0x68db50b0-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-02 14:55:42,820 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53660, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-03-02 14:55:42,831 INFO [Listener at localhost/45685] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39587,1709391338894 2024-03-02 14:55:42,832 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:55:42,835 DEBUG [Listener at localhost/45685] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-03-02 14:55:42,937 DEBUG [Listener at localhost/45685] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-03-02 14:55:42,938 INFO [jenkins-hbase4:39587] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-02 14:55:42,939 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=4c7f546d8e2dbb235856f58354193507, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:55:42,939 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:quota,,1709391342707.4c7f546d8e2dbb235856f58354193507.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1709391342939"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709391342939"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709391342939"}]},"ts":"1709391342939"} 2024-03-02 14:55:42,942 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 4c7f546d8e2dbb235856f58354193507, server=jenkins-hbase4.apache.org,41195,1709391340156}] 2024-03-02 14:55:43,039 DEBUG [Listener at localhost/45685] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-03-02 14:55:43,095 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:55:43,101 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:quota,,1709391342707.4c7f546d8e2dbb235856f58354193507. 2024-03-02 14:55:43,101 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4c7f546d8e2dbb235856f58354193507, NAME => 'hbase:quota,,1709391342707.4c7f546d8e2dbb235856f58354193507.', STARTKEY => '', ENDKEY => ''} 2024-03-02 14:55:43,101 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table quota 4c7f546d8e2dbb235856f58354193507 2024-03-02 14:55:43,102 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:quota,,1709391342707.4c7f546d8e2dbb235856f58354193507.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-02 14:55:43,102 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4c7f546d8e2dbb235856f58354193507 2024-03-02 14:55:43,102 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4c7f546d8e2dbb235856f58354193507 2024-03-02 14:55:43,104 INFO [StoreOpener-4c7f546d8e2dbb235856f58354193507-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family q of region 4c7f546d8e2dbb235856f58354193507 2024-03-02 14:55:43,106 DEBUG [StoreOpener-4c7f546d8e2dbb235856f58354193507-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/quota/4c7f546d8e2dbb235856f58354193507/q 2024-03-02 14:55:43,106 DEBUG [StoreOpener-4c7f546d8e2dbb235856f58354193507-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/quota/4c7f546d8e2dbb235856f58354193507/q 2024-03-02 14:55:43,107 INFO [StoreOpener-4c7f546d8e2dbb235856f58354193507-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4c7f546d8e2dbb235856f58354193507 columnFamilyName q 2024-03-02 14:55:43,107 INFO [StoreOpener-4c7f546d8e2dbb235856f58354193507-1] regionserver.HStore(310): Store=4c7f546d8e2dbb235856f58354193507/q, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-02 14:55:43,108 INFO [StoreOpener-4c7f546d8e2dbb235856f58354193507-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family u of region 4c7f546d8e2dbb235856f58354193507 2024-03-02 14:55:43,110 DEBUG [StoreOpener-4c7f546d8e2dbb235856f58354193507-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/quota/4c7f546d8e2dbb235856f58354193507/u 2024-03-02 14:55:43,110 DEBUG [StoreOpener-4c7f546d8e2dbb235856f58354193507-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/quota/4c7f546d8e2dbb235856f58354193507/u 2024-03-02 14:55:43,110 INFO [StoreOpener-4c7f546d8e2dbb235856f58354193507-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4c7f546d8e2dbb235856f58354193507 columnFamilyName u 2024-03-02 14:55:43,111 INFO [StoreOpener-4c7f546d8e2dbb235856f58354193507-1] regionserver.HStore(310): Store=4c7f546d8e2dbb235856f58354193507/u, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-02 14:55:43,113 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/quota/4c7f546d8e2dbb235856f58354193507 2024-03-02 14:55:43,114 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/quota/4c7f546d8e2dbb235856f58354193507 2024-03-02 14:55:43,118 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:quota descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2024-03-02 14:55:43,120 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4c7f546d8e2dbb235856f58354193507 2024-03-02 14:55:43,123 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/quota/4c7f546d8e2dbb235856f58354193507/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-02 14:55:43,124 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4c7f546d8e2dbb235856f58354193507; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63417180, jitterRate=-0.05501037836074829}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2024-03-02 14:55:43,124 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4c7f546d8e2dbb235856f58354193507: 2024-03-02 14:55:43,126 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:quota,,1709391342707.4c7f546d8e2dbb235856f58354193507., pid=11, masterSystemTime=1709391343095 2024-03-02 14:55:43,128 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:quota,,1709391342707.4c7f546d8e2dbb235856f58354193507. 2024-03-02 14:55:43,128 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:quota,,1709391342707.4c7f546d8e2dbb235856f58354193507. 2024-03-02 14:55:43,129 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=4c7f546d8e2dbb235856f58354193507, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:55:43,130 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:quota,,1709391342707.4c7f546d8e2dbb235856f58354193507.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1709391343129"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1709391343129"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1709391343129"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1709391343129"}]},"ts":"1709391343129"} 2024-03-02 14:55:43,136 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=11, resume processing ppid=10 2024-03-02 14:55:43,136 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 4c7f546d8e2dbb235856f58354193507, server=jenkins-hbase4.apache.org,41195,1709391340156 in 190 msec 2024-03-02 14:55:43,139 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=10, resume processing ppid=9 2024-03-02 14:55:43,139 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:quota, region=4c7f546d8e2dbb235856f58354193507, ASSIGN in 351 msec 2024-03-02 14:55:43,141 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-02 14:55:43,141 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709391343141"}]},"ts":"1709391343141"} 2024-03-02 14:55:43,141 DEBUG [Listener at localhost/45685] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-03-02 14:55:43,143 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLED in hbase:meta 2024-03-02 14:55:43,147 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_POST_OPERATION 2024-03-02 14:55:43,150 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:quota in 440 msec 2024-03-02 14:55:43,258 DEBUG [Listener at localhost/45685] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-03-02 14:55:43,262 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46984, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2024-03-02 14:55:43,289 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39587] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-02 14:55:43,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39587] procedure2.ProcedureExecutor(1075): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin0 2024-03-02 14:55:43,294 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_PRE_OPERATION 2024-03-02 14:55:43,296 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-02 14:55:43,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39587] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin0" procId is: 12 2024-03-02 14:55:43,298 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/default/TestQuotaAdmin0/ede0d130fe800882e0d404c992cd501e 2024-03-02 14:55:43,299 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/default/TestQuotaAdmin0/ede0d130fe800882e0d404c992cd501e empty. 2024-03-02 14:55:43,300 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/default/TestQuotaAdmin0/ede0d130fe800882e0d404c992cd501e 2024-03-02 14:55:43,300 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-03-02 14:55:43,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-03-02 14:55:43,321 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/default/TestQuotaAdmin0/.tabledesc/.tableinfo.0000000001 2024-03-02 14:55:43,323 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(7675): creating {ENCODED => ede0d130fe800882e0d404c992cd501e, NAME => 'TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp 2024-03-02 14:55:43,339 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-02 14:55:43,339 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1604): Closing ede0d130fe800882e0d404c992cd501e, disabling compactions & flushes 2024-03-02 14:55:43,339 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e. 2024-03-02 14:55:43,339 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e. 2024-03-02 14:55:43,339 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e. after waiting 0 ms 2024-03-02 14:55:43,339 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e. 2024-03-02 14:55:43,339 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e. 2024-03-02 14:55:43,339 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1558): Region close journal for ede0d130fe800882e0d404c992cd501e: 2024-03-02 14:55:43,343 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ADD_TO_META 2024-03-02 14:55:43,345 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709391343344"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709391343344"}]},"ts":"1709391343344"} 2024-03-02 14:55:43,348 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-02 14:55:43,349 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-02 14:55:43,350 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709391343349"}]},"ts":"1709391343349"} 2024-03-02 14:55:43,352 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLING in hbase:meta 2024-03-02 14:55:43,356 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-02 14:55:43,357 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-02 14:55:43,357 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-02 14:55:43,357 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-02 14:55:43,358 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=ede0d130fe800882e0d404c992cd501e, ASSIGN}] 2024-03-02 14:55:43,359 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=ede0d130fe800882e0d404c992cd501e, ASSIGN 2024-03-02 14:55:43,360 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin0, region=ede0d130fe800882e0d404c992cd501e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41195,1709391340156; forceNewPlan=false, retain=false 2024-03-02 14:55:43,510 INFO [jenkins-hbase4:39587] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-02 14:55:43,511 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=ede0d130fe800882e0d404c992cd501e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:55:43,512 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709391343511"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709391343511"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709391343511"}]},"ts":"1709391343511"} 2024-03-02 14:55:43,514 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; OpenRegionProcedure ede0d130fe800882e0d404c992cd501e, server=jenkins-hbase4.apache.org,41195,1709391340156}] 2024-03-02 14:55:43,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-03-02 14:55:43,667 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:55:43,674 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e. 2024-03-02 14:55:43,674 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ede0d130fe800882e0d404c992cd501e, NAME => 'TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e.', STARTKEY => '', ENDKEY => ''} 2024-03-02 14:55:43,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin0 ede0d130fe800882e0d404c992cd501e 2024-03-02 14:55:43,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-02 14:55:43,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ede0d130fe800882e0d404c992cd501e 2024-03-02 14:55:43,675 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ede0d130fe800882e0d404c992cd501e 2024-03-02 14:55:43,677 INFO [StoreOpener-ede0d130fe800882e0d404c992cd501e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ede0d130fe800882e0d404c992cd501e 2024-03-02 14:55:43,679 DEBUG [StoreOpener-ede0d130fe800882e0d404c992cd501e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/default/TestQuotaAdmin0/ede0d130fe800882e0d404c992cd501e/cf 2024-03-02 14:55:43,679 DEBUG [StoreOpener-ede0d130fe800882e0d404c992cd501e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/default/TestQuotaAdmin0/ede0d130fe800882e0d404c992cd501e/cf 2024-03-02 14:55:43,679 INFO [StoreOpener-ede0d130fe800882e0d404c992cd501e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ede0d130fe800882e0d404c992cd501e columnFamilyName cf 2024-03-02 14:55:43,680 INFO [StoreOpener-ede0d130fe800882e0d404c992cd501e-1] regionserver.HStore(310): Store=ede0d130fe800882e0d404c992cd501e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-02 14:55:43,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/default/TestQuotaAdmin0/ede0d130fe800882e0d404c992cd501e 2024-03-02 14:55:43,683 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/default/TestQuotaAdmin0/ede0d130fe800882e0d404c992cd501e 2024-03-02 14:55:43,688 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ede0d130fe800882e0d404c992cd501e 2024-03-02 14:55:43,691 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/default/TestQuotaAdmin0/ede0d130fe800882e0d404c992cd501e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-02 14:55:43,692 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ede0d130fe800882e0d404c992cd501e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71999176, jitterRate=0.07287132740020752}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-02 14:55:43,692 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ede0d130fe800882e0d404c992cd501e: 2024-03-02 14:55:43,694 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e., pid=14, masterSystemTime=1709391343667 2024-03-02 14:55:43,696 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e. 2024-03-02 14:55:43,696 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e. 2024-03-02 14:55:43,697 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=ede0d130fe800882e0d404c992cd501e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:55:43,697 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709391343697"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1709391343697"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1709391343697"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1709391343697"}]},"ts":"1709391343697"} 2024-03-02 14:55:43,703 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=14, resume processing ppid=13 2024-03-02 14:55:43,703 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=14, ppid=13, state=SUCCESS; OpenRegionProcedure ede0d130fe800882e0d404c992cd501e, server=jenkins-hbase4.apache.org,41195,1709391340156 in 186 msec 2024-03-02 14:55:43,706 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=13, resume processing ppid=12 2024-03-02 14:55:43,707 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=ede0d130fe800882e0d404c992cd501e, ASSIGN in 346 msec 2024-03-02 14:55:43,708 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-02 14:55:43,708 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709391343708"}]},"ts":"1709391343708"} 2024-03-02 14:55:43,710 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLED in hbase:meta 2024-03-02 14:55:43,713 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_POST_OPERATION 2024-03-02 14:55:43,715 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=12, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin0 in 423 msec 2024-03-02 14:55:44,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-03-02 14:55:44,062 INFO [Listener at localhost/45685] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin0, procId: 12 completed 2024-03-02 14:55:44,062 DEBUG [Listener at localhost/45685] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin0 get assigned. Timeout = 60000ms 2024-03-02 14:55:44,063 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:55:44,068 INFO [Listener at localhost/45685] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin0 assigned to meta. Checking AM states. 2024-03-02 14:55:44,068 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:55:44,069 INFO [Listener at localhost/45685] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin0 assigned. 2024-03-02 14:55:44,069 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:55:44,083 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-03-02 14:55:44,085 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46988, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=MasterService 2024-03-02 14:55:44,086 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-02 14:55:44,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] procedure2.ProcedureExecutor(1075): Stored pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin1 2024-03-02 14:55:44,090 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_PRE_OPERATION 2024-03-02 14:55:44,091 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin1" procId is: 15 2024-03-02 14:55:44,092 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-02 14:55:44,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-03-02 14:55:44,094 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/default/TestQuotaAdmin1/01516433e448108963f7b2b4411d92d3 2024-03-02 14:55:44,095 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/default/TestQuotaAdmin1/01516433e448108963f7b2b4411d92d3 empty. 2024-03-02 14:55:44,096 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/default/TestQuotaAdmin1/01516433e448108963f7b2b4411d92d3 2024-03-02 14:55:44,096 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-03-02 14:55:44,121 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/default/TestQuotaAdmin1/.tabledesc/.tableinfo.0000000001 2024-03-02 14:55:44,123 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 01516433e448108963f7b2b4411d92d3, NAME => 'TestQuotaAdmin1,,1709391344086.01516433e448108963f7b2b4411d92d3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp 2024-03-02 14:55:44,138 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1709391344086.01516433e448108963f7b2b4411d92d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-02 14:55:44,139 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1604): Closing 01516433e448108963f7b2b4411d92d3, disabling compactions & flushes 2024-03-02 14:55:44,139 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1709391344086.01516433e448108963f7b2b4411d92d3. 2024-03-02 14:55:44,139 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1709391344086.01516433e448108963f7b2b4411d92d3. 2024-03-02 14:55:44,139 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1709391344086.01516433e448108963f7b2b4411d92d3. after waiting 0 ms 2024-03-02 14:55:44,139 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1709391344086.01516433e448108963f7b2b4411d92d3. 2024-03-02 14:55:44,139 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1709391344086.01516433e448108963f7b2b4411d92d3. 2024-03-02 14:55:44,139 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1558): Region close journal for 01516433e448108963f7b2b4411d92d3: 2024-03-02 14:55:44,143 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ADD_TO_META 2024-03-02 14:55:44,145 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1709391344086.01516433e448108963f7b2b4411d92d3.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709391344144"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709391344144"}]},"ts":"1709391344144"} 2024-03-02 14:55:44,148 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-02 14:55:44,149 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-02 14:55:44,149 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709391344149"}]},"ts":"1709391344149"} 2024-03-02 14:55:44,151 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLING in hbase:meta 2024-03-02 14:55:44,156 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-02 14:55:44,157 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-02 14:55:44,157 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-02 14:55:44,157 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-02 14:55:44,157 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=01516433e448108963f7b2b4411d92d3, ASSIGN}] 2024-03-02 14:55:44,158 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=01516433e448108963f7b2b4411d92d3, ASSIGN 2024-03-02 14:55:44,160 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin1, region=01516433e448108963f7b2b4411d92d3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36719,1709391340112; forceNewPlan=false, retain=false 2024-03-02 14:55:44,310 INFO [jenkins-hbase4:39587] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-02 14:55:44,311 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=01516433e448108963f7b2b4411d92d3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36719,1709391340112 2024-03-02 14:55:44,311 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1709391344086.01516433e448108963f7b2b4411d92d3.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709391344311"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709391344311"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709391344311"}]},"ts":"1709391344311"} 2024-03-02 14:55:44,314 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure 01516433e448108963f7b2b4411d92d3, server=jenkins-hbase4.apache.org,36719,1709391340112}] 2024-03-02 14:55:44,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-03-02 14:55:44,467 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,36719,1709391340112 2024-03-02 14:55:44,468 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-03-02 14:55:44,471 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52176, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-03-02 14:55:44,476 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin1,,1709391344086.01516433e448108963f7b2b4411d92d3. 2024-03-02 14:55:44,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 01516433e448108963f7b2b4411d92d3, NAME => 'TestQuotaAdmin1,,1709391344086.01516433e448108963f7b2b4411d92d3.', STARTKEY => '', ENDKEY => ''} 2024-03-02 14:55:44,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin1 01516433e448108963f7b2b4411d92d3 2024-03-02 14:55:44,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1709391344086.01516433e448108963f7b2b4411d92d3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-02 14:55:44,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 01516433e448108963f7b2b4411d92d3 2024-03-02 14:55:44,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 01516433e448108963f7b2b4411d92d3 2024-03-02 14:55:44,479 INFO [StoreOpener-01516433e448108963f7b2b4411d92d3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 01516433e448108963f7b2b4411d92d3 2024-03-02 14:55:44,481 DEBUG [StoreOpener-01516433e448108963f7b2b4411d92d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/default/TestQuotaAdmin1/01516433e448108963f7b2b4411d92d3/cf 2024-03-02 14:55:44,481 DEBUG [StoreOpener-01516433e448108963f7b2b4411d92d3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/default/TestQuotaAdmin1/01516433e448108963f7b2b4411d92d3/cf 2024-03-02 14:55:44,482 INFO [StoreOpener-01516433e448108963f7b2b4411d92d3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 01516433e448108963f7b2b4411d92d3 columnFamilyName cf 2024-03-02 14:55:44,483 INFO [StoreOpener-01516433e448108963f7b2b4411d92d3-1] regionserver.HStore(310): Store=01516433e448108963f7b2b4411d92d3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-02 14:55:44,484 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/default/TestQuotaAdmin1/01516433e448108963f7b2b4411d92d3 2024-03-02 14:55:44,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/default/TestQuotaAdmin1/01516433e448108963f7b2b4411d92d3 2024-03-02 14:55:44,492 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 01516433e448108963f7b2b4411d92d3 2024-03-02 14:55:44,496 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/default/TestQuotaAdmin1/01516433e448108963f7b2b4411d92d3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-02 14:55:44,497 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 01516433e448108963f7b2b4411d92d3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65017463, jitterRate=-0.031164303421974182}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-02 14:55:44,497 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 01516433e448108963f7b2b4411d92d3: 2024-03-02 14:55:44,499 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin1,,1709391344086.01516433e448108963f7b2b4411d92d3., pid=17, masterSystemTime=1709391344467 2024-03-02 14:55:44,502 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin1,,1709391344086.01516433e448108963f7b2b4411d92d3. 2024-03-02 14:55:44,502 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin1,,1709391344086.01516433e448108963f7b2b4411d92d3. 2024-03-02 14:55:44,503 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=01516433e448108963f7b2b4411d92d3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36719,1709391340112 2024-03-02 14:55:44,503 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin1,,1709391344086.01516433e448108963f7b2b4411d92d3.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709391344503"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1709391344503"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1709391344503"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1709391344503"}]},"ts":"1709391344503"} 2024-03-02 14:55:44,508 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=17, resume processing ppid=16 2024-03-02 14:55:44,508 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure 01516433e448108963f7b2b4411d92d3, server=jenkins-hbase4.apache.org,36719,1709391340112 in 192 msec 2024-03-02 14:55:44,511 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=16, resume processing ppid=15 2024-03-02 14:55:44,513 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=01516433e448108963f7b2b4411d92d3, ASSIGN in 351 msec 2024-03-02 14:55:44,513 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-02 14:55:44,514 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709391344514"}]},"ts":"1709391344514"} 2024-03-02 14:55:44,516 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLED in hbase:meta 2024-03-02 14:55:44,519 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_POST_OPERATION 2024-03-02 14:55:44,521 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=15, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin1 in 433 msec 2024-03-02 14:55:44,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-03-02 14:55:44,847 INFO [Listener at localhost/45685] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin1, procId: 15 completed 2024-03-02 14:55:44,847 DEBUG [Listener at localhost/45685] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin1 get assigned. Timeout = 60000ms 2024-03-02 14:55:44,847 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:55:44,851 INFO [Listener at localhost/45685] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin1 assigned to meta. Checking AM states. 2024-03-02 14:55:44,851 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:55:44,851 INFO [Listener at localhost/45685] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin1 assigned. 2024-03-02 14:55:44,851 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:55:44,859 DEBUG [hconnection-0x68db50b0-shared-pool-5] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-02 14:55:44,863 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52188, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-03-02 14:55:44,865 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-03-02 14:55:44,869 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46998, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService 2024-03-02 14:55:44,870 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-02 14:55:44,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] procedure2.ProcedureExecutor(1075): Stored pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin2 2024-03-02 14:55:44,874 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_PRE_OPERATION 2024-03-02 14:55:44,874 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin2" procId is: 18 2024-03-02 14:55:44,875 DEBUG [hconnection-0x2b38d688-metaLookup-shared--pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-02 14:55:44,876 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-02 14:55:44,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-03-02 14:55:44,877 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53674, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2024-03-02 14:55:44,879 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/default/TestQuotaAdmin2/b497e2afcd7eb4e1fd02ae1bbede53c2 2024-03-02 14:55:44,880 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/default/TestQuotaAdmin2/b497e2afcd7eb4e1fd02ae1bbede53c2 empty. 2024-03-02 14:55:44,881 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/default/TestQuotaAdmin2/b497e2afcd7eb4e1fd02ae1bbede53c2 2024-03-02 14:55:44,881 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-03-02 14:55:44,902 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/default/TestQuotaAdmin2/.tabledesc/.tableinfo.0000000001 2024-03-02 14:55:44,904 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(7675): creating {ENCODED => b497e2afcd7eb4e1fd02ae1bbede53c2, NAME => 'TestQuotaAdmin2,,1709391344870.b497e2afcd7eb4e1fd02ae1bbede53c2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp 2024-03-02 14:55:44,916 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1709391344870.b497e2afcd7eb4e1fd02ae1bbede53c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-02 14:55:44,917 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1604): Closing b497e2afcd7eb4e1fd02ae1bbede53c2, disabling compactions & flushes 2024-03-02 14:55:44,917 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1709391344870.b497e2afcd7eb4e1fd02ae1bbede53c2. 2024-03-02 14:55:44,917 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1709391344870.b497e2afcd7eb4e1fd02ae1bbede53c2. 2024-03-02 14:55:44,917 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1709391344870.b497e2afcd7eb4e1fd02ae1bbede53c2. after waiting 0 ms 2024-03-02 14:55:44,917 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1709391344870.b497e2afcd7eb4e1fd02ae1bbede53c2. 2024-03-02 14:55:44,917 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1709391344870.b497e2afcd7eb4e1fd02ae1bbede53c2. 2024-03-02 14:55:44,917 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1558): Region close journal for b497e2afcd7eb4e1fd02ae1bbede53c2: 2024-03-02 14:55:44,921 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ADD_TO_META 2024-03-02 14:55:44,923 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1709391344870.b497e2afcd7eb4e1fd02ae1bbede53c2.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709391344922"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709391344922"}]},"ts":"1709391344922"} 2024-03-02 14:55:44,925 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-02 14:55:44,926 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-02 14:55:44,926 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709391344926"}]},"ts":"1709391344926"} 2024-03-02 14:55:44,928 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLING in hbase:meta 2024-03-02 14:55:44,933 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-02 14:55:44,934 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-02 14:55:44,934 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-02 14:55:44,934 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-02 14:55:44,934 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=b497e2afcd7eb4e1fd02ae1bbede53c2, ASSIGN}] 2024-03-02 14:55:44,935 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=b497e2afcd7eb4e1fd02ae1bbede53c2, ASSIGN 2024-03-02 14:55:44,936 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin2, region=b497e2afcd7eb4e1fd02ae1bbede53c2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41195,1709391340156; forceNewPlan=false, retain=false 2024-03-02 14:55:45,087 INFO [jenkins-hbase4:39587] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-02 14:55:45,088 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=b497e2afcd7eb4e1fd02ae1bbede53c2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:55:45,088 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1709391344870.b497e2afcd7eb4e1fd02ae1bbede53c2.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709391345088"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709391345088"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709391345088"}]},"ts":"1709391345088"} 2024-03-02 14:55:45,090 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE; OpenRegionProcedure b497e2afcd7eb4e1fd02ae1bbede53c2, server=jenkins-hbase4.apache.org,41195,1709391340156}] 2024-03-02 14:55:45,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-03-02 14:55:45,243 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:55:45,248 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin2,,1709391344870.b497e2afcd7eb4e1fd02ae1bbede53c2. 2024-03-02 14:55:45,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b497e2afcd7eb4e1fd02ae1bbede53c2, NAME => 'TestQuotaAdmin2,,1709391344870.b497e2afcd7eb4e1fd02ae1bbede53c2.', STARTKEY => '', ENDKEY => ''} 2024-03-02 14:55:45,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin2 b497e2afcd7eb4e1fd02ae1bbede53c2 2024-03-02 14:55:45,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1709391344870.b497e2afcd7eb4e1fd02ae1bbede53c2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-02 14:55:45,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b497e2afcd7eb4e1fd02ae1bbede53c2 2024-03-02 14:55:45,249 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b497e2afcd7eb4e1fd02ae1bbede53c2 2024-03-02 14:55:45,251 INFO [StoreOpener-b497e2afcd7eb4e1fd02ae1bbede53c2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b497e2afcd7eb4e1fd02ae1bbede53c2 2024-03-02 14:55:45,254 DEBUG [StoreOpener-b497e2afcd7eb4e1fd02ae1bbede53c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/default/TestQuotaAdmin2/b497e2afcd7eb4e1fd02ae1bbede53c2/cf 2024-03-02 14:55:45,254 DEBUG [StoreOpener-b497e2afcd7eb4e1fd02ae1bbede53c2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/default/TestQuotaAdmin2/b497e2afcd7eb4e1fd02ae1bbede53c2/cf 2024-03-02 14:55:45,254 INFO [StoreOpener-b497e2afcd7eb4e1fd02ae1bbede53c2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b497e2afcd7eb4e1fd02ae1bbede53c2 columnFamilyName cf 2024-03-02 14:55:45,255 INFO [StoreOpener-b497e2afcd7eb4e1fd02ae1bbede53c2-1] regionserver.HStore(310): Store=b497e2afcd7eb4e1fd02ae1bbede53c2/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-02 14:55:45,257 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/default/TestQuotaAdmin2/b497e2afcd7eb4e1fd02ae1bbede53c2 2024-03-02 14:55:45,258 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/default/TestQuotaAdmin2/b497e2afcd7eb4e1fd02ae1bbede53c2 2024-03-02 14:55:45,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b497e2afcd7eb4e1fd02ae1bbede53c2 2024-03-02 14:55:45,265 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/default/TestQuotaAdmin2/b497e2afcd7eb4e1fd02ae1bbede53c2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-02 14:55:45,266 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b497e2afcd7eb4e1fd02ae1bbede53c2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65770138, jitterRate=-0.019948571920394897}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-02 14:55:45,266 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b497e2afcd7eb4e1fd02ae1bbede53c2: 2024-03-02 14:55:45,267 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin2,,1709391344870.b497e2afcd7eb4e1fd02ae1bbede53c2., pid=20, masterSystemTime=1709391345243 2024-03-02 14:55:45,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin2,,1709391344870.b497e2afcd7eb4e1fd02ae1bbede53c2. 2024-03-02 14:55:45,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin2,,1709391344870.b497e2afcd7eb4e1fd02ae1bbede53c2. 2024-03-02 14:55:45,270 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=b497e2afcd7eb4e1fd02ae1bbede53c2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:55:45,270 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin2,,1709391344870.b497e2afcd7eb4e1fd02ae1bbede53c2.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709391345270"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1709391345270"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1709391345270"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1709391345270"}]},"ts":"1709391345270"} 2024-03-02 14:55:45,276 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=20, resume processing ppid=19 2024-03-02 14:55:45,276 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=20, ppid=19, state=SUCCESS; OpenRegionProcedure b497e2afcd7eb4e1fd02ae1bbede53c2, server=jenkins-hbase4.apache.org,41195,1709391340156 in 183 msec 2024-03-02 14:55:45,279 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=19, resume processing ppid=18 2024-03-02 14:55:45,280 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=19, ppid=18, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=b497e2afcd7eb4e1fd02ae1bbede53c2, ASSIGN in 342 msec 2024-03-02 14:55:45,281 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-02 14:55:45,281 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709391345281"}]},"ts":"1709391345281"} 2024-03-02 14:55:45,283 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLED in hbase:meta 2024-03-02 14:55:45,286 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_POST_OPERATION 2024-03-02 14:55:45,288 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=18, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin2 in 416 msec 2024-03-02 14:55:45,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-03-02 14:55:45,631 INFO [Listener at localhost/45685] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin2, procId: 18 completed 2024-03-02 14:55:45,631 DEBUG [Listener at localhost/45685] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin2 get assigned. Timeout = 60000ms 2024-03-02 14:55:45,631 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:55:45,635 INFO [Listener at localhost/45685] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin2 assigned to meta. Checking AM states. 2024-03-02 14:55:45,635 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:55:45,635 INFO [Listener at localhost/45685] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin2 assigned. 2024-03-02 14:55:45,635 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:55:45,650 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.HMaster$15(3020): Client=jenkins//172.31.14.131 creating {NAME => 'TestNs'} 2024-03-02 14:55:45,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] procedure2.ProcedureExecutor(1075): Stored pid=21, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=TestNs 2024-03-02 14:55:45,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-03-02 14:55:45,666 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-03-02 14:55:45,672 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=21, state=SUCCESS; CreateNamespaceProcedure, namespace=TestNs in 18 msec 2024-03-02 14:55:45,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-03-02 14:55:45,914 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-02 14:55:45,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] procedure2.ProcedureExecutor(1075): Stored pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestNs:TestTable 2024-03-02 14:55:45,918 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_PRE_OPERATION 2024-03-02 14:55:45,918 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "TestNs" qualifier: "TestTable" procId is: 22 2024-03-02 14:55:45,919 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-02 14:55:45,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-03-02 14:55:45,922 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/TestNs/TestTable/0cd9546da74fc32f61f67d9a8e9ee270 2024-03-02 14:55:45,922 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/TestNs/TestTable/8962c93d3f1583d6c125e721749cb7eb 2024-03-02 14:55:45,923 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/TestNs/TestTable/0cd9546da74fc32f61f67d9a8e9ee270 empty. 2024-03-02 14:55:45,923 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/TestNs/TestTable/8962c93d3f1583d6c125e721749cb7eb empty. 2024-03-02 14:55:45,924 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/TestNs/TestTable/0cd9546da74fc32f61f67d9a8e9ee270 2024-03-02 14:55:45,924 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/TestNs/TestTable/8962c93d3f1583d6c125e721749cb7eb 2024-03-02 14:55:45,924 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-03-02 14:55:45,942 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/TestNs/TestTable/.tabledesc/.tableinfo.0000000001 2024-03-02 14:55:45,944 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0cd9546da74fc32f61f67d9a8e9ee270, NAME => 'TestNs:TestTable,,1709391345914.0cd9546da74fc32f61f67d9a8e9ee270.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp 2024-03-02 14:55:45,944 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(7675): creating {ENCODED => 8962c93d3f1583d6c125e721749cb7eb, NAME => 'TestNs:TestTable,1,1709391345914.8962c93d3f1583d6c125e721749cb7eb.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp 2024-03-02 14:55:45,963 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1709391345914.0cd9546da74fc32f61f67d9a8e9ee270.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-02 14:55:45,964 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1604): Closing 0cd9546da74fc32f61f67d9a8e9ee270, disabling compactions & flushes 2024-03-02 14:55:45,964 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1709391345914.0cd9546da74fc32f61f67d9a8e9ee270. 2024-03-02 14:55:45,964 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1709391345914.0cd9546da74fc32f61f67d9a8e9ee270. 2024-03-02 14:55:45,964 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1709391345914.0cd9546da74fc32f61f67d9a8e9ee270. after waiting 0 ms 2024-03-02 14:55:45,964 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1709391345914.0cd9546da74fc32f61f67d9a8e9ee270. 2024-03-02 14:55:45,964 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1709391345914.0cd9546da74fc32f61f67d9a8e9ee270. 2024-03-02 14:55:45,964 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1709391345914.8962c93d3f1583d6c125e721749cb7eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-02 14:55:45,965 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1604): Closing 8962c93d3f1583d6c125e721749cb7eb, disabling compactions & flushes 2024-03-02 14:55:45,965 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1709391345914.8962c93d3f1583d6c125e721749cb7eb. 2024-03-02 14:55:45,965 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1709391345914.8962c93d3f1583d6c125e721749cb7eb. 2024-03-02 14:55:45,965 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1709391345914.8962c93d3f1583d6c125e721749cb7eb. after waiting 0 ms 2024-03-02 14:55:45,965 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1709391345914.8962c93d3f1583d6c125e721749cb7eb. 2024-03-02 14:55:45,965 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1709391345914.8962c93d3f1583d6c125e721749cb7eb. 2024-03-02 14:55:45,965 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1558): Region close journal for 8962c93d3f1583d6c125e721749cb7eb: 2024-03-02 14:55:45,965 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1558): Region close journal for 0cd9546da74fc32f61f67d9a8e9ee270: 2024-03-02 14:55:45,970 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ADD_TO_META 2024-03-02 14:55:45,972 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1709391345914.8962c93d3f1583d6c125e721749cb7eb.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709391345971"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709391345971"}]},"ts":"1709391345971"} 2024-03-02 14:55:45,972 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,,1709391345914.0cd9546da74fc32f61f67d9a8e9ee270.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709391345971"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709391345971"}]},"ts":"1709391345971"} 2024-03-02 14:55:45,980 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2024-03-02 14:55:45,982 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-02 14:55:45,982 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709391345982"}]},"ts":"1709391345982"} 2024-03-02 14:55:45,984 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLING in hbase:meta 2024-03-02 14:55:45,989 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-02 14:55:45,991 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-02 14:55:45,991 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-02 14:55:45,991 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-02 14:55:45,991 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=0cd9546da74fc32f61f67d9a8e9ee270, ASSIGN}, {pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=8962c93d3f1583d6c125e721749cb7eb, ASSIGN}] 2024-03-02 14:55:45,993 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=8962c93d3f1583d6c125e721749cb7eb, ASSIGN 2024-03-02 14:55:45,993 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=0cd9546da74fc32f61f67d9a8e9ee270, ASSIGN 2024-03-02 14:55:45,994 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=8962c93d3f1583d6c125e721749cb7eb, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41195,1709391340156; forceNewPlan=false, retain=false 2024-03-02 14:55:45,994 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=0cd9546da74fc32f61f67d9a8e9ee270, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36719,1709391340112; forceNewPlan=false, retain=false 2024-03-02 14:55:46,144 INFO [jenkins-hbase4:39587] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2024-03-02 14:55:46,146 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=0cd9546da74fc32f61f67d9a8e9ee270, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36719,1709391340112 2024-03-02 14:55:46,146 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=8962c93d3f1583d6c125e721749cb7eb, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:55:46,146 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1709391345914.0cd9546da74fc32f61f67d9a8e9ee270.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709391346146"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709391346146"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709391346146"}]},"ts":"1709391346146"} 2024-03-02 14:55:46,146 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1709391345914.8962c93d3f1583d6c125e721749cb7eb.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709391346146"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709391346146"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709391346146"}]},"ts":"1709391346146"} 2024-03-02 14:55:46,149 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; OpenRegionProcedure 0cd9546da74fc32f61f67d9a8e9ee270, server=jenkins-hbase4.apache.org,36719,1709391340112}] 2024-03-02 14:55:46,150 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=26, ppid=24, state=RUNNABLE; OpenRegionProcedure 8962c93d3f1583d6c125e721749cb7eb, server=jenkins-hbase4.apache.org,41195,1709391340156}] 2024-03-02 14:55:46,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-03-02 14:55:46,301 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,36719,1709391340112 2024-03-02 14:55:46,303 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:55:46,308 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,,1709391345914.0cd9546da74fc32f61f67d9a8e9ee270. 2024-03-02 14:55:46,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0cd9546da74fc32f61f67d9a8e9ee270, NAME => 'TestNs:TestTable,,1709391345914.0cd9546da74fc32f61f67d9a8e9ee270.', STARTKEY => '', ENDKEY => '1'} 2024-03-02 14:55:46,308 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,1,1709391345914.8962c93d3f1583d6c125e721749cb7eb. 2024-03-02 14:55:46,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable 0cd9546da74fc32f61f67d9a8e9ee270 2024-03-02 14:55:46,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8962c93d3f1583d6c125e721749cb7eb, NAME => 'TestNs:TestTable,1,1709391345914.8962c93d3f1583d6c125e721749cb7eb.', STARTKEY => '1', ENDKEY => ''} 2024-03-02 14:55:46,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1709391345914.0cd9546da74fc32f61f67d9a8e9ee270.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-02 14:55:46,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0cd9546da74fc32f61f67d9a8e9ee270 2024-03-02 14:55:46,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0cd9546da74fc32f61f67d9a8e9ee270 2024-03-02 14:55:46,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable 8962c93d3f1583d6c125e721749cb7eb 2024-03-02 14:55:46,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1709391345914.8962c93d3f1583d6c125e721749cb7eb.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-02 14:55:46,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8962c93d3f1583d6c125e721749cb7eb 2024-03-02 14:55:46,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8962c93d3f1583d6c125e721749cb7eb 2024-03-02 14:55:46,311 INFO [StoreOpener-0cd9546da74fc32f61f67d9a8e9ee270-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0cd9546da74fc32f61f67d9a8e9ee270 2024-03-02 14:55:46,311 INFO [StoreOpener-8962c93d3f1583d6c125e721749cb7eb-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8962c93d3f1583d6c125e721749cb7eb 2024-03-02 14:55:46,313 DEBUG [StoreOpener-8962c93d3f1583d6c125e721749cb7eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/TestNs/TestTable/8962c93d3f1583d6c125e721749cb7eb/cf 2024-03-02 14:55:46,313 DEBUG [StoreOpener-8962c93d3f1583d6c125e721749cb7eb-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/TestNs/TestTable/8962c93d3f1583d6c125e721749cb7eb/cf 2024-03-02 14:55:46,313 DEBUG [StoreOpener-0cd9546da74fc32f61f67d9a8e9ee270-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/TestNs/TestTable/0cd9546da74fc32f61f67d9a8e9ee270/cf 2024-03-02 14:55:46,313 DEBUG [StoreOpener-0cd9546da74fc32f61f67d9a8e9ee270-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/TestNs/TestTable/0cd9546da74fc32f61f67d9a8e9ee270/cf 2024-03-02 14:55:46,314 INFO [StoreOpener-8962c93d3f1583d6c125e721749cb7eb-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8962c93d3f1583d6c125e721749cb7eb columnFamilyName cf 2024-03-02 14:55:46,314 INFO [StoreOpener-0cd9546da74fc32f61f67d9a8e9ee270-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0cd9546da74fc32f61f67d9a8e9ee270 columnFamilyName cf 2024-03-02 14:55:46,314 INFO [StoreOpener-8962c93d3f1583d6c125e721749cb7eb-1] regionserver.HStore(310): Store=8962c93d3f1583d6c125e721749cb7eb/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-02 14:55:46,316 INFO [StoreOpener-0cd9546da74fc32f61f67d9a8e9ee270-1] regionserver.HStore(310): Store=0cd9546da74fc32f61f67d9a8e9ee270/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-02 14:55:46,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/TestNs/TestTable/8962c93d3f1583d6c125e721749cb7eb 2024-03-02 14:55:46,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/TestNs/TestTable/0cd9546da74fc32f61f67d9a8e9ee270 2024-03-02 14:55:46,318 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/TestNs/TestTable/8962c93d3f1583d6c125e721749cb7eb 2024-03-02 14:55:46,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/TestNs/TestTable/0cd9546da74fc32f61f67d9a8e9ee270 2024-03-02 14:55:46,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8962c93d3f1583d6c125e721749cb7eb 2024-03-02 14:55:46,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0cd9546da74fc32f61f67d9a8e9ee270 2024-03-02 14:55:46,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/TestNs/TestTable/8962c93d3f1583d6c125e721749cb7eb/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-02 14:55:46,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/TestNs/TestTable/0cd9546da74fc32f61f67d9a8e9ee270/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-02 14:55:46,332 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8962c93d3f1583d6c125e721749cb7eb; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64695164, jitterRate=-0.03596693277359009}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-02 14:55:46,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8962c93d3f1583d6c125e721749cb7eb: 2024-03-02 14:55:46,332 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0cd9546da74fc32f61f67d9a8e9ee270; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68954425, jitterRate=0.027501001954078674}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-02 14:55:46,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0cd9546da74fc32f61f67d9a8e9ee270: 2024-03-02 14:55:46,333 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestNs:TestTable,1,1709391345914.8962c93d3f1583d6c125e721749cb7eb., pid=26, masterSystemTime=1709391346303 2024-03-02 14:55:46,333 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestNs:TestTable,,1709391345914.0cd9546da74fc32f61f67d9a8e9ee270., pid=25, masterSystemTime=1709391346301 2024-03-02 14:55:46,336 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestNs:TestTable,,1709391345914.0cd9546da74fc32f61f67d9a8e9ee270. 2024-03-02 14:55:46,336 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,,1709391345914.0cd9546da74fc32f61f67d9a8e9ee270. 2024-03-02 14:55:46,336 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=0cd9546da74fc32f61f67d9a8e9ee270, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36719,1709391340112 2024-03-02 14:55:46,337 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,,1709391345914.0cd9546da74fc32f61f67d9a8e9ee270.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709391346336"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1709391346336"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1709391346336"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1709391346336"}]},"ts":"1709391346336"} 2024-03-02 14:55:46,337 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestNs:TestTable,1,1709391345914.8962c93d3f1583d6c125e721749cb7eb. 2024-03-02 14:55:46,337 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,1,1709391345914.8962c93d3f1583d6c125e721749cb7eb. 2024-03-02 14:55:46,338 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=8962c93d3f1583d6c125e721749cb7eb, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:55:46,338 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,1,1709391345914.8962c93d3f1583d6c125e721749cb7eb.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709391346338"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1709391346338"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1709391346338"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1709391346338"}]},"ts":"1709391346338"} 2024-03-02 14:55:46,343 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=25, resume processing ppid=23 2024-03-02 14:55:46,343 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=25, ppid=23, state=SUCCESS; OpenRegionProcedure 0cd9546da74fc32f61f67d9a8e9ee270, server=jenkins-hbase4.apache.org,36719,1709391340112 in 190 msec 2024-03-02 14:55:46,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=26, resume processing ppid=24 2024-03-02 14:55:46,344 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=26, ppid=24, state=SUCCESS; OpenRegionProcedure 8962c93d3f1583d6c125e721749cb7eb, server=jenkins-hbase4.apache.org,41195,1709391340156 in 191 msec 2024-03-02 14:55:46,345 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=23, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=0cd9546da74fc32f61f67d9a8e9ee270, ASSIGN in 352 msec 2024-03-02 14:55:46,347 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=24, resume processing ppid=22 2024-03-02 14:55:46,347 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=24, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=8962c93d3f1583d6c125e721749cb7eb, ASSIGN in 353 msec 2024-03-02 14:55:46,348 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-02 14:55:46,349 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709391346349"}]},"ts":"1709391346349"} 2024-03-02 14:55:46,351 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLED in hbase:meta 2024-03-02 14:55:46,354 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_POST_OPERATION 2024-03-02 14:55:46,357 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=22, state=SUCCESS; CreateTableProcedure table=TestNs:TestTable in 440 msec 2024-03-02 14:55:46,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-03-02 14:55:46,673 INFO [Listener at localhost/45685] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: TestNs:TestTable, procId: 22 completed 2024-03-02 14:55:46,673 DEBUG [Listener at localhost/45685] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestNs:TestTable get assigned. Timeout = 60000ms 2024-03-02 14:55:46,674 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:55:46,678 INFO [Listener at localhost/45685] hbase.HBaseTestingUtility(3484): All regions for table TestNs:TestTable assigned to meta. Checking AM states. 2024-03-02 14:55:46,678 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:55:46,678 INFO [Listener at localhost/45685] hbase.HBaseTestingUtility(3504): All regions for table TestNs:TestTable assigned. 2024-03-02 14:55:46,678 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:55:46,722 INFO [Listener at localhost/45685] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=308, OpenFileDescriptor=630, MaxFileDescriptor=60000, SystemLoadAverage=183, ProcessCount=168, AvailableMemoryMB=8557 2024-03-02 14:55:47,045 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:55:47,046 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-02 14:55:47,046 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709394946794 bypass), TestNs=QuotaState(ts=1709394946794 bypass)} 2024-03-02 14:55:47,046 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709394946794 bypass), TestQuotaAdmin1=QuotaState(ts=1709394946794 bypass)} 2024-03-02 14:55:47,046 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709394946794 [ TestNs:TestTable ])} 2024-03-02 14:55:47,046 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709394946794 bypass)} 2024-03-02 14:55:47,296 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:55:47,296 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-02 14:55:47,297 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709394946794 bypass), TestNs=QuotaState(ts=1709394946794 bypass)} 2024-03-02 14:55:47,297 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709394946794 bypass), TestNs:TestTable=QuotaState(ts=1709394946794 bypass), TestQuotaAdmin2=QuotaState(ts=1709394946794 bypass)} 2024-03-02 14:55:47,297 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709394946794 [ TestNs:TestTable ])} 2024-03-02 14:55:47,297 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709394946794 bypass)} 2024-03-02 14:55:47,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:55:47,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 90 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:53660 deadline: 1709391357312, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:55:47,314 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2024-03-02 14:55:47,404 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin0' 2024-03-02 14:55:47,405 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2024-03-02 14:55:47,405 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2024-03-02 14:55:47,405 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestNs:TestTable' 2024-03-02 14:55:47,406 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin2' 2024-03-02 14:55:47,406 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:quota' 2024-03-02 14:55:47,407 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin1' 2024-03-02 14:55:47,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:55:47,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 92 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:53660 deadline: 1709391357313, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:55:48,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:55:48,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 94 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:53660 deadline: 1709391357313, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:55:48,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:55:48,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 96 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:53660 deadline: 1709391357312, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:55:49,069 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-03-02 14:55:49,070 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver Metrics about HBase MasterObservers 2024-03-02 14:55:49,070 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-03-02 14:55:49,070 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2024-03-02 14:55:50,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:55:50,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 98 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:53660 deadline: 1709391357313, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:55:52,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:55:52,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 100 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:53660 deadline: 1709391357312, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:55:52,598 ERROR [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10315: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1709391345914.8962c93d3f1583d6c125e721749cb7eb., hostname=jenkins-hbase4.apache.org,41195,1709391340156, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-02 14:55:52,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:55:52,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 101 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:53660 deadline: 1709391362601, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:55:52,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:55:52,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 103 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:53660 deadline: 1709391362600, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:55:53,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:55:53,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 105 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:53660 deadline: 1709391362600, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:55:54,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:55:54,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 107 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:53660 deadline: 1709391362601, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:55:55,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:55:55,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 109 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:53660 deadline: 1709391362601, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:55:57,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:55:57,902 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 111 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:53660 deadline: 1709391362601, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:55:57,903 ERROR [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10351: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1709391345914.8962c93d3f1583d6c125e721749cb7eb., hostname=jenkins-hbase4.apache.org,41195,1709391340156, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-02 14:55:58,162 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:55:58,162 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-02 14:55:58,162 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709398546794 bypass), TestNs=QuotaState(ts=1709398546794 bypass)} 2024-03-02 14:55:58,162 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709398546794 bypass), TestQuotaAdmin1=QuotaState(ts=1709398546794 bypass)} 2024-03-02 14:55:58,162 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709398546794 bypass)} 2024-03-02 14:55:58,162 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709398546794 bypass)} 2024-03-02 14:55:58,413 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:55:58,413 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-02 14:55:58,413 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709398546794 bypass), TestNs=QuotaState(ts=1709398546794 bypass)} 2024-03-02 14:55:58,413 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709398546794 bypass), TestNs:TestTable=QuotaState(ts=1709398546794 bypass), TestQuotaAdmin2=QuotaState(ts=1709398546794 bypass)} 2024-03-02 14:55:58,413 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709398546794 bypass)} 2024-03-02 14:55:58,413 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709398546794 bypass)} 2024-03-02 14:55:58,433 INFO [Listener at localhost/45685] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=291 (was 308), OpenFileDescriptor=599 (was 630), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=162 (was 183), ProcessCount=168 (was 168), AvailableMemoryMB=8486 (was 8557) 2024-03-02 14:55:58,446 INFO [Listener at localhost/45685] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=291, OpenFileDescriptor=599, MaxFileDescriptor=60000, SystemLoadAverage=162, ProcessCount=168, AvailableMemoryMB=8486 2024-03-02 14:55:58,709 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:55:58,709 INFO [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-03-02 14:55:58,960 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-02 14:55:58,961 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709402146894 bypass), TestNs=QuotaState(ts=1709402146894 bypass)} 2024-03-02 14:55:58,961 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709402146894 bypass), TestQuotaAdmin1=QuotaState(ts=1709402146894 bypass)} 2024-03-02 14:55:58,961 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709402146894 [ default ])} 2024-03-02 14:55:58,961 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709402146894 bypass)} 2024-03-02 14:55:59,212 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:55:59,212 INFO [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-03-02 14:55:59,462 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-02 14:55:59,463 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709402146994 bypass), TestNs=QuotaState(ts=1709402146994 bypass)} 2024-03-02 14:55:59,465 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709402146994 bypass), TestNs:TestTable=QuotaState(ts=1709402146994 bypass), TestQuotaAdmin2=QuotaState(ts=1709402146994 bypass)} 2024-03-02 14:55:59,465 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709402146994 [ default ])} 2024-03-02 14:55:59,465 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709402146994 bypass)} 2024-03-02 14:55:59,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-02 14:55:59,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 123 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:53660 deadline: 1709391369474, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-02 14:55:59,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-02 14:55:59,728 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 125 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:53660 deadline: 1709391369474, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-02 14:56:00,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-02 14:56:00,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 127 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:53660 deadline: 1709391369474, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-02 14:56:00,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-02 14:56:00,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 129 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:53660 deadline: 1709391369474, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-02 14:56:02,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-02 14:56:02,246 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 131 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:53660 deadline: 1709391369473, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-02 14:56:04,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-02 14:56:04,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 133 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:53660 deadline: 1709391369473, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-02 14:56:04,777 ERROR [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10344: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e., hostname=jenkins-hbase4.apache.org,41195,1709391340156, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:199) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor35.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-02 14:56:04,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:04,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 140 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:53660 deadline: 1709391374793, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:05,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:05,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 142 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:53660 deadline: 1709391374793, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:05,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:05,555 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 144 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:53660 deadline: 1709391374793, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:06,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:06,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 146 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:53660 deadline: 1709391374792, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:07,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:07,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 148 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:53660 deadline: 1709391374792, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:10,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:10,094 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 150 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:53660 deadline: 1709391374792, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:10,094 ERROR [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10306: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e., hostname=jenkins-hbase4.apache.org,41195,1709391340156, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:200) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor35.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-02 14:56:10,352 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:56:10,352 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-02 14:56:10,352 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709405746994 bypass), TestNs=QuotaState(ts=1709405746994 bypass)} 2024-03-02 14:56:10,352 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709405746994 bypass), TestQuotaAdmin1=QuotaState(ts=1709405746994 bypass)} 2024-03-02 14:56:10,352 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709405746994 bypass)} 2024-03-02 14:56:10,352 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709405746994 bypass)} 2024-03-02 14:56:10,602 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:56:10,603 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-02 14:56:10,603 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709405746994 bypass), TestNs=QuotaState(ts=1709405746994 bypass)} 2024-03-02 14:56:10,603 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709405746994 bypass), TestNs:TestTable=QuotaState(ts=1709405746994 bypass), TestQuotaAdmin2=QuotaState(ts=1709405746994 bypass)} 2024-03-02 14:56:10,603 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709405746994 bypass)} 2024-03-02 14:56:10,603 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709405746994 bypass)} 2024-03-02 14:56:10,617 INFO [Listener at localhost/45685] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=291 (was 291), OpenFileDescriptor=595 (was 599), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=137 (was 162), ProcessCount=168 (was 168), AvailableMemoryMB=8457 (was 8486) 2024-03-02 14:56:10,630 INFO [Listener at localhost/45685] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=291, OpenFileDescriptor=595, MaxFileDescriptor=60000, SystemLoadAverage=137, ProcessCount=168, AvailableMemoryMB=8456 2024-03-02 14:56:10,892 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:56:10,893 INFO [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-03-02 14:56:11,143 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-02 14:56:11,144 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709409347094 bypass), TestNs=QuotaState(ts=1709409347094 bypass)} 2024-03-02 14:56:11,145 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709409347094 bypass), TestQuotaAdmin1=QuotaState(ts=1709409347094 bypass)} 2024-03-02 14:56:11,145 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709409347094 global-limiter)} 2024-03-02 14:56:11,145 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709409347094 bypass)} 2024-03-02 14:56:11,395 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:56:11,396 INFO [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-03-02 14:56:11,646 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-02 14:56:11,647 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709409347194 bypass), TestNs=QuotaState(ts=1709409347194 bypass)} 2024-03-02 14:56:11,647 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709409347194 bypass), TestNs:TestTable=QuotaState(ts=1709409347194 bypass), TestQuotaAdmin2=QuotaState(ts=1709409347194 bypass)} 2024-03-02 14:56:11,647 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709409347194 global-limiter)} 2024-03-02 14:56:11,648 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709409347194 bypass)} 2024-03-02 14:56:11,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:11,663 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 163 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:53660 deadline: 1709391381663, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:11,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:11,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 165 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:53660 deadline: 1709391381663, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:12,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:12,424 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 167 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:53660 deadline: 1709391381663, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:13,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:13,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 169 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:53660 deadline: 1709391381663, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:14,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:14,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 171 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:53660 deadline: 1709391381663, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:16,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:16,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 173 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:53660 deadline: 1709391381663, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:16,968 ERROR [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10351: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e., hostname=jenkins-hbase4.apache.org,41195,1709391340156, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:178) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor35.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-02 14:56:16,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-02 14:56:16,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 177 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:53660 deadline: 1709391386975, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-02 14:56:17,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-02 14:56:17,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 179 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:53660 deadline: 1709391386974, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-02 14:56:17,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-02 14:56:17,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 181 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:53660 deadline: 1709391386974, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-02 14:56:18,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-02 14:56:18,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 183 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:53660 deadline: 1709391386974, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-02 14:56:19,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-02 14:56:19,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 185 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:53660 deadline: 1709391386974, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-02 14:56:22,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-02 14:56:22,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 187 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:53660 deadline: 1709391386975, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-02 14:56:22,275 ERROR [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=3 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10301: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-3' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e., hostname=jenkins-hbase4.apache.org,41195,1709391340156, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor35.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-02 14:56:22,531 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:56:22,532 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-02 14:56:22,532 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709412947194 bypass), TestNs=QuotaState(ts=1709412947194 bypass)} 2024-03-02 14:56:22,532 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709412947194 bypass), TestQuotaAdmin1=QuotaState(ts=1709412947194 bypass)} 2024-03-02 14:56:22,532 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709412947194 bypass)} 2024-03-02 14:56:22,532 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709412947194 bypass)} 2024-03-02 14:56:22,782 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:56:22,783 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-02 14:56:22,783 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709412947194 bypass), TestNs=QuotaState(ts=1709412947194 bypass)} 2024-03-02 14:56:22,783 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709412947194 bypass), TestNs:TestTable=QuotaState(ts=1709412947194 bypass), TestQuotaAdmin2=QuotaState(ts=1709412947194 bypass)} 2024-03-02 14:56:22,783 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709412947194 bypass)} 2024-03-02 14:56:22,783 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709412947194 bypass)} 2024-03-02 14:56:22,796 INFO [Listener at localhost/45685] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=282 (was 291), OpenFileDescriptor=593 (was 595), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=107 (was 137), ProcessCount=168 (was 168), AvailableMemoryMB=8452 (was 8456) 2024-03-02 14:56:22,810 INFO [Listener at localhost/45685] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=282, OpenFileDescriptor=593, MaxFileDescriptor=60000, SystemLoadAverage=107, ProcessCount=168, AvailableMemoryMB=8451 2024-03-02 14:56:23,068 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:56:23,069 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-02 14:56:23,070 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709416547194 bypass), TestNs=QuotaState(ts=1709416547194 bypass)} 2024-03-02 14:56:23,071 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709416547194 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin1=QuotaState(ts=1709416547194 bypass)} 2024-03-02 14:56:23,071 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-02 14:56:23,072 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709416547194 bypass)} 2024-03-02 14:56:23,322 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:56:23,323 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-02 14:56:23,323 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709416547194 bypass), TestNs=QuotaState(ts=1709416547194 bypass)} 2024-03-02 14:56:23,324 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709416547194 bypass), TestNs:TestTable=QuotaState(ts=1709416547194 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin2=QuotaState(ts=1709416547194 bypass)} 2024-03-02 14:56:23,324 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-02 14:56:23,324 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709416547194 bypass)} 2024-03-02 14:56:23,340 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:56:23,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 202 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:53660 deadline: 1709391393340, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:56:23,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:56:23,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 204 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:53660 deadline: 1709391393340, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:56:24,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:56:24,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 206 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:53660 deadline: 1709391393340, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:56:24,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:56:24,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 208 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:53660 deadline: 1709391393341, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:56:26,111 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:56:26,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 210 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:53660 deadline: 1709391393340, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:56:28,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:56:28,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 212 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:53660 deadline: 1709391393340, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:56:28,635 ERROR [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10305: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1709391345914.8962c93d3f1583d6c125e721749cb7eb., hostname=jenkins-hbase4.apache.org,41195,1709391340156, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor35.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-02 14:56:28,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:56:28,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 213 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:53660 deadline: 1709391398637, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:56:28,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:56:28,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 215 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:53660 deadline: 1709391398636, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:56:29,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:56:29,396 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 217 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:53660 deadline: 1709391398637, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:56:30,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:56:30,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 219 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:53660 deadline: 1709391398636, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:56:31,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:56:31,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 221 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:53660 deadline: 1709391398636, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:56:33,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:56:33,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 223 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:53660 deadline: 1709391398637, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-02 14:56:33,932 ERROR [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10337: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1709391345914.8962c93d3f1583d6c125e721749cb7eb., hostname=jenkins-hbase4.apache.org,41195,1709391340156, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor35.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-02 14:56:34,189 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:56:34,190 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-02 14:56:34,190 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709420147194 bypass), TestNs=QuotaState(ts=1709420147194 bypass)} 2024-03-02 14:56:34,190 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709420147194 bypass), TestQuotaAdmin1=QuotaState(ts=1709420147194 bypass)} 2024-03-02 14:56:34,190 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-02 14:56:34,190 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709420147194 bypass)} 2024-03-02 14:56:34,440 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:56:34,440 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-02 14:56:34,440 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709420147194 bypass), TestNs=QuotaState(ts=1709420147194 bypass)} 2024-03-02 14:56:34,441 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709420147194 bypass), TestNs:TestTable=QuotaState(ts=1709420147194 bypass), TestQuotaAdmin2=QuotaState(ts=1709420147194 bypass)} 2024-03-02 14:56:34,441 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709420147194 bypass)} 2024-03-02 14:56:34,441 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709420147194 bypass)} 2024-03-02 14:56:34,454 INFO [Listener at localhost/45685] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=281 (was 282), OpenFileDescriptor=593 (was 593), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=90 (was 107), ProcessCount=168 (was 168), AvailableMemoryMB=8450 (was 8451) 2024-03-02 14:56:34,468 INFO [Listener at localhost/45685] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=281, OpenFileDescriptor=593, MaxFileDescriptor=60000, SystemLoadAverage=90, ProcessCount=168, AvailableMemoryMB=8450 2024-03-02 14:56:34,730 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:56:34,730 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-02 14:56:34,731 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709423747194 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1709423747194 bypass)} 2024-03-02 14:56:34,731 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709423747194 bypass), TestQuotaAdmin1=QuotaState(ts=1709423747194 bypass)} 2024-03-02 14:56:34,731 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-02 14:56:34,731 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709423747194 bypass)} 2024-03-02 14:56:34,981 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:56:34,981 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-02 14:56:34,982 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709423747194 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1709423747194 bypass)} 2024-03-02 14:56:34,983 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709423747194 bypass), TestNs:TestTable=QuotaState(ts=1709423747194 bypass), TestQuotaAdmin2=QuotaState(ts=1709423747194 bypass)} 2024-03-02 14:56:34,983 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-02 14:56:34,983 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709423747194 bypass)} 2024-03-02 14:56:34,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-02 14:56:34,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 235 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:53660 deadline: 1709391404998, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-02 14:56:35,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-02 14:56:35,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 237 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:53660 deadline: 1709391404999, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-02 14:56:35,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-02 14:56:35,759 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 239 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:53660 deadline: 1709391404998, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-02 14:56:36,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-02 14:56:36,519 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 241 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:53660 deadline: 1709391404999, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-02 14:56:37,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-02 14:56:37,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 243 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:53660 deadline: 1709391404998, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-02 14:56:40,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-02 14:56:40,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 245 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:53660 deadline: 1709391404999, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-02 14:56:40,289 ERROR [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10323: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e., hostname=jenkins-hbase4.apache.org,41195,1709391340156, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:128) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor35.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-02 14:56:40,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:40,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 252 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:53660 deadline: 1709391410298, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:40,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:40,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 254 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:53660 deadline: 1709391410298, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:41,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:41,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 256 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:53660 deadline: 1709391410298, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:41,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:41,811 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 258 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:53660 deadline: 1709391410297, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:43,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:43,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 260 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:53660 deadline: 1709391410298, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:45,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:45,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41195] ipc.CallRunner(144): callId: 262 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:53660 deadline: 1709391410297, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-02 14:56:45,601 ERROR [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10316: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e., hostname=jenkins-hbase4.apache.org,41195,1709391340156, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor35.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-02 14:56:45,859 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:56:45,859 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-02 14:56:45,859 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709427347194 bypass), TestNs=QuotaState(ts=1709427347194 bypass)} 2024-03-02 14:56:45,860 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709427347194 bypass), TestQuotaAdmin1=QuotaState(ts=1709427347194 bypass)} 2024-03-02 14:56:45,860 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-02 14:56:45,860 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709427347194 bypass)} 2024-03-02 14:56:46,110 INFO [Listener at localhost/45685] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-02 14:56:46,110 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-02 14:56:46,110 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709427347194 bypass), TestNs=QuotaState(ts=1709427347194 bypass)} 2024-03-02 14:56:46,110 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709427347194 bypass), TestNs:TestTable=QuotaState(ts=1709427347194 bypass), TestQuotaAdmin2=QuotaState(ts=1709427347194 bypass)} 2024-03-02 14:56:46,110 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709427347194 bypass)} 2024-03-02 14:56:46,110 DEBUG [Listener at localhost/45685] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709427347194 bypass)} 2024-03-02 14:56:46,124 INFO [Listener at localhost/45685] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=266 (was 281), OpenFileDescriptor=584 (was 593), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=76 (was 90), ProcessCount=168 (was 168), AvailableMemoryMB=8449 (was 8450) 2024-03-02 14:56:46,126 INFO [Listener at localhost/45685] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin0 2024-03-02 14:56:46,131 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin0 2024-03-02 14:56:46,137 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] procedure2.ProcedureExecutor(1075): Stored pid=27, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin0 2024-03-02 14:56:46,141 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709391406141"}]},"ts":"1709391406141"} 2024-03-02 14:56:46,142 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-03-02 14:56:46,143 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLING in hbase:meta 2024-03-02 14:56:46,145 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set TestQuotaAdmin0 to state=DISABLING 2024-03-02 14:56:46,147 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=ede0d130fe800882e0d404c992cd501e, UNASSIGN}] 2024-03-02 14:56:46,148 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=ede0d130fe800882e0d404c992cd501e, UNASSIGN 2024-03-02 14:56:46,149 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=ede0d130fe800882e0d404c992cd501e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:56:46,149 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709391406149"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709391406149"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709391406149"}]},"ts":"1709391406149"} 2024-03-02 14:56:46,151 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure ede0d130fe800882e0d404c992cd501e, server=jenkins-hbase4.apache.org,41195,1709391340156}] 2024-03-02 14:56:46,304 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase4.apache.org,41195,1709391340156, timeout=1709391406306, delay=2, operations=[pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure ede0d130fe800882e0d404c992cd501e, server=jenkins-hbase4.apache.org,41195,1709391340156]] 2024-03-02 14:56:46,308 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:56:46,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ede0d130fe800882e0d404c992cd501e 2024-03-02 14:56:46,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ede0d130fe800882e0d404c992cd501e, disabling compactions & flushes 2024-03-02 14:56:46,312 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e. 2024-03-02 14:56:46,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e. 2024-03-02 14:56:46,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e. after waiting 0 ms 2024-03-02 14:56:46,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e. 2024-03-02 14:56:46,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing ede0d130fe800882e0d404c992cd501e 1/1 column families, dataSize=578 B heapSize=2.11 KB 2024-03-02 14:56:46,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=578 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/default/TestQuotaAdmin0/ede0d130fe800882e0d404c992cd501e/.tmp/cf/9c060662a6a54c21b95eca6c2318a2af 2024-03-02 14:56:46,393 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-03-02 14:56:46,431 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/default/TestQuotaAdmin0/ede0d130fe800882e0d404c992cd501e/.tmp/cf/9c060662a6a54c21b95eca6c2318a2af as hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/default/TestQuotaAdmin0/ede0d130fe800882e0d404c992cd501e/cf/9c060662a6a54c21b95eca6c2318a2af 2024-03-02 14:56:46,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/default/TestQuotaAdmin0/ede0d130fe800882e0d404c992cd501e/cf/9c060662a6a54c21b95eca6c2318a2af, entries=6, sequenceid=21, filesize=4.7 K 2024-03-02 14:56:46,447 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~578 B/578, heapSize ~2.09 KB/2144, currentSize=0 B/0 for ede0d130fe800882e0d404c992cd501e in 134ms, sequenceid=21, compaction requested=false 2024-03-02 14:56:46,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/default/TestQuotaAdmin0/ede0d130fe800882e0d404c992cd501e/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2024-03-02 14:56:46,456 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e. 2024-03-02 14:56:46,456 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ede0d130fe800882e0d404c992cd501e: 2024-03-02 14:56:46,458 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ede0d130fe800882e0d404c992cd501e 2024-03-02 14:56:46,459 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=ede0d130fe800882e0d404c992cd501e, regionState=CLOSED 2024-03-02 14:56:46,459 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709391406459"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709391406459"}]},"ts":"1709391406459"} 2024-03-02 14:56:46,463 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=29, resume processing ppid=28 2024-03-02 14:56:46,463 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=29, ppid=28, state=SUCCESS; CloseRegionProcedure ede0d130fe800882e0d404c992cd501e, server=jenkins-hbase4.apache.org,41195,1709391340156 in 310 msec 2024-03-02 14:56:46,465 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=28, resume processing ppid=27 2024-03-02 14:56:46,465 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=ede0d130fe800882e0d404c992cd501e, UNASSIGN in 316 msec 2024-03-02 14:56:46,466 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709391406465"}]},"ts":"1709391406465"} 2024-03-02 14:56:46,467 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLED in hbase:meta 2024-03-02 14:56:46,469 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set TestQuotaAdmin0 to state=DISABLED 2024-03-02 14:56:46,471 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=27, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin0 in 338 msec 2024-03-02 14:56:46,894 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-03-02 14:56:46,895 INFO [Listener at localhost/45685] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin0, procId: 27 completed 2024-03-02 14:56:46,900 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin0 2024-03-02 14:56:46,908 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] procedure2.ProcedureExecutor(1075): Stored pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-02 14:56:46,911 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-02 14:56:46,913 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=30, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-02 14:56:46,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-03-02 14:56:46,924 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/default/TestQuotaAdmin0/ede0d130fe800882e0d404c992cd501e 2024-03-02 14:56:46,930 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/default/TestQuotaAdmin0/ede0d130fe800882e0d404c992cd501e/cf, FileablePath, hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/default/TestQuotaAdmin0/ede0d130fe800882e0d404c992cd501e/recovered.edits] 2024-03-02 14:56:46,944 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/default/TestQuotaAdmin0/ede0d130fe800882e0d404c992cd501e/cf/9c060662a6a54c21b95eca6c2318a2af to hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/archive/data/default/TestQuotaAdmin0/ede0d130fe800882e0d404c992cd501e/cf/9c060662a6a54c21b95eca6c2318a2af 2024-03-02 14:56:46,951 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/default/TestQuotaAdmin0/ede0d130fe800882e0d404c992cd501e/recovered.edits/24.seqid to hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/archive/data/default/TestQuotaAdmin0/ede0d130fe800882e0d404c992cd501e/recovered.edits/24.seqid 2024-03-02 14:56:46,952 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/default/TestQuotaAdmin0/ede0d130fe800882e0d404c992cd501e 2024-03-02 14:56:46,952 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-03-02 14:56:46,957 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=30, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-02 14:56:46,986 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin0 from hbase:meta 2024-03-02 14:56:46,989 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin0' descriptor. 2024-03-02 14:56:46,991 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=30, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-02 14:56:46,991 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin0' from region states. 2024-03-02 14:56:46,991 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1709391406991"}]},"ts":"9223372036854775807"} 2024-03-02 14:56:46,994 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-03-02 14:56:46,994 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ede0d130fe800882e0d404c992cd501e, NAME => 'TestQuotaAdmin0,,1709391343286.ede0d130fe800882e0d404c992cd501e.', STARTKEY => '', ENDKEY => ''}] 2024-03-02 14:56:46,994 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin0' as deleted. 2024-03-02 14:56:46,994 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1709391406994"}]},"ts":"9223372036854775807"} 2024-03-02 14:56:46,999 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin0 state from META 2024-03-02 14:56:47,003 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=30, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-02 14:56:47,005 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=30, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin0 in 101 msec 2024-03-02 14:56:47,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-03-02 14:56:47,172 INFO [Listener at localhost/45685] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin0, procId: 30 completed 2024-03-02 14:56:47,172 INFO [Listener at localhost/45685] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin1 2024-03-02 14:56:47,173 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin1 2024-03-02 14:56:47,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] procedure2.ProcedureExecutor(1075): Stored pid=31, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin1 2024-03-02 14:56:47,179 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-03-02 14:56:47,182 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709391407182"}]},"ts":"1709391407182"} 2024-03-02 14:56:47,184 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLING in hbase:meta 2024-03-02 14:56:47,186 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set TestQuotaAdmin1 to state=DISABLING 2024-03-02 14:56:47,188 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=01516433e448108963f7b2b4411d92d3, UNASSIGN}] 2024-03-02 14:56:47,189 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=01516433e448108963f7b2b4411d92d3, UNASSIGN 2024-03-02 14:56:47,191 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=01516433e448108963f7b2b4411d92d3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36719,1709391340112 2024-03-02 14:56:47,191 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1709391344086.01516433e448108963f7b2b4411d92d3.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709391407191"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709391407191"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709391407191"}]},"ts":"1709391407191"} 2024-03-02 14:56:47,193 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=33, ppid=32, state=RUNNABLE; CloseRegionProcedure 01516433e448108963f7b2b4411d92d3, server=jenkins-hbase4.apache.org,36719,1709391340112}] 2024-03-02 14:56:47,346 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,36719,1709391340112 2024-03-02 14:56:47,347 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 01516433e448108963f7b2b4411d92d3 2024-03-02 14:56:47,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 01516433e448108963f7b2b4411d92d3, disabling compactions & flushes 2024-03-02 14:56:47,349 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1709391344086.01516433e448108963f7b2b4411d92d3. 2024-03-02 14:56:47,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1709391344086.01516433e448108963f7b2b4411d92d3. 2024-03-02 14:56:47,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1709391344086.01516433e448108963f7b2b4411d92d3. after waiting 0 ms 2024-03-02 14:56:47,349 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1709391344086.01516433e448108963f7b2b4411d92d3. 2024-03-02 14:56:47,358 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/default/TestQuotaAdmin1/01516433e448108963f7b2b4411d92d3/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-03-02 14:56:47,360 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1709391344086.01516433e448108963f7b2b4411d92d3. 2024-03-02 14:56:47,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 01516433e448108963f7b2b4411d92d3: 2024-03-02 14:56:47,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 01516433e448108963f7b2b4411d92d3 2024-03-02 14:56:47,368 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=01516433e448108963f7b2b4411d92d3, regionState=CLOSED 2024-03-02 14:56:47,369 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1709391344086.01516433e448108963f7b2b4411d92d3.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709391407368"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709391407368"}]},"ts":"1709391407368"} 2024-03-02 14:56:47,373 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=33, resume processing ppid=32 2024-03-02 14:56:47,373 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=33, ppid=32, state=SUCCESS; CloseRegionProcedure 01516433e448108963f7b2b4411d92d3, server=jenkins-hbase4.apache.org,36719,1709391340112 in 178 msec 2024-03-02 14:56:47,376 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=32, resume processing ppid=31 2024-03-02 14:56:47,377 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=32, ppid=31, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=01516433e448108963f7b2b4411d92d3, UNASSIGN in 186 msec 2024-03-02 14:56:47,377 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709391407377"}]},"ts":"1709391407377"} 2024-03-02 14:56:47,379 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLED in hbase:meta 2024-03-02 14:56:47,381 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set TestQuotaAdmin1 to state=DISABLED 2024-03-02 14:56:47,384 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=31, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin1 in 209 msec 2024-03-02 14:56:47,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-03-02 14:56:47,432 INFO [Listener at localhost/45685] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin1, procId: 31 completed 2024-03-02 14:56:47,433 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin1 2024-03-02 14:56:47,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] procedure2.ProcedureExecutor(1075): Stored pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-02 14:56:47,437 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-02 14:56:47,438 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=34, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-02 14:56:47,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-03-02 14:56:47,445 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/default/TestQuotaAdmin1/01516433e448108963f7b2b4411d92d3 2024-03-02 14:56:47,449 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/default/TestQuotaAdmin1/01516433e448108963f7b2b4411d92d3/cf, FileablePath, hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/default/TestQuotaAdmin1/01516433e448108963f7b2b4411d92d3/recovered.edits] 2024-03-02 14:56:47,466 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/default/TestQuotaAdmin1/01516433e448108963f7b2b4411d92d3/recovered.edits/4.seqid to hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/archive/data/default/TestQuotaAdmin1/01516433e448108963f7b2b4411d92d3/recovered.edits/4.seqid 2024-03-02 14:56:47,466 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/default/TestQuotaAdmin1/01516433e448108963f7b2b4411d92d3 2024-03-02 14:56:47,467 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-03-02 14:56:47,472 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=34, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-02 14:56:47,474 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin1 from hbase:meta 2024-03-02 14:56:47,478 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin1' descriptor. 2024-03-02 14:56:47,480 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=34, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-02 14:56:47,480 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin1' from region states. 2024-03-02 14:56:47,480 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1,,1709391344086.01516433e448108963f7b2b4411d92d3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1709391407480"}]},"ts":"9223372036854775807"} 2024-03-02 14:56:47,482 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-03-02 14:56:47,482 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 01516433e448108963f7b2b4411d92d3, NAME => 'TestQuotaAdmin1,,1709391344086.01516433e448108963f7b2b4411d92d3.', STARTKEY => '', ENDKEY => ''}] 2024-03-02 14:56:47,482 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin1' as deleted. 2024-03-02 14:56:47,482 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1709391407482"}]},"ts":"9223372036854775807"} 2024-03-02 14:56:47,485 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin1 state from META 2024-03-02 14:56:47,487 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=34, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-02 14:56:47,490 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=34, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin1 in 54 msec 2024-03-02 14:56:47,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-03-02 14:56:47,692 INFO [Listener at localhost/45685] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin1, procId: 34 completed 2024-03-02 14:56:47,693 INFO [Listener at localhost/45685] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin2 2024-03-02 14:56:47,693 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin2 2024-03-02 14:56:47,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] procedure2.ProcedureExecutor(1075): Stored pid=35, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin2 2024-03-02 14:56:47,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-03-02 14:56:47,699 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709391407699"}]},"ts":"1709391407699"} 2024-03-02 14:56:47,700 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLING in hbase:meta 2024-03-02 14:56:47,703 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set TestQuotaAdmin2 to state=DISABLING 2024-03-02 14:56:47,704 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=b497e2afcd7eb4e1fd02ae1bbede53c2, UNASSIGN}] 2024-03-02 14:56:47,705 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=b497e2afcd7eb4e1fd02ae1bbede53c2, UNASSIGN 2024-03-02 14:56:47,706 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=b497e2afcd7eb4e1fd02ae1bbede53c2, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:56:47,706 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1709391344870.b497e2afcd7eb4e1fd02ae1bbede53c2.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709391407706"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709391407706"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709391407706"}]},"ts":"1709391407706"} 2024-03-02 14:56:47,708 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; CloseRegionProcedure b497e2afcd7eb4e1fd02ae1bbede53c2, server=jenkins-hbase4.apache.org,41195,1709391340156}] 2024-03-02 14:56:47,861 DEBUG [RSProcedureDispatcher-pool-5] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:56:47,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b497e2afcd7eb4e1fd02ae1bbede53c2 2024-03-02 14:56:47,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b497e2afcd7eb4e1fd02ae1bbede53c2, disabling compactions & flushes 2024-03-02 14:56:47,862 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1709391344870.b497e2afcd7eb4e1fd02ae1bbede53c2. 2024-03-02 14:56:47,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1709391344870.b497e2afcd7eb4e1fd02ae1bbede53c2. 2024-03-02 14:56:47,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1709391344870.b497e2afcd7eb4e1fd02ae1bbede53c2. after waiting 0 ms 2024-03-02 14:56:47,862 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1709391344870.b497e2afcd7eb4e1fd02ae1bbede53c2. 2024-03-02 14:56:47,867 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/default/TestQuotaAdmin2/b497e2afcd7eb4e1fd02ae1bbede53c2/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-03-02 14:56:47,868 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1709391344870.b497e2afcd7eb4e1fd02ae1bbede53c2. 2024-03-02 14:56:47,868 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b497e2afcd7eb4e1fd02ae1bbede53c2: 2024-03-02 14:56:47,870 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b497e2afcd7eb4e1fd02ae1bbede53c2 2024-03-02 14:56:47,871 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=b497e2afcd7eb4e1fd02ae1bbede53c2, regionState=CLOSED 2024-03-02 14:56:47,871 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1709391344870.b497e2afcd7eb4e1fd02ae1bbede53c2.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709391407871"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709391407871"}]},"ts":"1709391407871"} 2024-03-02 14:56:47,875 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=37, resume processing ppid=36 2024-03-02 14:56:47,875 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=37, ppid=36, state=SUCCESS; CloseRegionProcedure b497e2afcd7eb4e1fd02ae1bbede53c2, server=jenkins-hbase4.apache.org,41195,1709391340156 in 165 msec 2024-03-02 14:56:47,877 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=36, resume processing ppid=35 2024-03-02 14:56:47,877 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=b497e2afcd7eb4e1fd02ae1bbede53c2, UNASSIGN in 171 msec 2024-03-02 14:56:47,878 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709391407878"}]},"ts":"1709391407878"} 2024-03-02 14:56:47,880 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLED in hbase:meta 2024-03-02 14:56:47,882 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set TestQuotaAdmin2 to state=DISABLED 2024-03-02 14:56:47,884 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=35, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin2 in 189 msec 2024-03-02 14:56:47,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-03-02 14:56:47,950 INFO [Listener at localhost/45685] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin2, procId: 35 completed 2024-03-02 14:56:47,950 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin2 2024-03-02 14:56:47,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] procedure2.ProcedureExecutor(1075): Stored pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-02 14:56:47,953 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-02 14:56:47,954 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=38, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-02 14:56:47,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-03-02 14:56:47,959 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/default/TestQuotaAdmin2/b497e2afcd7eb4e1fd02ae1bbede53c2 2024-03-02 14:56:47,961 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/default/TestQuotaAdmin2/b497e2afcd7eb4e1fd02ae1bbede53c2/cf, FileablePath, hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/default/TestQuotaAdmin2/b497e2afcd7eb4e1fd02ae1bbede53c2/recovered.edits] 2024-03-02 14:56:47,970 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/default/TestQuotaAdmin2/b497e2afcd7eb4e1fd02ae1bbede53c2/recovered.edits/4.seqid to hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/archive/data/default/TestQuotaAdmin2/b497e2afcd7eb4e1fd02ae1bbede53c2/recovered.edits/4.seqid 2024-03-02 14:56:47,970 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/default/TestQuotaAdmin2/b497e2afcd7eb4e1fd02ae1bbede53c2 2024-03-02 14:56:47,970 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-03-02 14:56:47,974 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=38, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-02 14:56:47,975 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin2 from hbase:meta 2024-03-02 14:56:47,977 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin2' descriptor. 2024-03-02 14:56:47,979 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=38, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-02 14:56:47,979 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin2' from region states. 2024-03-02 14:56:47,979 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2,,1709391344870.b497e2afcd7eb4e1fd02ae1bbede53c2.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1709391407979"}]},"ts":"9223372036854775807"} 2024-03-02 14:56:47,980 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-03-02 14:56:47,980 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b497e2afcd7eb4e1fd02ae1bbede53c2, NAME => 'TestQuotaAdmin2,,1709391344870.b497e2afcd7eb4e1fd02ae1bbede53c2.', STARTKEY => '', ENDKEY => ''}] 2024-03-02 14:56:47,980 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin2' as deleted. 2024-03-02 14:56:47,981 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1709391407980"}]},"ts":"9223372036854775807"} 2024-03-02 14:56:47,982 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin2 state from META 2024-03-02 14:56:47,984 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=38, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-02 14:56:47,986 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=38, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin2 in 34 msec 2024-03-02 14:56:48,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-03-02 14:56:48,207 INFO [Listener at localhost/45685] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin2, procId: 38 completed 2024-03-02 14:56:48,208 INFO [Listener at localhost/45685] client.HBaseAdmin$15(890): Started disable of TestNs:TestTable 2024-03-02 14:56:48,208 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestNs:TestTable 2024-03-02 14:56:48,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] procedure2.ProcedureExecutor(1075): Stored pid=39, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestNs:TestTable 2024-03-02 14:56:48,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-03-02 14:56:48,213 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709391408213"}]},"ts":"1709391408213"} 2024-03-02 14:56:48,215 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLING in hbase:meta 2024-03-02 14:56:48,217 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set TestNs:TestTable to state=DISABLING 2024-03-02 14:56:48,217 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=0cd9546da74fc32f61f67d9a8e9ee270, UNASSIGN}, {pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=8962c93d3f1583d6c125e721749cb7eb, UNASSIGN}] 2024-03-02 14:56:48,218 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=8962c93d3f1583d6c125e721749cb7eb, UNASSIGN 2024-03-02 14:56:48,219 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=0cd9546da74fc32f61f67d9a8e9ee270, UNASSIGN 2024-03-02 14:56:48,219 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=8962c93d3f1583d6c125e721749cb7eb, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:56:48,219 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=0cd9546da74fc32f61f67d9a8e9ee270, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36719,1709391340112 2024-03-02 14:56:48,219 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1709391345914.8962c93d3f1583d6c125e721749cb7eb.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709391408219"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709391408219"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709391408219"}]},"ts":"1709391408219"} 2024-03-02 14:56:48,220 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1709391345914.0cd9546da74fc32f61f67d9a8e9ee270.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709391408219"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709391408219"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709391408219"}]},"ts":"1709391408219"} 2024-03-02 14:56:48,221 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=42, ppid=41, state=RUNNABLE; CloseRegionProcedure 8962c93d3f1583d6c125e721749cb7eb, server=jenkins-hbase4.apache.org,41195,1709391340156}] 2024-03-02 14:56:48,222 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=43, ppid=40, state=RUNNABLE; CloseRegionProcedure 0cd9546da74fc32f61f67d9a8e9ee270, server=jenkins-hbase4.apache.org,36719,1709391340112}] 2024-03-02 14:56:48,373 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:56:48,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8962c93d3f1583d6c125e721749cb7eb 2024-03-02 14:56:48,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8962c93d3f1583d6c125e721749cb7eb, disabling compactions & flushes 2024-03-02 14:56:48,375 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,36719,1709391340112 2024-03-02 14:56:48,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1709391345914.8962c93d3f1583d6c125e721749cb7eb. 2024-03-02 14:56:48,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1709391345914.8962c93d3f1583d6c125e721749cb7eb. 2024-03-02 14:56:48,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1709391345914.8962c93d3f1583d6c125e721749cb7eb. after waiting 0 ms 2024-03-02 14:56:48,375 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1709391345914.8962c93d3f1583d6c125e721749cb7eb. 2024-03-02 14:56:48,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0cd9546da74fc32f61f67d9a8e9ee270 2024-03-02 14:56:48,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0cd9546da74fc32f61f67d9a8e9ee270, disabling compactions & flushes 2024-03-02 14:56:48,376 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1709391345914.0cd9546da74fc32f61f67d9a8e9ee270. 2024-03-02 14:56:48,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1709391345914.0cd9546da74fc32f61f67d9a8e9ee270. 2024-03-02 14:56:48,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1709391345914.0cd9546da74fc32f61f67d9a8e9ee270. after waiting 0 ms 2024-03-02 14:56:48,376 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1709391345914.0cd9546da74fc32f61f67d9a8e9ee270. 2024-03-02 14:56:48,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/TestNs/TestTable/8962c93d3f1583d6c125e721749cb7eb/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-03-02 14:56:48,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/TestNs/TestTable/0cd9546da74fc32f61f67d9a8e9ee270/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-03-02 14:56:48,382 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1709391345914.8962c93d3f1583d6c125e721749cb7eb. 2024-03-02 14:56:48,382 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8962c93d3f1583d6c125e721749cb7eb: 2024-03-02 14:56:48,383 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1709391345914.0cd9546da74fc32f61f67d9a8e9ee270. 2024-03-02 14:56:48,383 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0cd9546da74fc32f61f67d9a8e9ee270: 2024-03-02 14:56:48,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8962c93d3f1583d6c125e721749cb7eb 2024-03-02 14:56:48,385 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=8962c93d3f1583d6c125e721749cb7eb, regionState=CLOSED 2024-03-02 14:56:48,385 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1709391345914.8962c93d3f1583d6c125e721749cb7eb.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709391408385"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709391408385"}]},"ts":"1709391408385"} 2024-03-02 14:56:48,385 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0cd9546da74fc32f61f67d9a8e9ee270 2024-03-02 14:56:48,386 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=0cd9546da74fc32f61f67d9a8e9ee270, regionState=CLOSED 2024-03-02 14:56:48,386 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,,1709391345914.0cd9546da74fc32f61f67d9a8e9ee270.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709391408386"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709391408386"}]},"ts":"1709391408386"} 2024-03-02 14:56:48,389 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=42, resume processing ppid=41 2024-03-02 14:56:48,389 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=42, ppid=41, state=SUCCESS; CloseRegionProcedure 8962c93d3f1583d6c125e721749cb7eb, server=jenkins-hbase4.apache.org,41195,1709391340156 in 166 msec 2024-03-02 14:56:48,390 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=43, resume processing ppid=40 2024-03-02 14:56:48,390 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=43, ppid=40, state=SUCCESS; CloseRegionProcedure 0cd9546da74fc32f61f67d9a8e9ee270, server=jenkins-hbase4.apache.org,36719,1709391340112 in 165 msec 2024-03-02 14:56:48,391 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=41, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=8962c93d3f1583d6c125e721749cb7eb, UNASSIGN in 172 msec 2024-03-02 14:56:48,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=40, resume processing ppid=39 2024-03-02 14:56:48,392 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=0cd9546da74fc32f61f67d9a8e9ee270, UNASSIGN in 173 msec 2024-03-02 14:56:48,393 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709391408393"}]},"ts":"1709391408393"} 2024-03-02 14:56:48,394 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLED in hbase:meta 2024-03-02 14:56:48,396 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set TestNs:TestTable to state=DISABLED 2024-03-02 14:56:48,398 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=39, state=SUCCESS; DisableTableProcedure table=TestNs:TestTable in 189 msec 2024-03-02 14:56:48,464 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-03-02 14:56:48,464 INFO [Listener at localhost/45685] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: TestNs:TestTable, procId: 39 completed 2024-03-02 14:56:48,465 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestNs:TestTable 2024-03-02 14:56:48,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] procedure2.ProcedureExecutor(1075): Stored pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestNs:TestTable 2024-03-02 14:56:48,468 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-02 14:56:48,469 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=44, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-02 14:56:48,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-03-02 14:56:48,476 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/TestNs/TestTable/0cd9546da74fc32f61f67d9a8e9ee270 2024-03-02 14:56:48,481 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/TestNs/TestTable/8962c93d3f1583d6c125e721749cb7eb 2024-03-02 14:56:48,483 DEBUG [HFileArchiver-11] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/TestNs/TestTable/0cd9546da74fc32f61f67d9a8e9ee270/cf, FileablePath, hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/TestNs/TestTable/0cd9546da74fc32f61f67d9a8e9ee270/recovered.edits] 2024-03-02 14:56:48,484 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/TestNs/TestTable/8962c93d3f1583d6c125e721749cb7eb/cf, FileablePath, hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/TestNs/TestTable/8962c93d3f1583d6c125e721749cb7eb/recovered.edits] 2024-03-02 14:56:48,494 DEBUG [HFileArchiver-11] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/TestNs/TestTable/0cd9546da74fc32f61f67d9a8e9ee270/recovered.edits/4.seqid to hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/archive/data/TestNs/TestTable/0cd9546da74fc32f61f67d9a8e9ee270/recovered.edits/4.seqid 2024-03-02 14:56:48,494 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/TestNs/TestTable/8962c93d3f1583d6c125e721749cb7eb/recovered.edits/4.seqid to hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/archive/data/TestNs/TestTable/8962c93d3f1583d6c125e721749cb7eb/recovered.edits/4.seqid 2024-03-02 14:56:48,495 DEBUG [HFileArchiver-11] backup.HFileArchiver(596): Deleted hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/TestNs/TestTable/0cd9546da74fc32f61f67d9a8e9ee270 2024-03-02 14:56:48,495 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/.tmp/data/TestNs/TestTable/8962c93d3f1583d6c125e721749cb7eb 2024-03-02 14:56:48,496 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-03-02 14:56:48,499 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=44, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-02 14:56:48,501 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of TestNs:TestTable from hbase:meta 2024-03-02 14:56:48,503 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'TestNs:TestTable' descriptor. 2024-03-02 14:56:48,505 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=44, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-02 14:56:48,505 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'TestNs:TestTable' from region states. 2024-03-02 14:56:48,505 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,,1709391345914.0cd9546da74fc32f61f67d9a8e9ee270.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1709391408505"}]},"ts":"9223372036854775807"} 2024-03-02 14:56:48,505 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,1,1709391345914.8962c93d3f1583d6c125e721749cb7eb.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1709391408505"}]},"ts":"9223372036854775807"} 2024-03-02 14:56:48,507 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2024-03-02 14:56:48,507 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0cd9546da74fc32f61f67d9a8e9ee270, NAME => 'TestNs:TestTable,,1709391345914.0cd9546da74fc32f61f67d9a8e9ee270.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 8962c93d3f1583d6c125e721749cb7eb, NAME => 'TestNs:TestTable,1,1709391345914.8962c93d3f1583d6c125e721749cb7eb.', STARTKEY => '1', ENDKEY => ''}] 2024-03-02 14:56:48,507 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'TestNs:TestTable' as deleted. 2024-03-02 14:56:48,507 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1709391408507"}]},"ts":"9223372036854775807"} 2024-03-02 14:56:48,509 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table TestNs:TestTable state from META 2024-03-02 14:56:48,511 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=44, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-02 14:56:48,513 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=44, state=SUCCESS; DeleteTableProcedure table=TestNs:TestTable in 46 msec 2024-03-02 14:56:48,727 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-03-02 14:56:48,728 INFO [Listener at localhost/45685] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: TestNs:TestTable, procId: 44 completed 2024-03-02 14:56:48,732 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.HMaster$17(3092): Client=jenkins//172.31.14.131 delete TestNs 2024-03-02 14:56:48,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] procedure2.ProcedureExecutor(1075): Stored pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE; DeleteNamespaceProcedure, namespace=TestNs 2024-03-02 14:56:48,744 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-02 14:56:48,746 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_FROM_NS_TABLE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-02 14:56:48,749 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_FROM_ZK, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-02 14:56:48,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-03-02 14:56:48,750 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace/TestNs 2024-03-02 14:56:48,750 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-03-02 14:56:48,751 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_DIRECTORIES, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-02 14:56:48,754 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_NAMESPACE_QUOTA, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-02 14:56:48,756 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=45, state=SUCCESS; DeleteNamespaceProcedure, namespace=TestNs in 21 msec 2024-03-02 14:56:49,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39587] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-03-02 14:56:49,002 INFO [Listener at localhost/45685] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2024-03-02 14:56:49,002 INFO [Listener at localhost/45685] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-03-02 14:56:49,002 DEBUG [Listener at localhost/45685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11e514a4 to 127.0.0.1:58480 2024-03-02 14:56:49,002 DEBUG [Listener at localhost/45685] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-02 14:56:49,003 DEBUG [Listener at localhost/45685] util.JVMClusterUtil(237): Shutting down HBase Cluster 2024-03-02 14:56:49,003 DEBUG [Listener at localhost/45685] util.JVMClusterUtil(257): Found active master hash=65741404, stopped=false 2024-03-02 14:56:49,003 DEBUG [Listener at localhost/45685] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-03-02 14:56:49,004 INFO [Listener at localhost/45685] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39587,1709391338894 2024-03-02 14:56:49,007 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-03-02 14:56:49,007 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-02 14:56:49,007 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): regionserver:36719-0x100250aa1ae0001, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-03-02 14:56:49,007 INFO [Listener at localhost/45685] procedure2.ProcedureExecutor(675): Stopping 2024-03-02 14:56:49,007 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): regionserver:41195-0x100250aa1ae0002, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-03-02 14:56:49,008 DEBUG [Listener at localhost/45685] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0acd0a85 to 127.0.0.1:58480 2024-03-02 14:56:49,008 DEBUG [Listener at localhost/45685] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-02 14:56:49,008 INFO [Listener at localhost/45685] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,36719,1709391340112' ***** 2024-03-02 14:56:49,008 INFO [Listener at localhost/45685] regionserver.HRegionServer(2313): STOPPED: Shutdown requested 2024-03-02 14:56:49,008 INFO [Listener at localhost/45685] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,41195,1709391340156' ***** 2024-03-02 14:56:49,008 INFO [Listener at localhost/45685] regionserver.HRegionServer(2313): STOPPED: Shutdown requested 2024-03-02 14:56:49,008 INFO [RS:0;jenkins-hbase4:36719] regionserver.HeapMemoryManager(220): Stopping 2024-03-02 14:56:49,009 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:36719-0x100250aa1ae0001, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-02 14:56:49,009 INFO [RS:0;jenkins-hbase4:36719] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-03-02 14:56:49,009 INFO [RS:1;jenkins-hbase4:41195] regionserver.HeapMemoryManager(220): Stopping 2024-03-02 14:56:49,009 INFO [RS:0;jenkins-hbase4:36719] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-03-02 14:56:49,009 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-03-02 14:56:49,009 INFO [RS:0;jenkins-hbase4:36719] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,36719,1709391340112 2024-03-02 14:56:49,009 INFO [RS:0;jenkins-hbase4:36719] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-03-02 14:56:49,009 DEBUG [RS:0;jenkins-hbase4:36719] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26f08827 to 127.0.0.1:58480 2024-03-02 14:56:49,009 DEBUG [RS:0;jenkins-hbase4:36719] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-02 14:56:49,009 INFO [RS:0;jenkins-hbase4:36719] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,36719,1709391340112; all regions closed. 2024-03-02 14:56:49,009 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-02 14:56:49,009 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-03-02 14:56:49,010 DEBUG [RS:0;jenkins-hbase4:36719] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-03-02 14:56:49,009 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41195-0x100250aa1ae0002, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-02 14:56:49,009 INFO [RS:1;jenkins-hbase4:41195] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-03-02 14:56:49,011 INFO [RS:1;jenkins-hbase4:41195] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-03-02 14:56:49,011 INFO [RS:1;jenkins-hbase4:41195] regionserver.HRegionServer(3307): Received CLOSE for c61265fbb35c30a3859441251ce33c62 2024-03-02 14:56:49,011 INFO [RS:1;jenkins-hbase4:41195] regionserver.HRegionServer(3307): Received CLOSE for 4c7f546d8e2dbb235856f58354193507 2024-03-02 14:56:49,011 INFO [RS:1;jenkins-hbase4:41195] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:56:49,011 INFO [RS:1;jenkins-hbase4:41195] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-03-02 14:56:49,011 DEBUG [RS:1;jenkins-hbase4:41195] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x71381fe9 to 127.0.0.1:58480 2024-03-02 14:56:49,012 DEBUG [RS:1;jenkins-hbase4:41195] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-02 14:56:49,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c61265fbb35c30a3859441251ce33c62, disabling compactions & flushes 2024-03-02 14:56:49,014 INFO [RS:1;jenkins-hbase4:41195] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-03-02 14:56:49,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1709391341990.c61265fbb35c30a3859441251ce33c62. 2024-03-02 14:56:49,014 INFO [RS:1;jenkins-hbase4:41195] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-03-02 14:56:49,014 INFO [RS:1;jenkins-hbase4:41195] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-03-02 14:56:49,014 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1709391341990.c61265fbb35c30a3859441251ce33c62. 2024-03-02 14:56:49,015 INFO [RS:1;jenkins-hbase4:41195] regionserver.HRegionServer(3307): Received CLOSE for 1588230740 2024-03-02 14:56:49,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1709391341990.c61265fbb35c30a3859441251ce33c62. after waiting 0 ms 2024-03-02 14:56:49,015 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1709391341990.c61265fbb35c30a3859441251ce33c62. 2024-03-02 14:56:49,015 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c61265fbb35c30a3859441251ce33c62 1/1 column families, dataSize=147 B heapSize=704 B 2024-03-02 14:56:49,017 INFO [RS:1;jenkins-hbase4:41195] regionserver.HRegionServer(1477): Waiting on 3 regions to close 2024-03-02 14:56:49,017 DEBUG [RS:1;jenkins-hbase4:41195] regionserver.HRegionServer(1481): Online Regions={c61265fbb35c30a3859441251ce33c62=hbase:namespace,,1709391341990.c61265fbb35c30a3859441251ce33c62., 4c7f546d8e2dbb235856f58354193507=hbase:quota,,1709391342707.4c7f546d8e2dbb235856f58354193507., 1588230740=hbase:meta,,1.1588230740} 2024-03-02 14:56:49,021 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-03-02 14:56:49,021 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-03-02 14:56:49,021 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-03-02 14:56:49,021 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-03-02 14:56:49,021 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-03-02 14:56:49,021 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-03-02 14:56:49,021 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=14.15 KB heapSize=25.10 KB 2024-03-02 14:56:49,021 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-03-02 14:56:49,022 DEBUG [RS:1;jenkins-hbase4:41195] regionserver.HRegionServer(1507): Waiting on 1588230740, 4c7f546d8e2dbb235856f58354193507, c61265fbb35c30a3859441251ce33c62 2024-03-02 14:56:49,047 DEBUG [RS:0;jenkins-hbase4:36719] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/oldWALs 2024-03-02 14:56:49,047 INFO [RS:0;jenkins-hbase4:36719] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36719%2C1709391340112:(num 1709391341614) 2024-03-02 14:56:49,047 DEBUG [RS:0;jenkins-hbase4:36719] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-02 14:56:49,047 INFO [RS:0;jenkins-hbase4:36719] regionserver.LeaseManager(133): Closed leases 2024-03-02 14:56:49,049 INFO [RS:0;jenkins-hbase4:36719] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2024-03-02 14:56:49,050 INFO [RS:0;jenkins-hbase4:36719] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-03-02 14:56:49,050 INFO [RS:0;jenkins-hbase4:36719] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-03-02 14:56:49,050 INFO [RS:0;jenkins-hbase4:36719] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-03-02 14:56:49,050 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-03-02 14:56:49,060 INFO [RS:0;jenkins-hbase4:36719] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36719 2024-03-02 14:56:49,069 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-03-02 14:56:49,073 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): regionserver:36719-0x100250aa1ae0001, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36719,1709391340112 2024-03-02 14:56:49,073 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-03-02 14:56:49,073 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): regionserver:36719-0x100250aa1ae0001, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-03-02 14:56:49,073 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=147 B at sequenceid=8 (bloomFilter=true), to=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/namespace/c61265fbb35c30a3859441251ce33c62/.tmp/info/49b1c8427f904ee59ca390d412c28e14 2024-03-02 14:56:49,073 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): regionserver:41195-0x100250aa1ae0002, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36719,1709391340112 2024-03-02 14:56:49,074 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): regionserver:41195-0x100250aa1ae0002, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-03-02 14:56:49,074 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36719,1709391340112] 2024-03-02 14:56:49,075 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36719,1709391340112; numProcessing=1 2024-03-02 14:56:49,080 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=12.16 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/meta/1588230740/.tmp/info/7d381b42a9a044569b928615c80ee8d7 2024-03-02 14:56:49,085 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36719,1709391340112 already deleted, retry=false 2024-03-02 14:56:49,085 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,36719,1709391340112 expired; onlineServers=1 2024-03-02 14:56:49,094 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7d381b42a9a044569b928615c80ee8d7 2024-03-02 14:56:49,094 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 49b1c8427f904ee59ca390d412c28e14 2024-03-02 14:56:49,095 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/namespace/c61265fbb35c30a3859441251ce33c62/.tmp/info/49b1c8427f904ee59ca390d412c28e14 as hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/namespace/c61265fbb35c30a3859441251ce33c62/info/49b1c8427f904ee59ca390d412c28e14 2024-03-02 14:56:49,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 49b1c8427f904ee59ca390d412c28e14 2024-03-02 14:56:49,105 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/namespace/c61265fbb35c30a3859441251ce33c62/info/49b1c8427f904ee59ca390d412c28e14, entries=3, sequenceid=8, filesize=5.0 K 2024-03-02 14:56:49,106 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~147 B/147, heapSize ~688 B/688, currentSize=0 B/0 for c61265fbb35c30a3859441251ce33c62 in 91ms, sequenceid=8, compaction requested=false 2024-03-02 14:56:49,135 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/namespace/c61265fbb35c30a3859441251ce33c62/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=1 2024-03-02 14:56:49,137 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1709391341990.c61265fbb35c30a3859441251ce33c62. 2024-03-02 14:56:49,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c61265fbb35c30a3859441251ce33c62: 2024-03-02 14:56:49,137 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1709391341990.c61265fbb35c30a3859441251ce33c62. 2024-03-02 14:56:49,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4c7f546d8e2dbb235856f58354193507, disabling compactions & flushes 2024-03-02 14:56:49,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:quota,,1709391342707.4c7f546d8e2dbb235856f58354193507. 2024-03-02 14:56:49,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1709391342707.4c7f546d8e2dbb235856f58354193507. 2024-03-02 14:56:49,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1709391342707.4c7f546d8e2dbb235856f58354193507. after waiting 0 ms 2024-03-02 14:56:49,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1709391342707.4c7f546d8e2dbb235856f58354193507. 2024-03-02 14:56:49,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 4c7f546d8e2dbb235856f58354193507 2/2 column families, dataSize=726 B heapSize=2.44 KB 2024-03-02 14:56:49,147 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=478 B at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/meta/1588230740/.tmp/rep_barrier/b9d3cf862eec435c93e4568e062110c8 2024-03-02 14:56:49,165 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b9d3cf862eec435c93e4568e062110c8 2024-03-02 14:56:49,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=597 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/quota/4c7f546d8e2dbb235856f58354193507/.tmp/q/2a995e6578d442188daeedc07b158769 2024-03-02 14:56:49,186 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): regionserver:36719-0x100250aa1ae0001, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-02 14:56:49,186 INFO [RS:0;jenkins-hbase4:36719] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,36719,1709391340112; zookeeper connection closed. 2024-03-02 14:56:49,186 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): regionserver:36719-0x100250aa1ae0001, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-02 14:56:49,194 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2a995e6578d442188daeedc07b158769 2024-03-02 14:56:49,199 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@30c9d487] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@30c9d487 2024-03-02 14:56:49,222 DEBUG [RS:1;jenkins-hbase4:41195] regionserver.HRegionServer(1507): Waiting on 1588230740, 4c7f546d8e2dbb235856f58354193507 2024-03-02 14:56:49,251 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.53 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/meta/1588230740/.tmp/table/862b18df0e2a4531b68923f6b96e8747 2024-03-02 14:56:49,262 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=129 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/quota/4c7f546d8e2dbb235856f58354193507/.tmp/u/22271e7ea3c14c91b0e638fb4b56fa8f 2024-03-02 14:56:49,266 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 862b18df0e2a4531b68923f6b96e8747 2024-03-02 14:56:49,268 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/meta/1588230740/.tmp/info/7d381b42a9a044569b928615c80ee8d7 as hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/meta/1588230740/info/7d381b42a9a044569b928615c80ee8d7 2024-03-02 14:56:49,272 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22271e7ea3c14c91b0e638fb4b56fa8f 2024-03-02 14:56:49,274 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/quota/4c7f546d8e2dbb235856f58354193507/.tmp/q/2a995e6578d442188daeedc07b158769 as hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/quota/4c7f546d8e2dbb235856f58354193507/q/2a995e6578d442188daeedc07b158769 2024-03-02 14:56:49,279 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7d381b42a9a044569b928615c80ee8d7 2024-03-02 14:56:49,279 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/meta/1588230740/info/7d381b42a9a044569b928615c80ee8d7, entries=30, sequenceid=66, filesize=8.0 K 2024-03-02 14:56:49,283 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/meta/1588230740/.tmp/rep_barrier/b9d3cf862eec435c93e4568e062110c8 as hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/meta/1588230740/rep_barrier/b9d3cf862eec435c93e4568e062110c8 2024-03-02 14:56:49,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2a995e6578d442188daeedc07b158769 2024-03-02 14:56:49,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/quota/4c7f546d8e2dbb235856f58354193507/q/2a995e6578d442188daeedc07b158769, entries=5, sequenceid=17, filesize=5.1 K 2024-03-02 14:56:49,289 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/quota/4c7f546d8e2dbb235856f58354193507/.tmp/u/22271e7ea3c14c91b0e638fb4b56fa8f as hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/quota/4c7f546d8e2dbb235856f58354193507/u/22271e7ea3c14c91b0e638fb4b56fa8f 2024-03-02 14:56:49,292 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b9d3cf862eec435c93e4568e062110c8 2024-03-02 14:56:49,292 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/meta/1588230740/rep_barrier/b9d3cf862eec435c93e4568e062110c8, entries=5, sequenceid=66, filesize=5.3 K 2024-03-02 14:56:49,294 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/meta/1588230740/.tmp/table/862b18df0e2a4531b68923f6b96e8747 as hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/meta/1588230740/table/862b18df0e2a4531b68923f6b96e8747 2024-03-02 14:56:49,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 22271e7ea3c14c91b0e638fb4b56fa8f 2024-03-02 14:56:49,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/quota/4c7f546d8e2dbb235856f58354193507/u/22271e7ea3c14c91b0e638fb4b56fa8f, entries=4, sequenceid=17, filesize=5.0 K 2024-03-02 14:56:49,301 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~726 B/726, heapSize ~2.41 KB/2464, currentSize=0 B/0 for 4c7f546d8e2dbb235856f58354193507 in 163ms, sequenceid=17, compaction requested=false 2024-03-02 14:56:49,311 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 862b18df0e2a4531b68923f6b96e8747 2024-03-02 14:56:49,311 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/meta/1588230740/table/862b18df0e2a4531b68923f6b96e8747, entries=13, sequenceid=66, filesize=5.6 K 2024-03-02 14:56:49,313 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~14.15 KB/14494, heapSize ~25.05 KB/25656, currentSize=0 B/0 for 1588230740 in 292ms, sequenceid=66, compaction requested=false 2024-03-02 14:56:49,326 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/quota/4c7f546d8e2dbb235856f58354193507/recovered.edits/20.seqid, newMaxSeqId=20, maxSeqId=1 2024-03-02 14:56:49,327 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/data/hbase/meta/1588230740/recovered.edits/69.seqid, newMaxSeqId=69, maxSeqId=1 2024-03-02 14:56:49,327 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:quota,,1709391342707.4c7f546d8e2dbb235856f58354193507. 2024-03-02 14:56:49,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4c7f546d8e2dbb235856f58354193507: 2024-03-02 14:56:49,328 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:quota,,1709391342707.4c7f546d8e2dbb235856f58354193507. 2024-03-02 14:56:49,328 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-03-02 14:56:49,328 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-03-02 14:56:49,328 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-03-02 14:56:49,328 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2024-03-02 14:56:49,423 INFO [RS:1;jenkins-hbase4:41195] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,41195,1709391340156; all regions closed. 2024-03-02 14:56:49,423 DEBUG [RS:1;jenkins-hbase4:41195] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-03-02 14:56:49,430 DEBUG [RS:1;jenkins-hbase4:41195] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/oldWALs 2024-03-02 14:56:49,430 INFO [RS:1;jenkins-hbase4:41195] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41195%2C1709391340156.meta:.meta(num 1709391341732) 2024-03-02 14:56:49,437 DEBUG [RS:1;jenkins-hbase4:41195] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/oldWALs 2024-03-02 14:56:49,437 INFO [RS:1;jenkins-hbase4:41195] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41195%2C1709391340156:(num 1709391341614) 2024-03-02 14:56:49,437 DEBUG [RS:1;jenkins-hbase4:41195] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-02 14:56:49,437 INFO [RS:1;jenkins-hbase4:41195] regionserver.LeaseManager(133): Closed leases 2024-03-02 14:56:49,438 INFO [RS:1;jenkins-hbase4:41195] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2024-03-02 14:56:49,438 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-03-02 14:56:49,439 INFO [RS:1;jenkins-hbase4:41195] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41195 2024-03-02 14:56:49,442 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-03-02 14:56:49,442 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): regionserver:41195-0x100250aa1ae0002, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41195,1709391340156 2024-03-02 14:56:49,443 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41195,1709391340156] 2024-03-02 14:56:49,443 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41195,1709391340156; numProcessing=2 2024-03-02 14:56:49,444 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41195,1709391340156 already deleted, retry=false 2024-03-02 14:56:49,444 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,41195,1709391340156 expired; onlineServers=0 2024-03-02 14:56:49,444 INFO [RegionServerTracker-0] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,39587,1709391338894' ***** 2024-03-02 14:56:49,444 INFO [RegionServerTracker-0] regionserver.HRegionServer(2313): STOPPED: Cluster shutdown set; onlineServer=0 2024-03-02 14:56:49,445 DEBUG [M:0;jenkins-hbase4:39587] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@297de531, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-03-02 14:56:49,445 INFO [M:0;jenkins-hbase4:39587] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,39587,1709391338894 2024-03-02 14:56:49,445 INFO [M:0;jenkins-hbase4:39587] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,39587,1709391338894; all regions closed. 2024-03-02 14:56:49,446 DEBUG [M:0;jenkins-hbase4:39587] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-02 14:56:49,446 DEBUG [M:0;jenkins-hbase4:39587] cleaner.LogCleaner(198): Cancelling LogCleaner 2024-03-02 14:56:49,446 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2024-03-02 14:56:49,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1709391341243] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1709391341243,5,FailOnTimeoutGroup] 2024-03-02 14:56:49,446 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1709391341245] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1709391341245,5,FailOnTimeoutGroup] 2024-03-02 14:56:49,446 DEBUG [M:0;jenkins-hbase4:39587] cleaner.HFileCleaner(317): Stopping file delete threads 2024-03-02 14:56:49,447 INFO [M:0;jenkins-hbase4:39587] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2024-03-02 14:56:49,447 INFO [M:0;jenkins-hbase4:39587] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2024-03-02 14:56:49,447 INFO [M:0;jenkins-hbase4:39587] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS] on shutdown 2024-03-02 14:56:49,447 DEBUG [M:0;jenkins-hbase4:39587] master.HMaster(1517): Stopping service threads 2024-03-02 14:56:49,447 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2024-03-02 14:56:49,447 INFO [M:0;jenkins-hbase4:39587] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2024-03-02 14:56:49,447 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-02 14:56:49,447 ERROR [M:0;jenkins-hbase4:39587] procedure2.ProcedureExecutor(699): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-8,5,PEWorkerGroup] Thread[HFileArchiver-9,5,PEWorkerGroup] Thread[HFileArchiver-10,5,PEWorkerGroup] Thread[HFileArchiver-11,5,PEWorkerGroup] Thread[HFileArchiver-12,5,PEWorkerGroup] 2024-03-02 14:56:49,448 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-03-02 14:56:49,448 INFO [M:0;jenkins-hbase4:39587] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2024-03-02 14:56:49,448 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2024-03-02 14:56:49,449 DEBUG [M:0;jenkins-hbase4:39587] zookeeper.ZKUtil(399): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2024-03-02 14:56:49,449 WARN [M:0;jenkins-hbase4:39587] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2024-03-02 14:56:49,449 INFO [M:0;jenkins-hbase4:39587] assignment.AssignmentManager(315): Stopping assignment manager 2024-03-02 14:56:49,449 INFO [M:0;jenkins-hbase4:39587] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2024-03-02 14:56:49,450 DEBUG [M:0;jenkins-hbase4:39587] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-03-02 14:56:49,450 INFO [M:0;jenkins-hbase4:39587] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-02 14:56:49,450 DEBUG [M:0;jenkins-hbase4:39587] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-02 14:56:49,450 DEBUG [M:0;jenkins-hbase4:39587] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-03-02 14:56:49,450 DEBUG [M:0;jenkins-hbase4:39587] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-02 14:56:49,450 INFO [M:0;jenkins-hbase4:39587] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=152.93 KB heapSize=184.74 KB 2024-03-02 14:56:49,467 INFO [M:0;jenkins-hbase4:39587] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=152.93 KB at sequenceid=376 (bloomFilter=true), to=hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/45e5526d2ae243d5b0f66895f40ebda0 2024-03-02 14:56:49,474 INFO [M:0;jenkins-hbase4:39587] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 45e5526d2ae243d5b0f66895f40ebda0 2024-03-02 14:56:49,476 DEBUG [M:0;jenkins-hbase4:39587] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/45e5526d2ae243d5b0f66895f40ebda0 as hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/45e5526d2ae243d5b0f66895f40ebda0 2024-03-02 14:56:49,484 INFO [M:0;jenkins-hbase4:39587] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 45e5526d2ae243d5b0f66895f40ebda0 2024-03-02 14:56:49,484 INFO [M:0;jenkins-hbase4:39587] regionserver.HStore(1080): Added hdfs://localhost:37505/user/jenkins/test-data/ce947bdf-8ac2-ec6f-1367-4a78338afce7/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/45e5526d2ae243d5b0f66895f40ebda0, entries=45, sequenceid=376, filesize=12.0 K 2024-03-02 14:56:49,485 INFO [M:0;jenkins-hbase4:39587] regionserver.HRegion(2948): Finished flush of dataSize ~152.93 KB/156602, heapSize ~184.73 KB/189160, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 35ms, sequenceid=376, compaction requested=false 2024-03-02 14:56:49,487 INFO [M:0;jenkins-hbase4:39587] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-02 14:56:49,487 DEBUG [M:0;jenkins-hbase4:39587] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-03-02 14:56:49,492 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-03-02 14:56:49,492 INFO [M:0;jenkins-hbase4:39587] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2024-03-02 14:56:49,492 INFO [M:0;jenkins-hbase4:39587] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39587 2024-03-02 14:56:49,495 DEBUG [M:0;jenkins-hbase4:39587] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39587,1709391338894 already deleted, retry=false 2024-03-02 14:56:49,544 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): regionserver:41195-0x100250aa1ae0002, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-02 14:56:49,544 INFO [RS:1;jenkins-hbase4:41195] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,41195,1709391340156; zookeeper connection closed. 2024-03-02 14:56:49,544 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): regionserver:41195-0x100250aa1ae0002, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-02 14:56:49,544 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3af6a4b4] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3af6a4b4 2024-03-02 14:56:49,545 INFO [Listener at localhost/45685] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2024-03-02 14:56:49,597 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-02 14:56:49,597 INFO [M:0;jenkins-hbase4:39587] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,39587,1709391338894; zookeeper connection closed. 2024-03-02 14:56:49,597 DEBUG [Listener at localhost/45685-EventThread] zookeeper.ZKWatcher(600): master:39587-0x100250aa1ae0000, quorum=127.0.0.1:58480, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-02 14:56:49,599 WARN [Listener at localhost/45685] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-03-02 14:56:49,602 INFO [Listener at localhost/45685] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-03-02 14:56:49,707 WARN [BP-1754136593-172.31.14.131-1709391335824 heartbeating to localhost/127.0.0.1:37505] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-03-02 14:56:49,707 WARN [BP-1754136593-172.31.14.131-1709391335824 heartbeating to localhost/127.0.0.1:37505] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1754136593-172.31.14.131-1709391335824 (Datanode Uuid 60b42497-6431-47ae-b4d0-9b93a6d3af21) service to localhost/127.0.0.1:37505 2024-03-02 14:56:49,709 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/cluster_eba173ae-247f-1258-82b9-7b9b8add7c95/dfs/data/data3/current/BP-1754136593-172.31.14.131-1709391335824] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-03-02 14:56:49,710 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/cluster_eba173ae-247f-1258-82b9-7b9b8add7c95/dfs/data/data4/current/BP-1754136593-172.31.14.131-1709391335824] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-03-02 14:56:49,711 WARN [Listener at localhost/45685] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-03-02 14:56:49,713 INFO [Listener at localhost/45685] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-03-02 14:56:49,817 WARN [BP-1754136593-172.31.14.131-1709391335824 heartbeating to localhost/127.0.0.1:37505] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-03-02 14:56:49,817 WARN [BP-1754136593-172.31.14.131-1709391335824 heartbeating to localhost/127.0.0.1:37505] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1754136593-172.31.14.131-1709391335824 (Datanode Uuid 140be842-71c2-4410-b57d-16a32eda4bc8) service to localhost/127.0.0.1:37505 2024-03-02 14:56:49,818 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/cluster_eba173ae-247f-1258-82b9-7b9b8add7c95/dfs/data/data1/current/BP-1754136593-172.31.14.131-1709391335824] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-03-02 14:56:49,818 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/40093ee5-60a1-3548-d157-6e540ff19494/cluster_eba173ae-247f-1258-82b9-7b9b8add7c95/dfs/data/data2/current/BP-1754136593-172.31.14.131-1709391335824] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-03-02 14:56:49,865 INFO [Listener at localhost/45685] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-03-02 14:56:49,986 INFO [Listener at localhost/45685] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2024-03-02 14:56:50,040 INFO [Listener at localhost/45685] hbase.HBaseTestingUtility(1293): Minicluster is down