2024-03-30 15:56:01,114 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle timeout: 13 mins 2024-03-30 15:56:01,354 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1 2024-03-30 15:56:01,368 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2024-03-30 15:56:01,369 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/cluster_12dd9d10-0619-2559-0263-7898b1180b87, deleteOnExit=true 2024-03-30 15:56:01,369 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2024-03-30 15:56:01,369 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/test.cache.data in system properties and HBase conf 2024-03-30 15:56:01,370 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/hadoop.tmp.dir in system properties and HBase conf 2024-03-30 15:56:01,370 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/hadoop.log.dir in system properties and HBase conf 2024-03-30 15:56:01,371 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/mapreduce.cluster.local.dir in system properties and HBase conf 2024-03-30 15:56:01,371 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/mapreduce.cluster.temp.dir in system properties and HBase conf 2024-03-30 15:56:01,371 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2024-03-30 15:56:01,491 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2024-03-30 15:56:01,874 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-03-30 15:56:01,879 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2024-03-30 15:56:01,879 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2024-03-30 15:56:01,879 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/yarn.nodemanager.log-dirs in system properties and HBase conf 2024-03-30 15:56:01,880 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-03-30 15:56:01,880 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2024-03-30 15:56:01,880 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2024-03-30 15:56:01,880 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-03-30 15:56:01,881 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/dfs.journalnode.edits.dir in system properties and HBase conf 2024-03-30 15:56:01,881 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2024-03-30 15:56:01,881 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/nfs.dump.dir in system properties and HBase conf 2024-03-30 15:56:01,882 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/java.io.tmpdir in system properties and HBase conf 2024-03-30 15:56:01,882 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/dfs.journalnode.edits.dir in system properties and HBase conf 2024-03-30 15:56:01,882 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2024-03-30 15:56:01,882 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2024-03-30 15:56:02,414 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-03-30 15:56:02,420 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-03-30 15:56:02,722 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2024-03-30 15:56:02,894 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2024-03-30 15:56:02,911 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-03-30 15:56:02,949 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2024-03-30 15:56:02,984 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/java.io.tmpdir/Jetty_localhost_40681_hdfs____ng1ffh/webapp 2024-03-30 15:56:03,121 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40681 2024-03-30 15:56:03,131 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-03-30 15:56:03,131 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-03-30 15:56:03,603 WARN [Listener at localhost/33283] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-03-30 15:56:03,680 WARN [Listener at localhost/33283] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-03-30 15:56:03,702 WARN [Listener at localhost/33283] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-03-30 15:56:03,709 INFO [Listener at localhost/33283] log.Slf4jLog(67): jetty-6.1.26 2024-03-30 15:56:03,714 INFO [Listener at localhost/33283] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/java.io.tmpdir/Jetty_localhost_37957_datanode____98puse/webapp 2024-03-30 15:56:03,812 INFO [Listener at localhost/33283] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37957 2024-03-30 15:56:04,137 WARN [Listener at localhost/43301] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-03-30 15:56:04,157 WARN [Listener at localhost/43301] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-03-30 15:56:04,161 WARN [Listener at localhost/43301] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-03-30 15:56:04,163 INFO [Listener at localhost/43301] log.Slf4jLog(67): jetty-6.1.26 2024-03-30 15:56:04,174 INFO [Listener at localhost/43301] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/java.io.tmpdir/Jetty_localhost_44065_datanode____.o13jmy/webapp 2024-03-30 15:56:04,274 INFO [Listener at localhost/43301] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44065 2024-03-30 15:56:04,286 WARN [Listener at localhost/42871] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-03-30 15:56:04,592 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x96e36a983ce735de: Processing first storage report for DS-5614b7b1-7bb4-4ee5-a93d-a87c8bf98c3f from datanode 6063bd69-f875-47e6-b01c-c4405ca17ad4 2024-03-30 15:56:04,594 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x96e36a983ce735de: from storage DS-5614b7b1-7bb4-4ee5-a93d-a87c8bf98c3f node DatanodeRegistration(127.0.0.1:45369, datanodeUuid=6063bd69-f875-47e6-b01c-c4405ca17ad4, infoPort=44047, infoSecurePort=0, ipcPort=42871, storageInfo=lv=-57;cid=testClusterID;nsid=550523082;c=1711814162497), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2024-03-30 15:56:04,594 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa76e1ea2c9ae61cc: Processing first storage report for DS-21596dbc-e238-4429-902c-5a614bf47c0a from datanode 4a07a617-95ee-4379-8aa4-5e0d9f6998e7 2024-03-30 15:56:04,594 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa76e1ea2c9ae61cc: from storage DS-21596dbc-e238-4429-902c-5a614bf47c0a node DatanodeRegistration(127.0.0.1:41573, datanodeUuid=4a07a617-95ee-4379-8aa4-5e0d9f6998e7, infoPort=35933, infoSecurePort=0, ipcPort=43301, storageInfo=lv=-57;cid=testClusterID;nsid=550523082;c=1711814162497), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2024-03-30 15:56:04,594 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x96e36a983ce735de: Processing first storage report for DS-489d89b0-d086-4d5b-aab8-03597dd3303b from datanode 6063bd69-f875-47e6-b01c-c4405ca17ad4 2024-03-30 15:56:04,594 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x96e36a983ce735de: from storage DS-489d89b0-d086-4d5b-aab8-03597dd3303b node DatanodeRegistration(127.0.0.1:45369, datanodeUuid=6063bd69-f875-47e6-b01c-c4405ca17ad4, infoPort=44047, infoSecurePort=0, ipcPort=42871, storageInfo=lv=-57;cid=testClusterID;nsid=550523082;c=1711814162497), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-03-30 15:56:04,594 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa76e1ea2c9ae61cc: Processing first storage report for DS-6840e93c-3f17-4163-a77b-ba655a65f795 from datanode 4a07a617-95ee-4379-8aa4-5e0d9f6998e7 2024-03-30 15:56:04,595 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa76e1ea2c9ae61cc: from storage DS-6840e93c-3f17-4163-a77b-ba655a65f795 node DatanodeRegistration(127.0.0.1:41573, datanodeUuid=4a07a617-95ee-4379-8aa4-5e0d9f6998e7, infoPort=35933, infoSecurePort=0, ipcPort=43301, storageInfo=lv=-57;cid=testClusterID;nsid=550523082;c=1711814162497), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-03-30 15:56:04,680 DEBUG [Listener at localhost/42871] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1 2024-03-30 15:56:04,791 INFO [Listener at localhost/42871] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/cluster_12dd9d10-0619-2559-0263-7898b1180b87/zookeeper_0, clientPort=60178, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/cluster_12dd9d10-0619-2559-0263-7898b1180b87/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/cluster_12dd9d10-0619-2559-0263-7898b1180b87/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2024-03-30 15:56:04,808 INFO [Listener at localhost/42871] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60178 2024-03-30 15:56:04,816 INFO [Listener at localhost/42871] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-30 15:56:04,818 INFO [Listener at localhost/42871] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-30 15:56:05,499 INFO [Listener at localhost/42871] util.FSUtils(471): Created version file at hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e with version=8 2024-03-30 15:56:05,499 INFO [Listener at localhost/42871] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/hbase-staging 2024-03-30 15:56:05,824 INFO [Listener at localhost/42871] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2024-03-30 15:56:06,294 INFO [Listener at localhost/42871] client.ConnectionUtils(126): master/jenkins-hbase4:0 server-side Connection retries=45 2024-03-30 15:56:06,329 INFO [Listener at localhost/42871] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-30 15:56:06,329 INFO [Listener at localhost/42871] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-03-30 15:56:06,330 INFO [Listener at localhost/42871] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-03-30 15:56:06,330 INFO [Listener at localhost/42871] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-30 15:56:06,330 INFO [Listener at localhost/42871] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-03-30 15:56:06,487 INFO [Listener at localhost/42871] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2024-03-30 15:56:06,569 DEBUG [Listener at localhost/42871] util.ClassSize(228): Using Unsafe to estimate memory layout 2024-03-30 15:56:06,684 INFO [Listener at localhost/42871] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37483 2024-03-30 15:56:06,695 INFO [Listener at localhost/42871] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-30 15:56:06,698 INFO [Listener at localhost/42871] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-30 15:56:06,720 INFO [Listener at localhost/42871] zookeeper.RecoverableZooKeeper(93): Process identifier=master:37483 connecting to ZooKeeper ensemble=127.0.0.1:60178 2024-03-30 15:56:06,765 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:374830x0, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-03-30 15:56:06,767 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:37483-0x100b57408a30000 connected 2024-03-30 15:56:06,805 DEBUG [Listener at localhost/42871] zookeeper.ZKUtil(165): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-03-30 15:56:06,806 DEBUG [Listener at localhost/42871] zookeeper.ZKUtil(165): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-30 15:56:06,810 DEBUG [Listener at localhost/42871] zookeeper.ZKUtil(165): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-03-30 15:56:06,819 DEBUG [Listener at localhost/42871] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37483 2024-03-30 15:56:06,819 DEBUG [Listener at localhost/42871] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37483 2024-03-30 15:56:06,820 DEBUG [Listener at localhost/42871] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37483 2024-03-30 15:56:06,820 DEBUG [Listener at localhost/42871] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37483 2024-03-30 15:56:06,821 DEBUG [Listener at localhost/42871] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37483 2024-03-30 15:56:06,827 INFO [Listener at localhost/42871] master.HMaster(445): hbase.rootdir=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e, hbase.cluster.distributed=false 2024-03-30 15:56:06,901 INFO [Listener at localhost/42871] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-03-30 15:56:06,901 INFO [Listener at localhost/42871] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-30 15:56:06,901 INFO [Listener at localhost/42871] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-03-30 15:56:06,901 INFO [Listener at localhost/42871] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-03-30 15:56:06,901 INFO [Listener at localhost/42871] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-30 15:56:06,902 INFO [Listener at localhost/42871] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-03-30 15:56:06,907 INFO [Listener at localhost/42871] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-03-30 15:56:06,910 INFO [Listener at localhost/42871] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44765 2024-03-30 15:56:06,912 INFO [Listener at localhost/42871] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-03-30 15:56:06,918 DEBUG [Listener at localhost/42871] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-03-30 15:56:06,919 INFO [Listener at localhost/42871] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-30 15:56:06,921 INFO [Listener at localhost/42871] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-30 15:56:06,923 INFO [Listener at localhost/42871] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44765 connecting to ZooKeeper ensemble=127.0.0.1:60178 2024-03-30 15:56:06,928 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): regionserver:447650x0, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-03-30 15:56:06,928 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44765-0x100b57408a30001 connected 2024-03-30 15:56:06,929 DEBUG [Listener at localhost/42871] zookeeper.ZKUtil(165): regionserver:44765-0x100b57408a30001, quorum=127.0.0.1:60178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-03-30 15:56:06,930 DEBUG [Listener at localhost/42871] zookeeper.ZKUtil(165): regionserver:44765-0x100b57408a30001, quorum=127.0.0.1:60178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-30 15:56:06,931 DEBUG [Listener at localhost/42871] zookeeper.ZKUtil(165): regionserver:44765-0x100b57408a30001, quorum=127.0.0.1:60178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-03-30 15:56:06,932 DEBUG [Listener at localhost/42871] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44765 2024-03-30 15:56:06,932 DEBUG [Listener at localhost/42871] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44765 2024-03-30 15:56:06,933 DEBUG [Listener at localhost/42871] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44765 2024-03-30 15:56:06,936 DEBUG [Listener at localhost/42871] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44765 2024-03-30 15:56:06,936 DEBUG [Listener at localhost/42871] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44765 2024-03-30 15:56:06,950 INFO [Listener at localhost/42871] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-03-30 15:56:06,950 INFO [Listener at localhost/42871] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-30 15:56:06,950 INFO [Listener at localhost/42871] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-03-30 15:56:06,951 INFO [Listener at localhost/42871] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-03-30 15:56:06,951 INFO [Listener at localhost/42871] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-30 15:56:06,951 INFO [Listener at localhost/42871] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-03-30 15:56:06,952 INFO [Listener at localhost/42871] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-03-30 15:56:06,954 INFO [Listener at localhost/42871] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43311 2024-03-30 15:56:06,954 INFO [Listener at localhost/42871] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-03-30 15:56:06,956 DEBUG [Listener at localhost/42871] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-03-30 15:56:06,956 INFO [Listener at localhost/42871] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-30 15:56:06,958 INFO [Listener at localhost/42871] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-30 15:56:06,960 INFO [Listener at localhost/42871] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43311 connecting to ZooKeeper ensemble=127.0.0.1:60178 2024-03-30 15:56:06,965 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): regionserver:433110x0, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-03-30 15:56:06,966 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43311-0x100b57408a30002 connected 2024-03-30 15:56:06,966 DEBUG [Listener at localhost/42871] zookeeper.ZKUtil(165): regionserver:43311-0x100b57408a30002, quorum=127.0.0.1:60178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-03-30 15:56:06,967 DEBUG [Listener at localhost/42871] zookeeper.ZKUtil(165): regionserver:43311-0x100b57408a30002, quorum=127.0.0.1:60178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-30 15:56:06,968 DEBUG [Listener at localhost/42871] zookeeper.ZKUtil(165): regionserver:43311-0x100b57408a30002, quorum=127.0.0.1:60178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-03-30 15:56:06,968 DEBUG [Listener at localhost/42871] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43311 2024-03-30 15:56:06,969 DEBUG [Listener at localhost/42871] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43311 2024-03-30 15:56:06,969 DEBUG [Listener at localhost/42871] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43311 2024-03-30 15:56:06,972 DEBUG [Listener at localhost/42871] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43311 2024-03-30 15:56:06,973 DEBUG [Listener at localhost/42871] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43311 2024-03-30 15:56:06,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2174): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,37483,1711814165652 2024-03-30 15:56:06,984 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-03-30 15:56:06,986 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,37483,1711814165652 2024-03-30 15:56:07,008 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-03-30 15:56:07,008 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): regionserver:43311-0x100b57408a30002, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-03-30 15:56:07,008 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): regionserver:44765-0x100b57408a30001, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-03-30 15:56:07,009 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-30 15:56:07,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-03-30 15:56:07,012 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(163): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-03-30 15:56:07,013 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,37483,1711814165652 from backup master directory 2024-03-30 15:56:07,017 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,37483,1711814165652 2024-03-30 15:56:07,017 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-03-30 15:56:07,018 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-03-30 15:56:07,018 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,37483,1711814165652 2024-03-30 15:56:07,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2024-03-30 15:56:07,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2024-03-30 15:56:07,113 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/hbase.id with ID: 9d9ec47b-4963-4461-bd5f-13d05d63bd32 2024-03-30 15:56:07,158 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-30 15:56:07,175 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-30 15:56:07,221 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7e01aae0 to 127.0.0.1:60178 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-03-30 15:56:07,256 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b8bec66, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-03-30 15:56:07,279 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-30 15:56:07,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2024-03-30 15:56:07,299 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2024-03-30 15:56:07,299 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2024-03-30 15:56:07,301 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-03-30 15:56:07,306 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-03-30 15:56:07,308 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-03-30 15:56:07,343 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/MasterData/data/master/store-tmp 2024-03-30 15:56:07,377 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-30 15:56:07,378 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-03-30 15:56:07,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-30 15:56:07,378 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-30 15:56:07,378 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-03-30 15:56:07,378 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-30 15:56:07,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-30 15:56:07,378 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-03-30 15:56:07,380 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/MasterData/WALs/jenkins-hbase4.apache.org,37483,1711814165652 2024-03-30 15:56:07,402 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(492): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37483%2C1711814165652, suffix=, logDir=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/MasterData/WALs/jenkins-hbase4.apache.org,37483,1711814165652, archiveDir=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/MasterData/oldWALs, maxLogs=10 2024-03-30 15:56:07,479 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41573,DS-21596dbc-e238-4429-902c-5a614bf47c0a,DISK] 2024-03-30 15:56:07,479 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45369,DS-5614b7b1-7bb4-4ee5-a93d-a87c8bf98c3f,DISK] 2024-03-30 15:56:07,488 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2024-03-30 15:56:07,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(809): New WAL /user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/MasterData/WALs/jenkins-hbase4.apache.org,37483,1711814165652/jenkins-hbase4.apache.org%2C37483%2C1711814165652.1711814167413 2024-03-30 15:56:07,565 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(890): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45369,DS-5614b7b1-7bb4-4ee5-a93d-a87c8bf98c3f,DISK], DatanodeInfoWithStorage[127.0.0.1:41573,DS-21596dbc-e238-4429-902c-5a614bf47c0a,DISK]] 2024-03-30 15:56:07,565 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2024-03-30 15:56:07,565 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-30 15:56:07,569 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2024-03-30 15:56:07,570 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2024-03-30 15:56:07,629 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2024-03-30 15:56:07,637 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2024-03-30 15:56:07,662 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2024-03-30 15:56:07,674 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-30 15:56:07,681 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-03-30 15:56:07,683 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-03-30 15:56:07,702 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2024-03-30 15:56:07,707 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-30 15:56:07,708 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59295088, jitterRate=-0.11643433570861816}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-30 15:56:07,708 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2024-03-30 15:56:07,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2024-03-30 15:56:07,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2024-03-30 15:56:07,730 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(608): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2024-03-30 15:56:07,732 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2024-03-30 15:56:07,734 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(628): Recovered RegionProcedureStore lease in 1 msec 2024-03-30 15:56:07,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(642): Loaded RegionProcedureStore in 33 msec 2024-03-30 15:56:07,768 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2024-03-30 15:56:07,794 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2024-03-30 15:56:07,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2024-03-30 15:56:07,824 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2024-03-30 15:56:07,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2024-03-30 15:56:07,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2024-03-30 15:56:07,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2024-03-30 15:56:07,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2024-03-30 15:56:07,847 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-30 15:56:07,848 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2024-03-30 15:56:07,849 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2024-03-30 15:56:07,861 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2024-03-30 15:56:07,866 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): regionserver:43311-0x100b57408a30002, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-03-30 15:56:07,866 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): regionserver:44765-0x100b57408a30001, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-03-30 15:56:07,866 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-03-30 15:56:07,866 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-30 15:56:07,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(745): Active/primary master=jenkins-hbase4.apache.org,37483,1711814165652, sessionid=0x100b57408a30000, setting cluster-up flag (Was=false) 2024-03-30 15:56:07,884 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-30 15:56:07,891 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2024-03-30 15:56:07,893 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37483,1711814165652 2024-03-30 15:56:07,899 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-30 15:56:07,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2024-03-30 15:56:07,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,37483,1711814165652 2024-03-30 15:56:07,910 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.hbase-snapshot/.tmp 2024-03-30 15:56:07,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver loaded, priority=536870911. 2024-03-30 15:56:07,977 INFO [RS:0;jenkins-hbase4:44765] regionserver.HRegionServer(954): ClusterId : 9d9ec47b-4963-4461-bd5f-13d05d63bd32 2024-03-30 15:56:07,977 INFO [RS:1;jenkins-hbase4:43311] regionserver.HRegionServer(954): ClusterId : 9d9ec47b-4963-4461-bd5f-13d05d63bd32 2024-03-30 15:56:07,982 DEBUG [RS:0;jenkins-hbase4:44765] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-03-30 15:56:07,982 DEBUG [RS:1;jenkins-hbase4:43311] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-03-30 15:56:07,989 DEBUG [RS:0;jenkins-hbase4:44765] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-03-30 15:56:07,989 DEBUG [RS:1;jenkins-hbase4:43311] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-03-30 15:56:07,989 DEBUG [RS:0;jenkins-hbase4:44765] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-03-30 15:56:07,989 DEBUG [RS:1;jenkins-hbase4:43311] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-03-30 15:56:07,994 DEBUG [RS:0;jenkins-hbase4:44765] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-03-30 15:56:07,995 DEBUG [RS:1;jenkins-hbase4:43311] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-03-30 15:56:07,996 DEBUG [RS:0;jenkins-hbase4:44765] zookeeper.ReadOnlyZKClient(139): Connect 0x4b93e7e9 to 127.0.0.1:60178 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-03-30 15:56:07,998 DEBUG [RS:1;jenkins-hbase4:43311] zookeeper.ReadOnlyZKClient(139): Connect 0x0011eb06 to 127.0.0.1:60178 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-03-30 15:56:08,003 DEBUG [RS:0;jenkins-hbase4:44765] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@455400eb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-03-30 15:56:08,004 DEBUG [RS:1;jenkins-hbase4:43311] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ed60574, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-03-30 15:56:08,004 DEBUG [RS:0;jenkins-hbase4:44765] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@416b8c99, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-03-30 15:56:08,004 DEBUG [RS:1;jenkins-hbase4:43311] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@ae98076, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-03-30 15:56:08,037 DEBUG [RS:0;jenkins-hbase4:44765] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:44765 2024-03-30 15:56:08,038 DEBUG [RS:1;jenkins-hbase4:43311] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43311 2024-03-30 15:56:08,042 INFO [RS:0;jenkins-hbase4:44765] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-03-30 15:56:08,042 INFO [RS:0;jenkins-hbase4:44765] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-03-30 15:56:08,042 INFO [RS:1;jenkins-hbase4:43311] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-03-30 15:56:08,043 INFO [RS:1;jenkins-hbase4:43311] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-03-30 15:56:08,042 DEBUG [RS:0;jenkins-hbase4:44765] regionserver.HRegionServer(1025): About to register with Master. 2024-03-30 15:56:08,043 DEBUG [RS:1;jenkins-hbase4:43311] regionserver.HRegionServer(1025): About to register with Master. 2024-03-30 15:56:08,043 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2024-03-30 15:56:08,046 INFO [RS:0;jenkins-hbase4:44765] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase4.apache.org,37483,1711814165652 with isa=jenkins-hbase4.apache.org/172.31.14.131:44765, startcode=1711814166900 2024-03-30 15:56:08,046 INFO [RS:1;jenkins-hbase4:43311] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase4.apache.org,37483,1711814165652 with isa=jenkins-hbase4.apache.org/172.31.14.131:43311, startcode=1711814166949 2024-03-30 15:56:08,055 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-03-30 15:56:08,055 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-03-30 15:56:08,056 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-03-30 15:56:08,056 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-03-30 15:56:08,056 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2024-03-30 15:56:08,056 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-30 15:56:08,056 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-03-30 15:56:08,056 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-30 15:56:08,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1711814198058 2024-03-30 15:56:08,061 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2024-03-30 15:56:08,065 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2024-03-30 15:56:08,065 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2024-03-30 15:56:08,065 DEBUG [RS:1;jenkins-hbase4:43311] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-03-30 15:56:08,065 DEBUG [RS:0;jenkins-hbase4:44765] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-03-30 15:56:08,072 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-03-30 15:56:08,074 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2024-03-30 15:56:08,081 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2024-03-30 15:56:08,082 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2024-03-30 15:56:08,082 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2024-03-30 15:56:08,082 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2024-03-30 15:56:08,083 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:08,086 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2024-03-30 15:56:08,088 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2024-03-30 15:56:08,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2024-03-30 15:56:08,093 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2024-03-30 15:56:08,094 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2024-03-30 15:56:08,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1711814168096,5,FailOnTimeoutGroup] 2024-03-30 15:56:08,101 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1711814168101,5,FailOnTimeoutGroup] 2024-03-30 15:56:08,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:08,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1466): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2024-03-30 15:56:08,103 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:08,103 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:08,121 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-03-30 15:56:08,122 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-03-30 15:56:08,123 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e 2024-03-30 15:56:08,128 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51465, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2024-03-30 15:56:08,128 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38109, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2024-03-30 15:56:08,149 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37483] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,43311,1711814166949 2024-03-30 15:56:08,151 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-30 15:56:08,154 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-03-30 15:56:08,157 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/meta/1588230740/info 2024-03-30 15:56:08,158 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-03-30 15:56:08,159 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-30 15:56:08,159 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-03-30 15:56:08,161 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=37483] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,44765,1711814166900 2024-03-30 15:56:08,164 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/meta/1588230740/rep_barrier 2024-03-30 15:56:08,165 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-03-30 15:56:08,166 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-30 15:56:08,166 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-03-30 15:56:08,168 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/meta/1588230740/table 2024-03-30 15:56:08,169 DEBUG [RS:1;jenkins-hbase4:43311] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e 2024-03-30 15:56:08,169 DEBUG [RS:0;jenkins-hbase4:44765] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e 2024-03-30 15:56:08,169 DEBUG [RS:1;jenkins-hbase4:43311] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:33283 2024-03-30 15:56:08,169 DEBUG [RS:0;jenkins-hbase4:44765] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:33283 2024-03-30 15:56:08,169 DEBUG [RS:1;jenkins-hbase4:43311] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-03-30 15:56:08,170 DEBUG [RS:0;jenkins-hbase4:44765] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-03-30 15:56:08,170 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-03-30 15:56:08,171 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-30 15:56:08,172 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/meta/1588230740 2024-03-30 15:56:08,173 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/meta/1588230740 2024-03-30 15:56:08,178 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-03-30 15:56:08,178 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-03-30 15:56:08,179 DEBUG [RS:0;jenkins-hbase4:44765] zookeeper.ZKUtil(163): regionserver:44765-0x100b57408a30001, quorum=127.0.0.1:60178, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44765,1711814166900 2024-03-30 15:56:08,179 DEBUG [RS:1;jenkins-hbase4:43311] zookeeper.ZKUtil(163): regionserver:43311-0x100b57408a30002, quorum=127.0.0.1:60178, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43311,1711814166949 2024-03-30 15:56:08,181 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2024-03-30 15:56:08,179 WARN [RS:0;jenkins-hbase4:44765] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-03-30 15:56:08,180 WARN [RS:1;jenkins-hbase4:43311] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-03-30 15:56:08,183 INFO [RS:0;jenkins-hbase4:44765] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-03-30 15:56:08,183 INFO [RS:1;jenkins-hbase4:43311] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-03-30 15:56:08,184 DEBUG [RS:0;jenkins-hbase4:44765] regionserver.HRegionServer(1950): logDir=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/WALs/jenkins-hbase4.apache.org,44765,1711814166900 2024-03-30 15:56:08,184 DEBUG [RS:1;jenkins-hbase4:43311] regionserver.HRegionServer(1950): logDir=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/WALs/jenkins-hbase4.apache.org,43311,1711814166949 2024-03-30 15:56:08,185 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44765,1711814166900] 2024-03-30 15:56:08,185 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43311,1711814166949] 2024-03-30 15:56:08,188 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-30 15:56:08,190 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68727438, jitterRate=0.024118632078170776}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-03-30 15:56:08,190 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2024-03-30 15:56:08,190 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-03-30 15:56:08,190 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-03-30 15:56:08,190 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-03-30 15:56:08,190 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-03-30 15:56:08,190 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-03-30 15:56:08,192 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-03-30 15:56:08,192 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-03-30 15:56:08,196 DEBUG [RS:1;jenkins-hbase4:43311] zookeeper.ZKUtil(163): regionserver:43311-0x100b57408a30002, quorum=127.0.0.1:60178, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44765,1711814166900 2024-03-30 15:56:08,196 DEBUG [RS:0;jenkins-hbase4:44765] zookeeper.ZKUtil(163): regionserver:44765-0x100b57408a30001, quorum=127.0.0.1:60178, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44765,1711814166900 2024-03-30 15:56:08,197 DEBUG [RS:1;jenkins-hbase4:43311] zookeeper.ZKUtil(163): regionserver:43311-0x100b57408a30002, quorum=127.0.0.1:60178, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43311,1711814166949 2024-03-30 15:56:08,197 DEBUG [RS:0;jenkins-hbase4:44765] zookeeper.ZKUtil(163): regionserver:44765-0x100b57408a30001, quorum=127.0.0.1:60178, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43311,1711814166949 2024-03-30 15:56:08,198 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2024-03-30 15:56:08,198 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2024-03-30 15:56:08,206 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2024-03-30 15:56:08,208 DEBUG [RS:0;jenkins-hbase4:44765] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-03-30 15:56:08,208 DEBUG [RS:1;jenkins-hbase4:43311] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-03-30 15:56:08,217 INFO [RS:0;jenkins-hbase4:44765] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-03-30 15:56:08,217 INFO [RS:1;jenkins-hbase4:43311] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-03-30 15:56:08,219 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2024-03-30 15:56:08,222 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2024-03-30 15:56:08,236 INFO [RS:0;jenkins-hbase4:44765] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-03-30 15:56:08,236 INFO [RS:1;jenkins-hbase4:43311] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-03-30 15:56:08,240 INFO [RS:0;jenkins-hbase4:44765] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-03-30 15:56:08,240 INFO [RS:1;jenkins-hbase4:43311] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-03-30 15:56:08,240 INFO [RS:0;jenkins-hbase4:44765] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:08,240 INFO [RS:1;jenkins-hbase4:43311] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:08,241 INFO [RS:0;jenkins-hbase4:44765] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-03-30 15:56:08,241 INFO [RS:1;jenkins-hbase4:43311] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-03-30 15:56:08,250 INFO [RS:0;jenkins-hbase4:44765] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:08,250 INFO [RS:1;jenkins-hbase4:43311] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:08,250 DEBUG [RS:0;jenkins-hbase4:44765] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-30 15:56:08,250 DEBUG [RS:1;jenkins-hbase4:43311] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-30 15:56:08,251 DEBUG [RS:0;jenkins-hbase4:44765] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-30 15:56:08,251 DEBUG [RS:1;jenkins-hbase4:43311] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-30 15:56:08,251 DEBUG [RS:0;jenkins-hbase4:44765] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-30 15:56:08,251 DEBUG [RS:1;jenkins-hbase4:43311] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-30 15:56:08,251 DEBUG [RS:0;jenkins-hbase4:44765] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-30 15:56:08,251 DEBUG [RS:1;jenkins-hbase4:43311] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-30 15:56:08,251 DEBUG [RS:0;jenkins-hbase4:44765] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-30 15:56:08,251 DEBUG [RS:1;jenkins-hbase4:43311] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-30 15:56:08,251 DEBUG [RS:0;jenkins-hbase4:44765] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-03-30 15:56:08,251 DEBUG [RS:1;jenkins-hbase4:43311] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-03-30 15:56:08,251 DEBUG [RS:0;jenkins-hbase4:44765] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-30 15:56:08,252 DEBUG [RS:1;jenkins-hbase4:43311] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-30 15:56:08,252 DEBUG [RS:0;jenkins-hbase4:44765] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-30 15:56:08,252 DEBUG [RS:1;jenkins-hbase4:43311] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-30 15:56:08,252 DEBUG [RS:0;jenkins-hbase4:44765] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-30 15:56:08,252 DEBUG [RS:1;jenkins-hbase4:43311] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-30 15:56:08,252 DEBUG [RS:0;jenkins-hbase4:44765] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-30 15:56:08,252 DEBUG [RS:1;jenkins-hbase4:43311] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-30 15:56:08,253 INFO [RS:1;jenkins-hbase4:43311] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:08,253 INFO [RS:0;jenkins-hbase4:44765] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:08,253 INFO [RS:1;jenkins-hbase4:43311] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:08,254 INFO [RS:0;jenkins-hbase4:44765] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:08,254 INFO [RS:1;jenkins-hbase4:43311] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:08,254 INFO [RS:0;jenkins-hbase4:44765] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:08,254 INFO [RS:1;jenkins-hbase4:43311] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:08,254 INFO [RS:0;jenkins-hbase4:44765] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:08,270 INFO [RS:0;jenkins-hbase4:44765] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-03-30 15:56:08,270 INFO [RS:1;jenkins-hbase4:43311] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-03-30 15:56:08,273 INFO [RS:1;jenkins-hbase4:43311] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43311,1711814166949-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:08,273 INFO [RS:0;jenkins-hbase4:44765] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44765,1711814166900-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:08,291 INFO [RS:1;jenkins-hbase4:43311] regionserver.Replication(203): jenkins-hbase4.apache.org,43311,1711814166949 started 2024-03-30 15:56:08,291 INFO [RS:0;jenkins-hbase4:44765] regionserver.Replication(203): jenkins-hbase4.apache.org,44765,1711814166900 started 2024-03-30 15:56:08,291 INFO [RS:1;jenkins-hbase4:43311] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,43311,1711814166949, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43311, sessionid=0x100b57408a30002 2024-03-30 15:56:08,291 INFO [RS:0;jenkins-hbase4:44765] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,44765,1711814166900, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44765, sessionid=0x100b57408a30001 2024-03-30 15:56:08,291 DEBUG [RS:1;jenkins-hbase4:43311] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-03-30 15:56:08,291 DEBUG [RS:0;jenkins-hbase4:44765] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-03-30 15:56:08,292 DEBUG [RS:1;jenkins-hbase4:43311] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43311,1711814166949 2024-03-30 15:56:08,292 DEBUG [RS:0;jenkins-hbase4:44765] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44765,1711814166900 2024-03-30 15:56:08,292 DEBUG [RS:1;jenkins-hbase4:43311] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43311,1711814166949' 2024-03-30 15:56:08,292 DEBUG [RS:0;jenkins-hbase4:44765] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44765,1711814166900' 2024-03-30 15:56:08,293 DEBUG [RS:0;jenkins-hbase4:44765] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-03-30 15:56:08,293 DEBUG [RS:1;jenkins-hbase4:43311] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-03-30 15:56:08,294 DEBUG [RS:0;jenkins-hbase4:44765] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-03-30 15:56:08,294 DEBUG [RS:1;jenkins-hbase4:43311] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-03-30 15:56:08,294 DEBUG [RS:0;jenkins-hbase4:44765] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-03-30 15:56:08,295 DEBUG [RS:0;jenkins-hbase4:44765] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-03-30 15:56:08,295 DEBUG [RS:1;jenkins-hbase4:43311] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-03-30 15:56:08,295 DEBUG [RS:0;jenkins-hbase4:44765] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44765,1711814166900 2024-03-30 15:56:08,295 DEBUG [RS:1;jenkins-hbase4:43311] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-03-30 15:56:08,295 DEBUG [RS:0;jenkins-hbase4:44765] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44765,1711814166900' 2024-03-30 15:56:08,295 DEBUG [RS:0;jenkins-hbase4:44765] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-03-30 15:56:08,295 DEBUG [RS:1;jenkins-hbase4:43311] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43311,1711814166949 2024-03-30 15:56:08,295 DEBUG [RS:1;jenkins-hbase4:43311] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43311,1711814166949' 2024-03-30 15:56:08,295 DEBUG [RS:1;jenkins-hbase4:43311] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-03-30 15:56:08,296 DEBUG [RS:0;jenkins-hbase4:44765] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-03-30 15:56:08,296 DEBUG [RS:1;jenkins-hbase4:43311] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-03-30 15:56:08,296 DEBUG [RS:0;jenkins-hbase4:44765] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-03-30 15:56:08,297 INFO [RS:0;jenkins-hbase4:44765] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-03-30 15:56:08,297 DEBUG [RS:1;jenkins-hbase4:43311] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-03-30 15:56:08,297 INFO [RS:1;jenkins-hbase4:43311] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-03-30 15:56:08,299 INFO [RS:1;jenkins-hbase4:43311] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:08,299 INFO [RS:0;jenkins-hbase4:44765] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:08,299 DEBUG [RS:0;jenkins-hbase4:44765] zookeeper.ZKUtil(399): regionserver:44765-0x100b57408a30001, quorum=127.0.0.1:60178, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-03-30 15:56:08,299 DEBUG [RS:1;jenkins-hbase4:43311] zookeeper.ZKUtil(399): regionserver:43311-0x100b57408a30002, quorum=127.0.0.1:60178, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-03-30 15:56:08,299 INFO [RS:0;jenkins-hbase4:44765] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-03-30 15:56:08,300 INFO [RS:1;jenkins-hbase4:43311] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-03-30 15:56:08,300 INFO [RS:1;jenkins-hbase4:43311] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:08,300 INFO [RS:0;jenkins-hbase4:44765] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:08,300 INFO [RS:0;jenkins-hbase4:44765] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:08,300 INFO [RS:1;jenkins-hbase4:43311] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:08,374 DEBUG [jenkins-hbase4:37483] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=2, allServersCount=2 2024-03-30 15:56:08,377 DEBUG [jenkins-hbase4:37483] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-30 15:56:08,384 DEBUG [jenkins-hbase4:37483] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-30 15:56:08,384 DEBUG [jenkins-hbase4:37483] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-30 15:56:08,384 DEBUG [jenkins-hbase4:37483] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-30 15:56:08,387 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44765,1711814166900, state=OPENING 2024-03-30 15:56:08,395 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2024-03-30 15:56:08,396 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-30 15:56:08,397 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-03-30 15:56:08,401 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44765,1711814166900}] 2024-03-30 15:56:08,413 INFO [RS:1;jenkins-hbase4:43311] wal.AbstractFSWAL(492): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43311%2C1711814166949, suffix=, logDir=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/WALs/jenkins-hbase4.apache.org,43311,1711814166949, archiveDir=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/oldWALs, maxLogs=32 2024-03-30 15:56:08,413 INFO [RS:0;jenkins-hbase4:44765] wal.AbstractFSWAL(492): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44765%2C1711814166900, suffix=, logDir=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/WALs/jenkins-hbase4.apache.org,44765,1711814166900, archiveDir=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/oldWALs, maxLogs=32 2024-03-30 15:56:08,436 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45369,DS-5614b7b1-7bb4-4ee5-a93d-a87c8bf98c3f,DISK] 2024-03-30 15:56:08,437 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41573,DS-21596dbc-e238-4429-902c-5a614bf47c0a,DISK] 2024-03-30 15:56:08,436 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45369,DS-5614b7b1-7bb4-4ee5-a93d-a87c8bf98c3f,DISK] 2024-03-30 15:56:08,438 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41573,DS-21596dbc-e238-4429-902c-5a614bf47c0a,DISK] 2024-03-30 15:56:08,478 INFO [RS:0;jenkins-hbase4:44765] wal.AbstractFSWAL(809): New WAL /user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/WALs/jenkins-hbase4.apache.org,44765,1711814166900/jenkins-hbase4.apache.org%2C44765%2C1711814166900.1711814168417 2024-03-30 15:56:08,478 INFO [RS:1;jenkins-hbase4:43311] wal.AbstractFSWAL(809): New WAL /user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/WALs/jenkins-hbase4.apache.org,43311,1711814166949/jenkins-hbase4.apache.org%2C43311%2C1711814166949.1711814168417 2024-03-30 15:56:08,479 DEBUG [RS:0;jenkins-hbase4:44765] wal.AbstractFSWAL(890): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41573,DS-21596dbc-e238-4429-902c-5a614bf47c0a,DISK], DatanodeInfoWithStorage[127.0.0.1:45369,DS-5614b7b1-7bb4-4ee5-a93d-a87c8bf98c3f,DISK]] 2024-03-30 15:56:08,479 DEBUG [RS:1;jenkins-hbase4:43311] wal.AbstractFSWAL(890): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45369,DS-5614b7b1-7bb4-4ee5-a93d-a87c8bf98c3f,DISK], DatanodeInfoWithStorage[127.0.0.1:41573,DS-21596dbc-e238-4429-902c-5a614bf47c0a,DISK]] 2024-03-30 15:56:08,588 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44765,1711814166900 2024-03-30 15:56:08,591 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-03-30 15:56:08,594 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-03-30 15:56:08,610 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2024-03-30 15:56:08,610 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-03-30 15:56:08,614 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(492): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44765%2C1711814166900.meta, suffix=.meta, logDir=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/WALs/jenkins-hbase4.apache.org,44765,1711814166900, archiveDir=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/oldWALs, maxLogs=32 2024-03-30 15:56:08,635 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45369,DS-5614b7b1-7bb4-4ee5-a93d-a87c8bf98c3f,DISK] 2024-03-30 15:56:08,635 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41573,DS-21596dbc-e238-4429-902c-5a614bf47c0a,DISK] 2024-03-30 15:56:08,641 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(809): New WAL /user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/WALs/jenkins-hbase4.apache.org,44765,1711814166900/jenkins-hbase4.apache.org%2C44765%2C1711814166900.meta.1711814168616.meta 2024-03-30 15:56:08,645 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(890): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45369,DS-5614b7b1-7bb4-4ee5-a93d-a87c8bf98c3f,DISK], DatanodeInfoWithStorage[127.0.0.1:41573,DS-21596dbc-e238-4429-902c-5a614bf47c0a,DISK]] 2024-03-30 15:56:08,645 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2024-03-30 15:56:08,647 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2024-03-30 15:56:08,664 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2024-03-30 15:56:08,668 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2024-03-30 15:56:08,674 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2024-03-30 15:56:08,674 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-30 15:56:08,674 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2024-03-30 15:56:08,674 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2024-03-30 15:56:08,678 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-03-30 15:56:08,680 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/meta/1588230740/info 2024-03-30 15:56:08,680 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/meta/1588230740/info 2024-03-30 15:56:08,680 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-03-30 15:56:08,681 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-30 15:56:08,682 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-03-30 15:56:08,683 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/meta/1588230740/rep_barrier 2024-03-30 15:56:08,684 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/meta/1588230740/rep_barrier 2024-03-30 15:56:08,684 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-03-30 15:56:08,685 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-30 15:56:08,685 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-03-30 15:56:08,687 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/meta/1588230740/table 2024-03-30 15:56:08,687 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/meta/1588230740/table 2024-03-30 15:56:08,687 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-03-30 15:56:08,688 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-30 15:56:08,690 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/meta/1588230740 2024-03-30 15:56:08,693 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/meta/1588230740 2024-03-30 15:56:08,697 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-03-30 15:56:08,700 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2024-03-30 15:56:08,701 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59539110, jitterRate=-0.11279812455177307}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-03-30 15:56:08,702 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2024-03-30 15:56:08,715 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1711814168580 2024-03-30 15:56:08,736 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:meta,,1.1588230740 2024-03-30 15:56:08,737 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2024-03-30 15:56:08,737 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44765,1711814166900, state=OPEN 2024-03-30 15:56:08,740 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2024-03-30 15:56:08,741 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-03-30 15:56:08,745 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=3, resume processing ppid=2 2024-03-30 15:56:08,745 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44765,1711814166900 in 340 msec 2024-03-30 15:56:08,750 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=2, resume processing ppid=1 2024-03-30 15:56:08,750 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 540 msec 2024-03-30 15:56:08,755 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 792 msec 2024-03-30 15:56:08,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(954): Wait for region servers to report in: status=null, state=RUNNING, startTime=1711814168756, completionTime=-1 2024-03-30 15:56:08,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2024-03-30 15:56:08,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2024-03-30 15:56:08,822 DEBUG [hconnection-0x43b4a769-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-30 15:56:08,826 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-03-30 15:56:08,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=2 2024-03-30 15:56:08,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1711814228842 2024-03-30 15:56:08,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1711814288842 2024-03-30 15:56:08,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 85 msec 2024-03-30 15:56:08,865 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37483,1711814165652-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:08,865 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37483,1711814165652-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:08,865 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37483,1711814165652-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:08,867 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:37483, period=300000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:08,868 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:08,874 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2024-03-30 15:56:08,883 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2024-03-30 15:56:08,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-03-30 15:56:08,894 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2024-03-30 15:56:08,897 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2024-03-30 15:56:08,900 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-30 15:56:08,922 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/hbase/namespace/63b3222862d662c64b94f1cf48ac7458 2024-03-30 15:56:08,925 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/hbase/namespace/63b3222862d662c64b94f1cf48ac7458 empty. 2024-03-30 15:56:08,926 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/hbase/namespace/63b3222862d662c64b94f1cf48ac7458 2024-03-30 15:56:08,926 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2024-03-30 15:56:08,954 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2024-03-30 15:56:08,956 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 63b3222862d662c64b94f1cf48ac7458, NAME => 'hbase:namespace,,1711814168883.63b3222862d662c64b94f1cf48ac7458.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp 2024-03-30 15:56:08,974 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1711814168883.63b3222862d662c64b94f1cf48ac7458.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-30 15:56:08,974 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 63b3222862d662c64b94f1cf48ac7458, disabling compactions & flushes 2024-03-30 15:56:08,974 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1711814168883.63b3222862d662c64b94f1cf48ac7458. 2024-03-30 15:56:08,974 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1711814168883.63b3222862d662c64b94f1cf48ac7458. 2024-03-30 15:56:08,974 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1711814168883.63b3222862d662c64b94f1cf48ac7458. after waiting 0 ms 2024-03-30 15:56:08,974 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1711814168883.63b3222862d662c64b94f1cf48ac7458. 2024-03-30 15:56:08,974 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1711814168883.63b3222862d662c64b94f1cf48ac7458. 2024-03-30 15:56:08,974 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 63b3222862d662c64b94f1cf48ac7458: 2024-03-30 15:56:08,979 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2024-03-30 15:56:08,995 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1711814168883.63b3222862d662c64b94f1cf48ac7458.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1711814168982"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1711814168982"}]},"ts":"1711814168982"} 2024-03-30 15:56:09,025 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-30 15:56:09,027 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-30 15:56:09,033 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711814169028"}]},"ts":"1711814169028"} 2024-03-30 15:56:09,036 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2024-03-30 15:56:09,041 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-30 15:56:09,043 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-30 15:56:09,043 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-30 15:56:09,043 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-30 15:56:09,046 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=63b3222862d662c64b94f1cf48ac7458, ASSIGN}] 2024-03-30 15:56:09,048 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=63b3222862d662c64b94f1cf48ac7458, ASSIGN 2024-03-30 15:56:09,050 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=63b3222862d662c64b94f1cf48ac7458, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43311,1711814166949; forceNewPlan=false, retain=false 2024-03-30 15:56:09,204 INFO [jenkins-hbase4:37483] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-30 15:56:09,205 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=63b3222862d662c64b94f1cf48ac7458, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43311,1711814166949 2024-03-30 15:56:09,205 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1711814168883.63b3222862d662c64b94f1cf48ac7458.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1711814169205"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1711814169205"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1711814169205"}]},"ts":"1711814169205"} 2024-03-30 15:56:09,210 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 63b3222862d662c64b94f1cf48ac7458, server=jenkins-hbase4.apache.org,43311,1711814166949}] 2024-03-30 15:56:09,365 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43311,1711814166949 2024-03-30 15:56:09,365 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-03-30 15:56:09,371 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37638, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-03-30 15:56:09,378 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1711814168883.63b3222862d662c64b94f1cf48ac7458. 2024-03-30 15:56:09,378 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 63b3222862d662c64b94f1cf48ac7458, NAME => 'hbase:namespace,,1711814168883.63b3222862d662c64b94f1cf48ac7458.', STARTKEY => '', ENDKEY => ''} 2024-03-30 15:56:09,379 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 63b3222862d662c64b94f1cf48ac7458 2024-03-30 15:56:09,379 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1711814168883.63b3222862d662c64b94f1cf48ac7458.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-30 15:56:09,379 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 63b3222862d662c64b94f1cf48ac7458 2024-03-30 15:56:09,379 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 63b3222862d662c64b94f1cf48ac7458 2024-03-30 15:56:09,382 INFO [StoreOpener-63b3222862d662c64b94f1cf48ac7458-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 63b3222862d662c64b94f1cf48ac7458 2024-03-30 15:56:09,384 DEBUG [StoreOpener-63b3222862d662c64b94f1cf48ac7458-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/namespace/63b3222862d662c64b94f1cf48ac7458/info 2024-03-30 15:56:09,384 DEBUG [StoreOpener-63b3222862d662c64b94f1cf48ac7458-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/namespace/63b3222862d662c64b94f1cf48ac7458/info 2024-03-30 15:56:09,385 INFO [StoreOpener-63b3222862d662c64b94f1cf48ac7458-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 63b3222862d662c64b94f1cf48ac7458 columnFamilyName info 2024-03-30 15:56:09,386 INFO [StoreOpener-63b3222862d662c64b94f1cf48ac7458-1] regionserver.HStore(310): Store=63b3222862d662c64b94f1cf48ac7458/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-30 15:56:09,387 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/namespace/63b3222862d662c64b94f1cf48ac7458 2024-03-30 15:56:09,388 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/namespace/63b3222862d662c64b94f1cf48ac7458 2024-03-30 15:56:09,392 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 63b3222862d662c64b94f1cf48ac7458 2024-03-30 15:56:09,397 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/namespace/63b3222862d662c64b94f1cf48ac7458/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-30 15:56:09,398 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 63b3222862d662c64b94f1cf48ac7458; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64643404, jitterRate=-0.03673821687698364}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-30 15:56:09,398 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 63b3222862d662c64b94f1cf48ac7458: 2024-03-30 15:56:09,400 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:namespace,,1711814168883.63b3222862d662c64b94f1cf48ac7458., pid=6, masterSystemTime=1711814169365 2024-03-30 15:56:09,405 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:namespace,,1711814168883.63b3222862d662c64b94f1cf48ac7458. 2024-03-30 15:56:09,406 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1711814168883.63b3222862d662c64b94f1cf48ac7458. 2024-03-30 15:56:09,407 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=63b3222862d662c64b94f1cf48ac7458, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43311,1711814166949 2024-03-30 15:56:09,407 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1711814168883.63b3222862d662c64b94f1cf48ac7458.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1711814169407"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1711814169407"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1711814169407"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1711814169407"}]},"ts":"1711814169407"} 2024-03-30 15:56:09,417 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=6, resume processing ppid=5 2024-03-30 15:56:09,417 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 63b3222862d662c64b94f1cf48ac7458, server=jenkins-hbase4.apache.org,43311,1711814166949 in 203 msec 2024-03-30 15:56:09,421 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=5, resume processing ppid=4 2024-03-30 15:56:09,421 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=63b3222862d662c64b94f1cf48ac7458, ASSIGN in 371 msec 2024-03-30 15:56:09,422 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-30 15:56:09,423 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711814169422"}]},"ts":"1711814169422"} 2024-03-30 15:56:09,426 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2024-03-30 15:56:09,430 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2024-03-30 15:56:09,433 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 545 msec 2024-03-30 15:56:09,498 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2024-03-30 15:56:09,500 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2024-03-30 15:56:09,500 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-30 15:56:09,524 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-30 15:56:09,526 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37644, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-03-30 15:56:09,543 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2024-03-30 15:56:09,563 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-03-30 15:56:09,569 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 36 msec 2024-03-30 15:56:09,578 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2024-03-30 15:56:09,590 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-03-30 15:56:09,595 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2024-03-30 15:56:09,604 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2024-03-30 15:56:09,607 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2024-03-30 15:56:09,608 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1084): Master has completed initialization 2.589sec 2024-03-30 15:56:09,610 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(103): Quota table not found. Creating... 2024-03-30 15:56:09,611 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-30 15:56:09,612 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:quota 2024-03-30 15:56:09,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(107): Initializing quota support 2024-03-30 15:56:09,615 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_PRE_OPERATION 2024-03-30 15:56:09,615 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(59): Namespace State Manager started. 2024-03-30 15:56:09,617 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-30 15:56:09,619 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/hbase/quota/82e214ee4fe8f93054806cf06e7f4f38 2024-03-30 15:56:09,620 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/hbase/quota/82e214ee4fe8f93054806cf06e7f4f38 empty. 2024-03-30 15:56:09,622 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/hbase/quota/82e214ee4fe8f93054806cf06e7f4f38 2024-03-30 15:56:09,623 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:quota regions 2024-03-30 15:56:09,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(222): Finished updating state of 2 namespaces. 2024-03-30 15:56:09,624 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceAuditor(50): NamespaceAuditor started. 2024-03-30 15:56:09,626 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:09,626 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:09,628 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2024-03-30 15:56:09,628 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2024-03-30 15:56:09,629 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37483,1711814165652-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2024-03-30 15:56:09,630 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37483,1711814165652-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2024-03-30 15:56:09,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1176): Balancer post startup initialization complete, took 0 seconds 2024-03-30 15:56:09,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37483,1711814165652-OldWALsDirSizeChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-30 15:56:09,646 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/hbase/quota/.tabledesc/.tableinfo.0000000001 2024-03-30 15:56:09,648 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(7675): creating {ENCODED => 82e214ee4fe8f93054806cf06e7f4f38, NAME => 'hbase:quota,,1711814169610.82e214ee4fe8f93054806cf06e7f4f38.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp 2024-03-30 15:56:09,668 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(866): Instantiated hbase:quota,,1711814169610.82e214ee4fe8f93054806cf06e7f4f38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-30 15:56:09,669 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1604): Closing 82e214ee4fe8f93054806cf06e7f4f38, disabling compactions & flushes 2024-03-30 15:56:09,669 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1626): Closing region hbase:quota,,1711814169610.82e214ee4fe8f93054806cf06e7f4f38. 2024-03-30 15:56:09,669 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1711814169610.82e214ee4fe8f93054806cf06e7f4f38. 2024-03-30 15:56:09,669 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1711814169610.82e214ee4fe8f93054806cf06e7f4f38. after waiting 0 ms 2024-03-30 15:56:09,669 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1711814169610.82e214ee4fe8f93054806cf06e7f4f38. 2024-03-30 15:56:09,669 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1838): Closed hbase:quota,,1711814169610.82e214ee4fe8f93054806cf06e7f4f38. 2024-03-30 15:56:09,669 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1558): Region close journal for 82e214ee4fe8f93054806cf06e7f4f38: 2024-03-30 15:56:09,673 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ADD_TO_META 2024-03-30 15:56:09,675 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:quota,,1711814169610.82e214ee4fe8f93054806cf06e7f4f38.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1711814169675"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1711814169675"}]},"ts":"1711814169675"} 2024-03-30 15:56:09,678 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-30 15:56:09,679 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-30 15:56:09,680 ERROR [Listener at localhost/42871] master.TableStateManager(95): Unable to get table hbase:quota state org.apache.hadoop.hbase.TableNotFoundException: No state found for hbase:quota at org.apache.hadoop.hbase.master.TableStateManager.getTableState(TableStateManager.java:155) at org.apache.hadoop.hbase.master.TableStateManager.isTableState(TableStateManager.java:92) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.isTableDisabled(AssignmentManager.java:419) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.getRegionStatesCount(AssignmentManager.java:2351) at org.apache.hadoop.hbase.master.HMaster.getClusterMetricsWithoutCoprocessor(HMaster.java:2622) at org.apache.hadoop.hbase.master.HMaster.getClusterMetrics(HMaster.java:2646) at org.apache.hadoop.hbase.master.HMaster.getClusterMetrics(HMaster.java:2639) at org.apache.hadoop.hbase.MiniHBaseCluster.getClusterMetrics(MiniHBaseCluster.java:710) at org.apache.hadoop.hbase.MiniHBaseCluster.(MiniHBaseCluster.java:111) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniHBaseCluster(HBaseTestingUtility.java:1131) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:1094) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:1048) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.setUpBeforeClass(TestClusterScopeQuotaThrottle.java:78) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2024-03-30 15:56:09,680 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711814169680"}]},"ts":"1711814169680"} 2024-03-30 15:56:09,682 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLING in hbase:meta 2024-03-30 15:56:09,686 DEBUG [Listener at localhost/42871] zookeeper.ReadOnlyZKClient(139): Connect 0x26bde290 to 127.0.0.1:60178 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-03-30 15:56:09,688 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-30 15:56:09,690 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-30 15:56:09,690 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-30 15:56:09,690 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-30 15:56:09,691 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=82e214ee4fe8f93054806cf06e7f4f38, ASSIGN}] 2024-03-30 15:56:09,691 DEBUG [Listener at localhost/42871] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a92e372, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-03-30 15:56:09,693 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=82e214ee4fe8f93054806cf06e7f4f38, ASSIGN 2024-03-30 15:56:09,695 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:quota, region=82e214ee4fe8f93054806cf06e7f4f38, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44765,1711814166900; forceNewPlan=false, retain=false 2024-03-30 15:56:09,707 DEBUG [hconnection-0x64ecc13b-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-30 15:56:09,719 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34806, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-03-30 15:56:09,729 INFO [Listener at localhost/42871] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,37483,1711814165652 2024-03-30 15:56:09,730 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:56:09,734 DEBUG [Listener at localhost/42871] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-03-30 15:56:09,836 DEBUG [Listener at localhost/42871] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-03-30 15:56:09,845 INFO [jenkins-hbase4:37483] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-30 15:56:09,846 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=82e214ee4fe8f93054806cf06e7f4f38, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44765,1711814166900 2024-03-30 15:56:09,847 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:quota,,1711814169610.82e214ee4fe8f93054806cf06e7f4f38.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1711814169846"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1711814169846"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1711814169846"}]},"ts":"1711814169846"} 2024-03-30 15:56:09,850 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 82e214ee4fe8f93054806cf06e7f4f38, server=jenkins-hbase4.apache.org,44765,1711814166900}] 2024-03-30 15:56:09,939 DEBUG [Listener at localhost/42871] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-03-30 15:56:10,004 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44765,1711814166900 2024-03-30 15:56:10,010 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:quota,,1711814169610.82e214ee4fe8f93054806cf06e7f4f38. 2024-03-30 15:56:10,011 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 82e214ee4fe8f93054806cf06e7f4f38, NAME => 'hbase:quota,,1711814169610.82e214ee4fe8f93054806cf06e7f4f38.', STARTKEY => '', ENDKEY => ''} 2024-03-30 15:56:10,011 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table quota 82e214ee4fe8f93054806cf06e7f4f38 2024-03-30 15:56:10,011 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:quota,,1711814169610.82e214ee4fe8f93054806cf06e7f4f38.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-30 15:56:10,011 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 82e214ee4fe8f93054806cf06e7f4f38 2024-03-30 15:56:10,011 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 82e214ee4fe8f93054806cf06e7f4f38 2024-03-30 15:56:10,013 INFO [StoreOpener-82e214ee4fe8f93054806cf06e7f4f38-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family q of region 82e214ee4fe8f93054806cf06e7f4f38 2024-03-30 15:56:10,015 DEBUG [StoreOpener-82e214ee4fe8f93054806cf06e7f4f38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/quota/82e214ee4fe8f93054806cf06e7f4f38/q 2024-03-30 15:56:10,015 DEBUG [StoreOpener-82e214ee4fe8f93054806cf06e7f4f38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/quota/82e214ee4fe8f93054806cf06e7f4f38/q 2024-03-30 15:56:10,016 INFO [StoreOpener-82e214ee4fe8f93054806cf06e7f4f38-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 82e214ee4fe8f93054806cf06e7f4f38 columnFamilyName q 2024-03-30 15:56:10,017 INFO [StoreOpener-82e214ee4fe8f93054806cf06e7f4f38-1] regionserver.HStore(310): Store=82e214ee4fe8f93054806cf06e7f4f38/q, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-30 15:56:10,017 INFO [StoreOpener-82e214ee4fe8f93054806cf06e7f4f38-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family u of region 82e214ee4fe8f93054806cf06e7f4f38 2024-03-30 15:56:10,019 DEBUG [StoreOpener-82e214ee4fe8f93054806cf06e7f4f38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/quota/82e214ee4fe8f93054806cf06e7f4f38/u 2024-03-30 15:56:10,019 DEBUG [StoreOpener-82e214ee4fe8f93054806cf06e7f4f38-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/quota/82e214ee4fe8f93054806cf06e7f4f38/u 2024-03-30 15:56:10,020 INFO [StoreOpener-82e214ee4fe8f93054806cf06e7f4f38-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 82e214ee4fe8f93054806cf06e7f4f38 columnFamilyName u 2024-03-30 15:56:10,020 INFO [StoreOpener-82e214ee4fe8f93054806cf06e7f4f38-1] regionserver.HStore(310): Store=82e214ee4fe8f93054806cf06e7f4f38/u, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-30 15:56:10,022 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/quota/82e214ee4fe8f93054806cf06e7f4f38 2024-03-30 15:56:10,023 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/quota/82e214ee4fe8f93054806cf06e7f4f38 2024-03-30 15:56:10,027 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:quota descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2024-03-30 15:56:10,029 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 82e214ee4fe8f93054806cf06e7f4f38 2024-03-30 15:56:10,033 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/quota/82e214ee4fe8f93054806cf06e7f4f38/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-30 15:56:10,034 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 82e214ee4fe8f93054806cf06e7f4f38; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71860190, jitterRate=0.07080027461051941}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2024-03-30 15:56:10,034 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 82e214ee4fe8f93054806cf06e7f4f38: 2024-03-30 15:56:10,036 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:quota,,1711814169610.82e214ee4fe8f93054806cf06e7f4f38., pid=11, masterSystemTime=1711814170003 2024-03-30 15:56:10,039 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:quota,,1711814169610.82e214ee4fe8f93054806cf06e7f4f38. 2024-03-30 15:56:10,039 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:quota,,1711814169610.82e214ee4fe8f93054806cf06e7f4f38. 2024-03-30 15:56:10,040 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=82e214ee4fe8f93054806cf06e7f4f38, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44765,1711814166900 2024-03-30 15:56:10,040 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:quota,,1711814169610.82e214ee4fe8f93054806cf06e7f4f38.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1711814170040"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1711814170040"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1711814170040"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1711814170040"}]},"ts":"1711814170040"} 2024-03-30 15:56:10,041 DEBUG [Listener at localhost/42871] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-03-30 15:56:10,046 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=11, resume processing ppid=10 2024-03-30 15:56:10,046 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 82e214ee4fe8f93054806cf06e7f4f38, server=jenkins-hbase4.apache.org,44765,1711814166900 in 193 msec 2024-03-30 15:56:10,050 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=10, resume processing ppid=9 2024-03-30 15:56:10,050 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:quota, region=82e214ee4fe8f93054806cf06e7f4f38, ASSIGN in 355 msec 2024-03-30 15:56:10,051 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-30 15:56:10,051 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711814170051"}]},"ts":"1711814170051"} 2024-03-30 15:56:10,053 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLED in hbase:meta 2024-03-30 15:56:10,057 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_POST_OPERATION 2024-03-30 15:56:10,060 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:quota in 446 msec 2024-03-30 15:56:10,154 DEBUG [Listener at localhost/42871] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-03-30 15:56:10,157 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38784, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2024-03-30 15:56:10,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37483] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-30 15:56:10,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37483] procedure2.ProcedureExecutor(1075): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin0 2024-03-30 15:56:10,199 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_PRE_OPERATION 2024-03-30 15:56:10,201 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-30 15:56:10,204 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/default/TestQuotaAdmin0/f49f78bfd9a64a3375041a4daa036ecc 2024-03-30 15:56:10,205 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/default/TestQuotaAdmin0/f49f78bfd9a64a3375041a4daa036ecc empty. 2024-03-30 15:56:10,205 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37483] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin0" procId is: 12 2024-03-30 15:56:10,205 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/default/TestQuotaAdmin0/f49f78bfd9a64a3375041a4daa036ecc 2024-03-30 15:56:10,206 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-03-30 15:56:10,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-03-30 15:56:10,226 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/default/TestQuotaAdmin0/.tabledesc/.tableinfo.0000000001 2024-03-30 15:56:10,229 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(7675): creating {ENCODED => f49f78bfd9a64a3375041a4daa036ecc, NAME => 'TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp 2024-03-30 15:56:10,255 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-30 15:56:10,255 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1604): Closing f49f78bfd9a64a3375041a4daa036ecc, disabling compactions & flushes 2024-03-30 15:56:10,255 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc. 2024-03-30 15:56:10,255 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc. 2024-03-30 15:56:10,255 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc. after waiting 0 ms 2024-03-30 15:56:10,255 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc. 2024-03-30 15:56:10,255 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc. 2024-03-30 15:56:10,255 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1558): Region close journal for f49f78bfd9a64a3375041a4daa036ecc: 2024-03-30 15:56:10,261 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ADD_TO_META 2024-03-30 15:56:10,263 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711814170263"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1711814170263"}]},"ts":"1711814170263"} 2024-03-30 15:56:10,266 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-30 15:56:10,267 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-30 15:56:10,268 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711814170267"}]},"ts":"1711814170267"} 2024-03-30 15:56:10,270 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLING in hbase:meta 2024-03-30 15:56:10,275 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-30 15:56:10,276 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-30 15:56:10,276 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-30 15:56:10,276 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-30 15:56:10,277 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=f49f78bfd9a64a3375041a4daa036ecc, ASSIGN}] 2024-03-30 15:56:10,278 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=f49f78bfd9a64a3375041a4daa036ecc, ASSIGN 2024-03-30 15:56:10,280 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin0, region=f49f78bfd9a64a3375041a4daa036ecc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43311,1711814166949; forceNewPlan=false, retain=false 2024-03-30 15:56:10,430 INFO [jenkins-hbase4:37483] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-30 15:56:10,431 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f49f78bfd9a64a3375041a4daa036ecc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43311,1711814166949 2024-03-30 15:56:10,431 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711814170431"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1711814170431"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1711814170431"}]},"ts":"1711814170431"} 2024-03-30 15:56:10,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; OpenRegionProcedure f49f78bfd9a64a3375041a4daa036ecc, server=jenkins-hbase4.apache.org,43311,1711814166949}] 2024-03-30 15:56:10,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-03-30 15:56:10,588 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43311,1711814166949 2024-03-30 15:56:10,594 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc. 2024-03-30 15:56:10,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f49f78bfd9a64a3375041a4daa036ecc, NAME => 'TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc.', STARTKEY => '', ENDKEY => ''} 2024-03-30 15:56:10,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin0 f49f78bfd9a64a3375041a4daa036ecc 2024-03-30 15:56:10,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-30 15:56:10,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f49f78bfd9a64a3375041a4daa036ecc 2024-03-30 15:56:10,595 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f49f78bfd9a64a3375041a4daa036ecc 2024-03-30 15:56:10,597 INFO [StoreOpener-f49f78bfd9a64a3375041a4daa036ecc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f49f78bfd9a64a3375041a4daa036ecc 2024-03-30 15:56:10,599 DEBUG [StoreOpener-f49f78bfd9a64a3375041a4daa036ecc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/default/TestQuotaAdmin0/f49f78bfd9a64a3375041a4daa036ecc/cf 2024-03-30 15:56:10,599 DEBUG [StoreOpener-f49f78bfd9a64a3375041a4daa036ecc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/default/TestQuotaAdmin0/f49f78bfd9a64a3375041a4daa036ecc/cf 2024-03-30 15:56:10,600 INFO [StoreOpener-f49f78bfd9a64a3375041a4daa036ecc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f49f78bfd9a64a3375041a4daa036ecc columnFamilyName cf 2024-03-30 15:56:10,601 INFO [StoreOpener-f49f78bfd9a64a3375041a4daa036ecc-1] regionserver.HStore(310): Store=f49f78bfd9a64a3375041a4daa036ecc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-30 15:56:10,604 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/default/TestQuotaAdmin0/f49f78bfd9a64a3375041a4daa036ecc 2024-03-30 15:56:10,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/default/TestQuotaAdmin0/f49f78bfd9a64a3375041a4daa036ecc 2024-03-30 15:56:10,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f49f78bfd9a64a3375041a4daa036ecc 2024-03-30 15:56:10,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/default/TestQuotaAdmin0/f49f78bfd9a64a3375041a4daa036ecc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-30 15:56:10,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f49f78bfd9a64a3375041a4daa036ecc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62280595, jitterRate=-0.07194681465625763}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-30 15:56:10,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f49f78bfd9a64a3375041a4daa036ecc: 2024-03-30 15:56:10,616 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc., pid=14, masterSystemTime=1711814170588 2024-03-30 15:56:10,619 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc. 2024-03-30 15:56:10,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc. 2024-03-30 15:56:10,620 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f49f78bfd9a64a3375041a4daa036ecc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43311,1711814166949 2024-03-30 15:56:10,620 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711814170620"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1711814170620"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1711814170620"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1711814170620"}]},"ts":"1711814170620"} 2024-03-30 15:56:10,626 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=14, resume processing ppid=13 2024-03-30 15:56:10,626 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=14, ppid=13, state=SUCCESS; OpenRegionProcedure f49f78bfd9a64a3375041a4daa036ecc, server=jenkins-hbase4.apache.org,43311,1711814166949 in 187 msec 2024-03-30 15:56:10,629 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=13, resume processing ppid=12 2024-03-30 15:56:10,630 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=f49f78bfd9a64a3375041a4daa036ecc, ASSIGN in 349 msec 2024-03-30 15:56:10,631 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-30 15:56:10,631 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711814170631"}]},"ts":"1711814170631"} 2024-03-30 15:56:10,633 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLED in hbase:meta 2024-03-30 15:56:10,637 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_POST_OPERATION 2024-03-30 15:56:10,639 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=12, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin0 in 443 msec 2024-03-30 15:56:10,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-03-30 15:56:10,975 INFO [Listener at localhost/42871] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin0, procId: 12 completed 2024-03-30 15:56:10,975 DEBUG [Listener at localhost/42871] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin0 get assigned. Timeout = 60000ms 2024-03-30 15:56:10,976 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:56:10,980 INFO [Listener at localhost/42871] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin0 assigned to meta. Checking AM states. 2024-03-30 15:56:10,980 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:56:10,981 INFO [Listener at localhost/42871] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin0 assigned. 2024-03-30 15:56:10,981 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:56:10,988 DEBUG [hconnection-0x64ecc13b-shared-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-30 15:56:10,992 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37648, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-03-30 15:56:10,997 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-03-30 15:56:10,998 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38792, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=MasterService 2024-03-30 15:56:11,000 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37483] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-30 15:56:11,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37483] procedure2.ProcedureExecutor(1075): Stored pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin1 2024-03-30 15:56:11,003 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_PRE_OPERATION 2024-03-30 15:56:11,004 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37483] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin1" procId is: 15 2024-03-30 15:56:11,005 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-30 15:56:11,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-03-30 15:56:11,008 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/default/TestQuotaAdmin1/a81bfcbbc320432e83b32b27cd2ed3f3 2024-03-30 15:56:11,009 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/default/TestQuotaAdmin1/a81bfcbbc320432e83b32b27cd2ed3f3 empty. 2024-03-30 15:56:11,010 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/default/TestQuotaAdmin1/a81bfcbbc320432e83b32b27cd2ed3f3 2024-03-30 15:56:11,010 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-03-30 15:56:11,031 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/default/TestQuotaAdmin1/.tabledesc/.tableinfo.0000000001 2024-03-30 15:56:11,032 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(7675): creating {ENCODED => a81bfcbbc320432e83b32b27cd2ed3f3, NAME => 'TestQuotaAdmin1,,1711814170999.a81bfcbbc320432e83b32b27cd2ed3f3.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp 2024-03-30 15:56:11,041 DEBUG [hconnection-0x40abad2-metaLookup-shared--pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-30 15:56:11,046 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34822, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2024-03-30 15:56:11,052 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1711814170999.a81bfcbbc320432e83b32b27cd2ed3f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-30 15:56:11,052 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1604): Closing a81bfcbbc320432e83b32b27cd2ed3f3, disabling compactions & flushes 2024-03-30 15:56:11,052 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1711814170999.a81bfcbbc320432e83b32b27cd2ed3f3. 2024-03-30 15:56:11,052 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1711814170999.a81bfcbbc320432e83b32b27cd2ed3f3. 2024-03-30 15:56:11,052 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1711814170999.a81bfcbbc320432e83b32b27cd2ed3f3. after waiting 0 ms 2024-03-30 15:56:11,052 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1711814170999.a81bfcbbc320432e83b32b27cd2ed3f3. 2024-03-30 15:56:11,052 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1711814170999.a81bfcbbc320432e83b32b27cd2ed3f3. 2024-03-30 15:56:11,052 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1558): Region close journal for a81bfcbbc320432e83b32b27cd2ed3f3: 2024-03-30 15:56:11,057 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ADD_TO_META 2024-03-30 15:56:11,059 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1711814170999.a81bfcbbc320432e83b32b27cd2ed3f3.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711814171059"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1711814171059"}]},"ts":"1711814171059"} 2024-03-30 15:56:11,062 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-30 15:56:11,063 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-30 15:56:11,064 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711814171063"}]},"ts":"1711814171063"} 2024-03-30 15:56:11,066 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLING in hbase:meta 2024-03-30 15:56:11,070 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-30 15:56:11,072 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-30 15:56:11,072 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-30 15:56:11,072 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-30 15:56:11,072 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=a81bfcbbc320432e83b32b27cd2ed3f3, ASSIGN}] 2024-03-30 15:56:11,074 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=a81bfcbbc320432e83b32b27cd2ed3f3, ASSIGN 2024-03-30 15:56:11,075 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin1, region=a81bfcbbc320432e83b32b27cd2ed3f3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44765,1711814166900; forceNewPlan=false, retain=false 2024-03-30 15:56:11,225 INFO [jenkins-hbase4:37483] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-30 15:56:11,226 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=a81bfcbbc320432e83b32b27cd2ed3f3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44765,1711814166900 2024-03-30 15:56:11,226 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1711814170999.a81bfcbbc320432e83b32b27cd2ed3f3.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711814171226"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1711814171226"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1711814171226"}]},"ts":"1711814171226"} 2024-03-30 15:56:11,229 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure a81bfcbbc320432e83b32b27cd2ed3f3, server=jenkins-hbase4.apache.org,44765,1711814166900}] 2024-03-30 15:56:11,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-03-30 15:56:11,382 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44765,1711814166900 2024-03-30 15:56:11,388 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin1,,1711814170999.a81bfcbbc320432e83b32b27cd2ed3f3. 2024-03-30 15:56:11,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a81bfcbbc320432e83b32b27cd2ed3f3, NAME => 'TestQuotaAdmin1,,1711814170999.a81bfcbbc320432e83b32b27cd2ed3f3.', STARTKEY => '', ENDKEY => ''} 2024-03-30 15:56:11,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin1 a81bfcbbc320432e83b32b27cd2ed3f3 2024-03-30 15:56:11,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1711814170999.a81bfcbbc320432e83b32b27cd2ed3f3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-30 15:56:11,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a81bfcbbc320432e83b32b27cd2ed3f3 2024-03-30 15:56:11,389 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a81bfcbbc320432e83b32b27cd2ed3f3 2024-03-30 15:56:11,391 INFO [StoreOpener-a81bfcbbc320432e83b32b27cd2ed3f3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a81bfcbbc320432e83b32b27cd2ed3f3 2024-03-30 15:56:11,394 DEBUG [StoreOpener-a81bfcbbc320432e83b32b27cd2ed3f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/default/TestQuotaAdmin1/a81bfcbbc320432e83b32b27cd2ed3f3/cf 2024-03-30 15:56:11,394 DEBUG [StoreOpener-a81bfcbbc320432e83b32b27cd2ed3f3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/default/TestQuotaAdmin1/a81bfcbbc320432e83b32b27cd2ed3f3/cf 2024-03-30 15:56:11,394 INFO [StoreOpener-a81bfcbbc320432e83b32b27cd2ed3f3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a81bfcbbc320432e83b32b27cd2ed3f3 columnFamilyName cf 2024-03-30 15:56:11,395 INFO [StoreOpener-a81bfcbbc320432e83b32b27cd2ed3f3-1] regionserver.HStore(310): Store=a81bfcbbc320432e83b32b27cd2ed3f3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-30 15:56:11,397 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/default/TestQuotaAdmin1/a81bfcbbc320432e83b32b27cd2ed3f3 2024-03-30 15:56:11,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/default/TestQuotaAdmin1/a81bfcbbc320432e83b32b27cd2ed3f3 2024-03-30 15:56:11,404 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a81bfcbbc320432e83b32b27cd2ed3f3 2024-03-30 15:56:11,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/default/TestQuotaAdmin1/a81bfcbbc320432e83b32b27cd2ed3f3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-30 15:56:11,408 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a81bfcbbc320432e83b32b27cd2ed3f3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69118826, jitterRate=0.029950767755508423}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-30 15:56:11,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a81bfcbbc320432e83b32b27cd2ed3f3: 2024-03-30 15:56:11,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin1,,1711814170999.a81bfcbbc320432e83b32b27cd2ed3f3., pid=17, masterSystemTime=1711814171382 2024-03-30 15:56:11,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin1,,1711814170999.a81bfcbbc320432e83b32b27cd2ed3f3. 2024-03-30 15:56:11,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin1,,1711814170999.a81bfcbbc320432e83b32b27cd2ed3f3. 2024-03-30 15:56:11,413 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=a81bfcbbc320432e83b32b27cd2ed3f3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44765,1711814166900 2024-03-30 15:56:11,413 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin1,,1711814170999.a81bfcbbc320432e83b32b27cd2ed3f3.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711814171413"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1711814171413"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1711814171413"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1711814171413"}]},"ts":"1711814171413"} 2024-03-30 15:56:11,419 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=17, resume processing ppid=16 2024-03-30 15:56:11,420 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure a81bfcbbc320432e83b32b27cd2ed3f3, server=jenkins-hbase4.apache.org,44765,1711814166900 in 187 msec 2024-03-30 15:56:11,422 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=16, resume processing ppid=15 2024-03-30 15:56:11,423 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=a81bfcbbc320432e83b32b27cd2ed3f3, ASSIGN in 347 msec 2024-03-30 15:56:11,424 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-30 15:56:11,424 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711814171424"}]},"ts":"1711814171424"} 2024-03-30 15:56:11,427 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLED in hbase:meta 2024-03-30 15:56:11,430 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_POST_OPERATION 2024-03-30 15:56:11,433 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=15, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin1 in 430 msec 2024-03-30 15:56:11,760 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-03-30 15:56:11,760 INFO [Listener at localhost/42871] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin1, procId: 15 completed 2024-03-30 15:56:11,760 DEBUG [Listener at localhost/42871] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin1 get assigned. Timeout = 60000ms 2024-03-30 15:56:11,761 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:56:11,764 INFO [Listener at localhost/42871] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin1 assigned to meta. Checking AM states. 2024-03-30 15:56:11,764 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:56:11,764 INFO [Listener at localhost/42871] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin1 assigned. 2024-03-30 15:56:11,764 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:56:11,774 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-03-30 15:56:11,778 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:38806, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService 2024-03-30 15:56:11,779 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-30 15:56:11,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] procedure2.ProcedureExecutor(1075): Stored pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin2 2024-03-30 15:56:11,784 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_PRE_OPERATION 2024-03-30 15:56:11,784 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin2" procId is: 18 2024-03-30 15:56:11,786 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-30 15:56:11,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-03-30 15:56:11,788 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/default/TestQuotaAdmin2/d7ae2674055ddc809f1c3ab9c364dd95 2024-03-30 15:56:11,789 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/default/TestQuotaAdmin2/d7ae2674055ddc809f1c3ab9c364dd95 empty. 2024-03-30 15:56:11,790 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/default/TestQuotaAdmin2/d7ae2674055ddc809f1c3ab9c364dd95 2024-03-30 15:56:11,790 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-03-30 15:56:11,811 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/default/TestQuotaAdmin2/.tabledesc/.tableinfo.0000000001 2024-03-30 15:56:11,813 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(7675): creating {ENCODED => d7ae2674055ddc809f1c3ab9c364dd95, NAME => 'TestQuotaAdmin2,,1711814171779.d7ae2674055ddc809f1c3ab9c364dd95.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp 2024-03-30 15:56:11,828 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1711814171779.d7ae2674055ddc809f1c3ab9c364dd95.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-30 15:56:11,828 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1604): Closing d7ae2674055ddc809f1c3ab9c364dd95, disabling compactions & flushes 2024-03-30 15:56:11,828 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1711814171779.d7ae2674055ddc809f1c3ab9c364dd95. 2024-03-30 15:56:11,828 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1711814171779.d7ae2674055ddc809f1c3ab9c364dd95. 2024-03-30 15:56:11,828 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1711814171779.d7ae2674055ddc809f1c3ab9c364dd95. after waiting 0 ms 2024-03-30 15:56:11,828 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1711814171779.d7ae2674055ddc809f1c3ab9c364dd95. 2024-03-30 15:56:11,828 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1711814171779.d7ae2674055ddc809f1c3ab9c364dd95. 2024-03-30 15:56:11,829 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1558): Region close journal for d7ae2674055ddc809f1c3ab9c364dd95: 2024-03-30 15:56:11,832 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ADD_TO_META 2024-03-30 15:56:11,834 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1711814171779.d7ae2674055ddc809f1c3ab9c364dd95.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711814171834"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1711814171834"}]},"ts":"1711814171834"} 2024-03-30 15:56:11,837 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-30 15:56:11,838 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-30 15:56:11,838 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711814171838"}]},"ts":"1711814171838"} 2024-03-30 15:56:11,840 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLING in hbase:meta 2024-03-30 15:56:11,846 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-30 15:56:11,847 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-30 15:56:11,847 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-30 15:56:11,847 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-30 15:56:11,847 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=d7ae2674055ddc809f1c3ab9c364dd95, ASSIGN}] 2024-03-30 15:56:11,848 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=d7ae2674055ddc809f1c3ab9c364dd95, ASSIGN 2024-03-30 15:56:11,850 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin2, region=d7ae2674055ddc809f1c3ab9c364dd95, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44765,1711814166900; forceNewPlan=false, retain=false 2024-03-30 15:56:12,000 INFO [jenkins-hbase4:37483] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-30 15:56:12,001 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=d7ae2674055ddc809f1c3ab9c364dd95, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44765,1711814166900 2024-03-30 15:56:12,001 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1711814171779.d7ae2674055ddc809f1c3ab9c364dd95.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711814172001"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1711814172001"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1711814172001"}]},"ts":"1711814172001"} 2024-03-30 15:56:12,004 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE; OpenRegionProcedure d7ae2674055ddc809f1c3ab9c364dd95, server=jenkins-hbase4.apache.org,44765,1711814166900}] 2024-03-30 15:56:12,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-03-30 15:56:12,157 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44765,1711814166900 2024-03-30 15:56:12,163 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin2,,1711814171779.d7ae2674055ddc809f1c3ab9c364dd95. 2024-03-30 15:56:12,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d7ae2674055ddc809f1c3ab9c364dd95, NAME => 'TestQuotaAdmin2,,1711814171779.d7ae2674055ddc809f1c3ab9c364dd95.', STARTKEY => '', ENDKEY => ''} 2024-03-30 15:56:12,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin2 d7ae2674055ddc809f1c3ab9c364dd95 2024-03-30 15:56:12,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1711814171779.d7ae2674055ddc809f1c3ab9c364dd95.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-30 15:56:12,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d7ae2674055ddc809f1c3ab9c364dd95 2024-03-30 15:56:12,164 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d7ae2674055ddc809f1c3ab9c364dd95 2024-03-30 15:56:12,166 INFO [StoreOpener-d7ae2674055ddc809f1c3ab9c364dd95-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d7ae2674055ddc809f1c3ab9c364dd95 2024-03-30 15:56:12,168 DEBUG [StoreOpener-d7ae2674055ddc809f1c3ab9c364dd95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/default/TestQuotaAdmin2/d7ae2674055ddc809f1c3ab9c364dd95/cf 2024-03-30 15:56:12,168 DEBUG [StoreOpener-d7ae2674055ddc809f1c3ab9c364dd95-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/default/TestQuotaAdmin2/d7ae2674055ddc809f1c3ab9c364dd95/cf 2024-03-30 15:56:12,168 INFO [StoreOpener-d7ae2674055ddc809f1c3ab9c364dd95-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d7ae2674055ddc809f1c3ab9c364dd95 columnFamilyName cf 2024-03-30 15:56:12,169 INFO [StoreOpener-d7ae2674055ddc809f1c3ab9c364dd95-1] regionserver.HStore(310): Store=d7ae2674055ddc809f1c3ab9c364dd95/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-30 15:56:12,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/default/TestQuotaAdmin2/d7ae2674055ddc809f1c3ab9c364dd95 2024-03-30 15:56:12,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/default/TestQuotaAdmin2/d7ae2674055ddc809f1c3ab9c364dd95 2024-03-30 15:56:12,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d7ae2674055ddc809f1c3ab9c364dd95 2024-03-30 15:56:12,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/default/TestQuotaAdmin2/d7ae2674055ddc809f1c3ab9c364dd95/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-30 15:56:12,181 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d7ae2674055ddc809f1c3ab9c364dd95; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64140716, jitterRate=-0.04422885179519653}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-30 15:56:12,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d7ae2674055ddc809f1c3ab9c364dd95: 2024-03-30 15:56:12,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin2,,1711814171779.d7ae2674055ddc809f1c3ab9c364dd95., pid=20, masterSystemTime=1711814172157 2024-03-30 15:56:12,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin2,,1711814171779.d7ae2674055ddc809f1c3ab9c364dd95. 2024-03-30 15:56:12,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin2,,1711814171779.d7ae2674055ddc809f1c3ab9c364dd95. 2024-03-30 15:56:12,186 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=d7ae2674055ddc809f1c3ab9c364dd95, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44765,1711814166900 2024-03-30 15:56:12,186 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin2,,1711814171779.d7ae2674055ddc809f1c3ab9c364dd95.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711814172186"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1711814172186"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1711814172186"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1711814172186"}]},"ts":"1711814172186"} 2024-03-30 15:56:12,192 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=20, resume processing ppid=19 2024-03-30 15:56:12,192 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=20, ppid=19, state=SUCCESS; OpenRegionProcedure d7ae2674055ddc809f1c3ab9c364dd95, server=jenkins-hbase4.apache.org,44765,1711814166900 in 185 msec 2024-03-30 15:56:12,195 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=19, resume processing ppid=18 2024-03-30 15:56:12,196 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=19, ppid=18, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=d7ae2674055ddc809f1c3ab9c364dd95, ASSIGN in 345 msec 2024-03-30 15:56:12,197 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-30 15:56:12,197 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711814172197"}]},"ts":"1711814172197"} 2024-03-30 15:56:12,199 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLED in hbase:meta 2024-03-30 15:56:12,203 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_POST_OPERATION 2024-03-30 15:56:12,205 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=18, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin2 in 423 msec 2024-03-30 15:56:12,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-03-30 15:56:12,540 INFO [Listener at localhost/42871] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin2, procId: 18 completed 2024-03-30 15:56:12,541 DEBUG [Listener at localhost/42871] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin2 get assigned. Timeout = 60000ms 2024-03-30 15:56:12,541 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:56:12,544 INFO [Listener at localhost/42871] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin2 assigned to meta. Checking AM states. 2024-03-30 15:56:12,545 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:56:12,545 INFO [Listener at localhost/42871] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin2 assigned. 2024-03-30 15:56:12,545 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:56:12,559 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.HMaster$15(3020): Client=jenkins//172.31.14.131 creating {NAME => 'TestNs'} 2024-03-30 15:56:12,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] procedure2.ProcedureExecutor(1075): Stored pid=21, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=TestNs 2024-03-30 15:56:12,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-03-30 15:56:12,575 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-03-30 15:56:12,581 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=21, state=SUCCESS; CreateNamespaceProcedure, namespace=TestNs in 19 msec 2024-03-30 15:56:12,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-03-30 15:56:12,823 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-30 15:56:12,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] procedure2.ProcedureExecutor(1075): Stored pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestNs:TestTable 2024-03-30 15:56:12,827 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_PRE_OPERATION 2024-03-30 15:56:12,827 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "TestNs" qualifier: "TestTable" procId is: 22 2024-03-30 15:56:12,828 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-30 15:56:12,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-03-30 15:56:12,832 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/TestNs/TestTable/59d3edc0fa4c3c9e91a7497b1b62f796 2024-03-30 15:56:12,832 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/TestNs/TestTable/44d2e09382bc6197f4ccfe7580d6fcef 2024-03-30 15:56:12,832 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/TestNs/TestTable/59d3edc0fa4c3c9e91a7497b1b62f796 empty. 2024-03-30 15:56:12,833 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/TestNs/TestTable/44d2e09382bc6197f4ccfe7580d6fcef empty. 2024-03-30 15:56:12,833 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/TestNs/TestTable/59d3edc0fa4c3c9e91a7497b1b62f796 2024-03-30 15:56:12,833 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/TestNs/TestTable/44d2e09382bc6197f4ccfe7580d6fcef 2024-03-30 15:56:12,833 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-03-30 15:56:12,851 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/TestNs/TestTable/.tabledesc/.tableinfo.0000000001 2024-03-30 15:56:12,853 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(7675): creating {ENCODED => 59d3edc0fa4c3c9e91a7497b1b62f796, NAME => 'TestNs:TestTable,,1711814172822.59d3edc0fa4c3c9e91a7497b1b62f796.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp 2024-03-30 15:56:12,853 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(7675): creating {ENCODED => 44d2e09382bc6197f4ccfe7580d6fcef, NAME => 'TestNs:TestTable,1,1711814172822.44d2e09382bc6197f4ccfe7580d6fcef.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp 2024-03-30 15:56:12,873 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1711814172822.44d2e09382bc6197f4ccfe7580d6fcef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-30 15:56:12,873 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1604): Closing 44d2e09382bc6197f4ccfe7580d6fcef, disabling compactions & flushes 2024-03-30 15:56:12,873 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1711814172822.59d3edc0fa4c3c9e91a7497b1b62f796.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-30 15:56:12,873 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1711814172822.44d2e09382bc6197f4ccfe7580d6fcef. 2024-03-30 15:56:12,874 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1604): Closing 59d3edc0fa4c3c9e91a7497b1b62f796, disabling compactions & flushes 2024-03-30 15:56:12,874 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1711814172822.44d2e09382bc6197f4ccfe7580d6fcef. 2024-03-30 15:56:12,874 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1711814172822.59d3edc0fa4c3c9e91a7497b1b62f796. 2024-03-30 15:56:12,874 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1711814172822.44d2e09382bc6197f4ccfe7580d6fcef. after waiting 0 ms 2024-03-30 15:56:12,874 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1711814172822.59d3edc0fa4c3c9e91a7497b1b62f796. 2024-03-30 15:56:12,874 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1711814172822.44d2e09382bc6197f4ccfe7580d6fcef. 2024-03-30 15:56:12,874 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1711814172822.59d3edc0fa4c3c9e91a7497b1b62f796. after waiting 0 ms 2024-03-30 15:56:12,874 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1711814172822.44d2e09382bc6197f4ccfe7580d6fcef. 2024-03-30 15:56:12,874 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1711814172822.59d3edc0fa4c3c9e91a7497b1b62f796. 2024-03-30 15:56:12,874 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1711814172822.59d3edc0fa4c3c9e91a7497b1b62f796. 2024-03-30 15:56:12,875 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1558): Region close journal for 44d2e09382bc6197f4ccfe7580d6fcef: 2024-03-30 15:56:12,875 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1558): Region close journal for 59d3edc0fa4c3c9e91a7497b1b62f796: 2024-03-30 15:56:12,879 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ADD_TO_META 2024-03-30 15:56:12,881 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,,1711814172822.59d3edc0fa4c3c9e91a7497b1b62f796.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1711814172880"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1711814172880"}]},"ts":"1711814172880"} 2024-03-30 15:56:12,881 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1711814172822.44d2e09382bc6197f4ccfe7580d6fcef.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1711814172880"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1711814172880"}]},"ts":"1711814172880"} 2024-03-30 15:56:12,888 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2024-03-30 15:56:12,890 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-30 15:56:12,890 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711814172890"}]},"ts":"1711814172890"} 2024-03-30 15:56:12,892 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLING in hbase:meta 2024-03-30 15:56:12,897 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-30 15:56:12,899 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-30 15:56:12,899 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-30 15:56:12,899 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-30 15:56:12,900 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=59d3edc0fa4c3c9e91a7497b1b62f796, ASSIGN}, {pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=44d2e09382bc6197f4ccfe7580d6fcef, ASSIGN}] 2024-03-30 15:56:12,901 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=44d2e09382bc6197f4ccfe7580d6fcef, ASSIGN 2024-03-30 15:56:12,901 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=59d3edc0fa4c3c9e91a7497b1b62f796, ASSIGN 2024-03-30 15:56:12,903 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=44d2e09382bc6197f4ccfe7580d6fcef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44765,1711814166900; forceNewPlan=false, retain=false 2024-03-30 15:56:12,903 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=59d3edc0fa4c3c9e91a7497b1b62f796, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43311,1711814166949; forceNewPlan=false, retain=false 2024-03-30 15:56:13,053 INFO [jenkins-hbase4:37483] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2024-03-30 15:56:13,054 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=44d2e09382bc6197f4ccfe7580d6fcef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44765,1711814166900 2024-03-30 15:56:13,054 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=59d3edc0fa4c3c9e91a7497b1b62f796, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43311,1711814166949 2024-03-30 15:56:13,055 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1711814172822.44d2e09382bc6197f4ccfe7580d6fcef.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1711814173054"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1711814173054"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1711814173054"}]},"ts":"1711814173054"} 2024-03-30 15:56:13,055 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1711814172822.59d3edc0fa4c3c9e91a7497b1b62f796.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1711814173054"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1711814173054"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1711814173054"}]},"ts":"1711814173054"} 2024-03-30 15:56:13,057 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 44d2e09382bc6197f4ccfe7580d6fcef, server=jenkins-hbase4.apache.org,44765,1711814166900}] 2024-03-30 15:56:13,059 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=26, ppid=23, state=RUNNABLE; OpenRegionProcedure 59d3edc0fa4c3c9e91a7497b1b62f796, server=jenkins-hbase4.apache.org,43311,1711814166949}] 2024-03-30 15:56:13,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-03-30 15:56:13,210 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44765,1711814166900 2024-03-30 15:56:13,212 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43311,1711814166949 2024-03-30 15:56:13,215 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,1,1711814172822.44d2e09382bc6197f4ccfe7580d6fcef. 2024-03-30 15:56:13,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 44d2e09382bc6197f4ccfe7580d6fcef, NAME => 'TestNs:TestTable,1,1711814172822.44d2e09382bc6197f4ccfe7580d6fcef.', STARTKEY => '1', ENDKEY => ''} 2024-03-30 15:56:13,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable 44d2e09382bc6197f4ccfe7580d6fcef 2024-03-30 15:56:13,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1711814172822.44d2e09382bc6197f4ccfe7580d6fcef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-30 15:56:13,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 44d2e09382bc6197f4ccfe7580d6fcef 2024-03-30 15:56:13,216 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 44d2e09382bc6197f4ccfe7580d6fcef 2024-03-30 15:56:13,217 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,,1711814172822.59d3edc0fa4c3c9e91a7497b1b62f796. 2024-03-30 15:56:13,217 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 59d3edc0fa4c3c9e91a7497b1b62f796, NAME => 'TestNs:TestTable,,1711814172822.59d3edc0fa4c3c9e91a7497b1b62f796.', STARTKEY => '', ENDKEY => '1'} 2024-03-30 15:56:13,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable 59d3edc0fa4c3c9e91a7497b1b62f796 2024-03-30 15:56:13,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1711814172822.59d3edc0fa4c3c9e91a7497b1b62f796.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-30 15:56:13,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 59d3edc0fa4c3c9e91a7497b1b62f796 2024-03-30 15:56:13,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 59d3edc0fa4c3c9e91a7497b1b62f796 2024-03-30 15:56:13,218 INFO [StoreOpener-44d2e09382bc6197f4ccfe7580d6fcef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 44d2e09382bc6197f4ccfe7580d6fcef 2024-03-30 15:56:13,220 INFO [StoreOpener-59d3edc0fa4c3c9e91a7497b1b62f796-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 59d3edc0fa4c3c9e91a7497b1b62f796 2024-03-30 15:56:13,221 DEBUG [StoreOpener-44d2e09382bc6197f4ccfe7580d6fcef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/TestNs/TestTable/44d2e09382bc6197f4ccfe7580d6fcef/cf 2024-03-30 15:56:13,221 DEBUG [StoreOpener-44d2e09382bc6197f4ccfe7580d6fcef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/TestNs/TestTable/44d2e09382bc6197f4ccfe7580d6fcef/cf 2024-03-30 15:56:13,221 INFO [StoreOpener-44d2e09382bc6197f4ccfe7580d6fcef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 44d2e09382bc6197f4ccfe7580d6fcef columnFamilyName cf 2024-03-30 15:56:13,222 DEBUG [StoreOpener-59d3edc0fa4c3c9e91a7497b1b62f796-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/TestNs/TestTable/59d3edc0fa4c3c9e91a7497b1b62f796/cf 2024-03-30 15:56:13,222 DEBUG [StoreOpener-59d3edc0fa4c3c9e91a7497b1b62f796-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/TestNs/TestTable/59d3edc0fa4c3c9e91a7497b1b62f796/cf 2024-03-30 15:56:13,222 INFO [StoreOpener-44d2e09382bc6197f4ccfe7580d6fcef-1] regionserver.HStore(310): Store=44d2e09382bc6197f4ccfe7580d6fcef/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-30 15:56:13,224 INFO [StoreOpener-59d3edc0fa4c3c9e91a7497b1b62f796-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 59d3edc0fa4c3c9e91a7497b1b62f796 columnFamilyName cf 2024-03-30 15:56:13,224 INFO [StoreOpener-59d3edc0fa4c3c9e91a7497b1b62f796-1] regionserver.HStore(310): Store=59d3edc0fa4c3c9e91a7497b1b62f796/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-30 15:56:13,225 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/TestNs/TestTable/44d2e09382bc6197f4ccfe7580d6fcef 2024-03-30 15:56:13,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/TestNs/TestTable/44d2e09382bc6197f4ccfe7580d6fcef 2024-03-30 15:56:13,226 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/TestNs/TestTable/59d3edc0fa4c3c9e91a7497b1b62f796 2024-03-30 15:56:13,227 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/TestNs/TestTable/59d3edc0fa4c3c9e91a7497b1b62f796 2024-03-30 15:56:13,231 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 44d2e09382bc6197f4ccfe7580d6fcef 2024-03-30 15:56:13,232 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 59d3edc0fa4c3c9e91a7497b1b62f796 2024-03-30 15:56:13,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/TestNs/TestTable/44d2e09382bc6197f4ccfe7580d6fcef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-30 15:56:13,235 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/TestNs/TestTable/59d3edc0fa4c3c9e91a7497b1b62f796/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-30 15:56:13,236 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 44d2e09382bc6197f4ccfe7580d6fcef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59551232, jitterRate=-0.11261749267578125}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-30 15:56:13,236 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 59d3edc0fa4c3c9e91a7497b1b62f796; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62037586, jitterRate=-0.07556793093681335}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-30 15:56:13,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 44d2e09382bc6197f4ccfe7580d6fcef: 2024-03-30 15:56:13,236 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 59d3edc0fa4c3c9e91a7497b1b62f796: 2024-03-30 15:56:13,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestNs:TestTable,1,1711814172822.44d2e09382bc6197f4ccfe7580d6fcef., pid=25, masterSystemTime=1711814173210 2024-03-30 15:56:13,238 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestNs:TestTable,,1711814172822.59d3edc0fa4c3c9e91a7497b1b62f796., pid=26, masterSystemTime=1711814173212 2024-03-30 15:56:13,241 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestNs:TestTable,1,1711814172822.44d2e09382bc6197f4ccfe7580d6fcef. 2024-03-30 15:56:13,241 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,1,1711814172822.44d2e09382bc6197f4ccfe7580d6fcef. 2024-03-30 15:56:13,242 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=44d2e09382bc6197f4ccfe7580d6fcef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44765,1711814166900 2024-03-30 15:56:13,243 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestNs:TestTable,,1711814172822.59d3edc0fa4c3c9e91a7497b1b62f796. 2024-03-30 15:56:13,243 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,1,1711814172822.44d2e09382bc6197f4ccfe7580d6fcef.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1711814173242"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1711814173242"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1711814173242"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1711814173242"}]},"ts":"1711814173242"} 2024-03-30 15:56:13,243 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,,1711814172822.59d3edc0fa4c3c9e91a7497b1b62f796. 2024-03-30 15:56:13,243 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=59d3edc0fa4c3c9e91a7497b1b62f796, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43311,1711814166949 2024-03-30 15:56:13,244 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,,1711814172822.59d3edc0fa4c3c9e91a7497b1b62f796.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1711814173243"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1711814173243"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1711814173243"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1711814173243"}]},"ts":"1711814173243"} 2024-03-30 15:56:13,249 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=25, resume processing ppid=24 2024-03-30 15:56:13,249 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 44d2e09382bc6197f4ccfe7580d6fcef, server=jenkins-hbase4.apache.org,44765,1711814166900 in 189 msec 2024-03-30 15:56:13,251 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=26, resume processing ppid=23 2024-03-30 15:56:13,252 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=26, ppid=23, state=SUCCESS; OpenRegionProcedure 59d3edc0fa4c3c9e91a7497b1b62f796, server=jenkins-hbase4.apache.org,43311,1711814166949 in 189 msec 2024-03-30 15:56:13,253 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=24, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=44d2e09382bc6197f4ccfe7580d6fcef, ASSIGN in 350 msec 2024-03-30 15:56:13,254 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=23, resume processing ppid=22 2024-03-30 15:56:13,255 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=23, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=59d3edc0fa4c3c9e91a7497b1b62f796, ASSIGN in 353 msec 2024-03-30 15:56:13,255 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-30 15:56:13,255 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711814173255"}]},"ts":"1711814173255"} 2024-03-30 15:56:13,257 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLED in hbase:meta 2024-03-30 15:56:13,260 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_POST_OPERATION 2024-03-30 15:56:13,262 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=22, state=SUCCESS; CreateTableProcedure table=TestNs:TestTable in 437 msec 2024-03-30 15:56:13,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-03-30 15:56:13,582 INFO [Listener at localhost/42871] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: TestNs:TestTable, procId: 22 completed 2024-03-30 15:56:13,583 DEBUG [Listener at localhost/42871] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestNs:TestTable get assigned. Timeout = 60000ms 2024-03-30 15:56:13,583 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:56:13,588 INFO [Listener at localhost/42871] hbase.HBaseTestingUtility(3484): All regions for table TestNs:TestTable assigned to meta. Checking AM states. 2024-03-30 15:56:13,588 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:56:13,588 INFO [Listener at localhost/42871] hbase.HBaseTestingUtility(3504): All regions for table TestNs:TestTable assigned. 2024-03-30 15:56:13,588 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:56:13,667 INFO [Listener at localhost/42871] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=307, OpenFileDescriptor=632, MaxFileDescriptor=60000, SystemLoadAverage=593, ProcessCount=168, AvailableMemoryMB=1967 2024-03-30 15:56:13,968 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:56:13,968 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-30 15:56:13,968 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711817773717 bypass), TestNs=QuotaState(ts=1711817773717 bypass)} 2024-03-30 15:56:13,969 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1711817773717 bypass), TestQuotaAdmin2=QuotaState(ts=1711817773717 bypass), TestQuotaAdmin1=QuotaState(ts=1711817773717 bypass)} 2024-03-30 15:56:13,969 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1711817773717 [ TestNs:TestTable ])} 2024-03-30 15:56:13,969 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711817773717 bypass)} 2024-03-30 15:56:14,198 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2024-03-30 15:56:14,219 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:56:14,219 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-30 15:56:14,219 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711817773717 bypass), TestNs=QuotaState(ts=1711817773717 bypass)} 2024-03-30 15:56:14,219 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1711817773717 bypass), TestNs:TestTable=QuotaState(ts=1711817773717 bypass)} 2024-03-30 15:56:14,220 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1711817773717 [ TestNs:TestTable ])} 2024-03-30 15:56:14,220 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711817773717 bypass)} 2024-03-30 15:56:14,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:14,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] ipc.CallRunner(144): callId: 90 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:34806 deadline: 1711814184236, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:14,261 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2024-03-30 15:56:14,262 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestNs:TestTable' 2024-03-30 15:56:14,263 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin2' 2024-03-30 15:56:14,263 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin1' 2024-03-30 15:56:14,264 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:quota' 2024-03-30 15:56:14,265 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin0' 2024-03-30 15:56:14,265 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2024-03-30 15:56:14,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:14,516 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] ipc.CallRunner(144): callId: 92 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:34806 deadline: 1711814184236, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:15,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:15,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] ipc.CallRunner(144): callId: 94 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:34806 deadline: 1711814184236, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:15,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:15,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] ipc.CallRunner(144): callId: 96 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:34806 deadline: 1711814184237, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:15,820 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-03-30 15:56:15,820 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver Metrics about HBase MasterObservers 2024-03-30 15:56:15,821 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-03-30 15:56:15,821 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2024-03-30 15:56:17,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:17,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] ipc.CallRunner(144): callId: 98 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:34806 deadline: 1711814184237, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:19,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:19,554 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] ipc.CallRunner(144): callId: 100 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:34806 deadline: 1711814184237, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:19,555 ERROR [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10353: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1711814172822.44d2e09382bc6197f4ccfe7580d6fcef., hostname=jenkins-hbase4.apache.org,44765,1711814166900, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-30 15:56:19,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:19,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] ipc.CallRunner(144): callId: 101 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:34806 deadline: 1711814189558, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:19,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:19,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] ipc.CallRunner(144): callId: 103 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:34806 deadline: 1711814189557, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:20,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:20,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] ipc.CallRunner(144): callId: 105 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:34806 deadline: 1711814189558, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:21,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:21,078 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] ipc.CallRunner(144): callId: 107 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:34806 deadline: 1711814189558, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:22,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:22,333 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] ipc.CallRunner(144): callId: 109 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:34806 deadline: 1711814189557, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:24,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:24,860 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] ipc.CallRunner(144): callId: 111 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:34806 deadline: 1711814189557, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:24,861 ERROR [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10328: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1711814172822.44d2e09382bc6197f4ccfe7580d6fcef., hostname=jenkins-hbase4.apache.org,44765,1711814166900, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-30 15:56:25,121 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:56:25,121 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-30 15:56:25,121 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711821373717 bypass), TestNs=QuotaState(ts=1711821373717 bypass)} 2024-03-30 15:56:25,121 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1711821373717 bypass), TestQuotaAdmin2=QuotaState(ts=1711821373717 bypass), TestQuotaAdmin1=QuotaState(ts=1711821373717 bypass)} 2024-03-30 15:56:25,121 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1711821373717 bypass)} 2024-03-30 15:56:25,121 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711821373717 bypass)} 2024-03-30 15:56:25,372 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:56:25,372 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-30 15:56:25,372 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711821373717 bypass), TestNs=QuotaState(ts=1711821373717 bypass)} 2024-03-30 15:56:25,372 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1711821373717 bypass), TestNs:TestTable=QuotaState(ts=1711821373717 bypass)} 2024-03-30 15:56:25,372 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1711821373717 bypass)} 2024-03-30 15:56:25,372 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711821373717 bypass)} 2024-03-30 15:56:25,388 INFO [Listener at localhost/42871] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=291 (was 307), OpenFileDescriptor=601 (was 632), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=501 (was 593), ProcessCount=167 (was 168), AvailableMemoryMB=1915 (was 1967) 2024-03-30 15:56:25,401 INFO [Listener at localhost/42871] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=291, OpenFileDescriptor=601, MaxFileDescriptor=60000, SystemLoadAverage=501, ProcessCount=167, AvailableMemoryMB=1914 2024-03-30 15:56:25,665 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:56:25,666 INFO [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-03-30 15:56:25,916 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-30 15:56:25,917 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711824973817 bypass), TestNs=QuotaState(ts=1711824973817 bypass)} 2024-03-30 15:56:25,918 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1711824973817 bypass), TestQuotaAdmin2=QuotaState(ts=1711824973817 bypass), TestQuotaAdmin1=QuotaState(ts=1711824973817 bypass)} 2024-03-30 15:56:25,918 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1711824973817 [ default ])} 2024-03-30 15:56:25,918 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711824973817 bypass)} 2024-03-30 15:56:26,169 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:56:26,169 INFO [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-03-30 15:56:26,419 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-30 15:56:26,420 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711824973917 bypass), TestNs=QuotaState(ts=1711824973917 bypass)} 2024-03-30 15:56:26,422 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1711824973917 bypass), TestNs:TestTable=QuotaState(ts=1711824973917 bypass)} 2024-03-30 15:56:26,422 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1711824973917 [ default ])} 2024-03-30 15:56:26,422 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711824973917 bypass)} 2024-03-30 15:56:26,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-30 15:56:26,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 123 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:37648 deadline: 1711814196431, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-30 15:56:26,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-30 15:56:26,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 125 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:37648 deadline: 1711814196431, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-30 15:56:27,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-30 15:56:27,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 127 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:37648 deadline: 1711814196431, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-30 15:56:27,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-30 15:56:27,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 129 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:37648 deadline: 1711814196431, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-30 15:56:29,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-30 15:56:29,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 131 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:37648 deadline: 1711814196430, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-30 15:56:31,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-30 15:56:31,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 133 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:37648 deadline: 1711814196430, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-30 15:56:31,713 ERROR [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10290: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc., hostname=jenkins-hbase4.apache.org,43311,1711814166949, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:199) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor37.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-30 15:56:31,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-30 15:56:31,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 140 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:37648 deadline: 1711814201729, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-30 15:56:31,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-30 15:56:31,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 142 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:37648 deadline: 1711814201729, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-30 15:56:32,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-30 15:56:32,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 144 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:37648 deadline: 1711814201729, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-30 15:56:33,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-30 15:56:33,245 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 146 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:37648 deadline: 1711814201729, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-30 15:56:34,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-30 15:56:34,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 148 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:37648 deadline: 1711814201729, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-30 15:56:37,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-30 15:56:37,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 150 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:37648 deadline: 1711814201728, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-30 15:56:37,032 ERROR [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10304: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc., hostname=jenkins-hbase4.apache.org,43311,1711814166949, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:200) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor37.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-30 15:56:37,289 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:56:37,289 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-30 15:56:37,289 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711828573917 bypass), TestNs=QuotaState(ts=1711828573917 bypass)} 2024-03-30 15:56:37,289 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1711828573917 bypass), TestQuotaAdmin2=QuotaState(ts=1711828573917 bypass), TestQuotaAdmin1=QuotaState(ts=1711828573917 bypass)} 2024-03-30 15:56:37,289 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1711828573917 bypass)} 2024-03-30 15:56:37,289 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711828573917 bypass)} 2024-03-30 15:56:37,540 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:56:37,540 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-30 15:56:37,540 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711828573917 bypass), TestNs=QuotaState(ts=1711828573917 bypass)} 2024-03-30 15:56:37,540 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1711828573917 bypass), TestNs:TestTable=QuotaState(ts=1711828573917 bypass)} 2024-03-30 15:56:37,540 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1711828573917 bypass)} 2024-03-30 15:56:37,540 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711828573917 bypass)} 2024-03-30 15:56:37,554 INFO [Listener at localhost/42871] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=291 (was 291), OpenFileDescriptor=597 (was 601), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=425 (was 501), ProcessCount=167 (was 167), AvailableMemoryMB=1904 (was 1914) 2024-03-30 15:56:37,568 INFO [Listener at localhost/42871] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=291, OpenFileDescriptor=597, MaxFileDescriptor=60000, SystemLoadAverage=425, ProcessCount=167, AvailableMemoryMB=1904 2024-03-30 15:56:37,829 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:56:37,829 INFO [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-03-30 15:56:38,080 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-30 15:56:38,081 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711832174017 bypass), TestNs=QuotaState(ts=1711832174017 bypass)} 2024-03-30 15:56:38,082 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1711832174017 bypass), TestQuotaAdmin2=QuotaState(ts=1711832174017 bypass), TestQuotaAdmin1=QuotaState(ts=1711832174017 bypass)} 2024-03-30 15:56:38,082 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1711832174017 global-limiter)} 2024-03-30 15:56:38,082 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711832174017 bypass)} 2024-03-30 15:56:38,333 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:56:38,333 INFO [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-03-30 15:56:38,583 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-30 15:56:38,584 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711832174117 bypass), TestNs=QuotaState(ts=1711832174117 bypass)} 2024-03-30 15:56:38,585 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1711832174117 bypass), TestNs:TestTable=QuotaState(ts=1711832174117 bypass)} 2024-03-30 15:56:38,585 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1711832174117 global-limiter)} 2024-03-30 15:56:38,585 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711832174117 bypass)} 2024-03-30 15:56:38,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-30 15:56:38,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 163 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:37648 deadline: 1711814208601, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-30 15:56:38,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-30 15:56:38,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 165 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:37648 deadline: 1711814208600, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-30 15:56:39,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-30 15:56:39,362 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 167 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:37648 deadline: 1711814208601, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-30 15:56:40,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-30 15:56:40,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 169 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:37648 deadline: 1711814208601, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-30 15:56:41,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-30 15:56:41,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 171 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:37648 deadline: 1711814208601, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-30 15:56:43,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-30 15:56:43,907 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 173 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:37648 deadline: 1711814208601, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-30 15:56:43,908 ERROR [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10334: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc., hostname=jenkins-hbase4.apache.org,43311,1711814166949, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:178) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor37.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-30 15:56:43,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-30 15:56:43,915 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 177 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:37648 deadline: 1711814213915, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-30 15:56:44,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-30 15:56:44,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 179 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:37648 deadline: 1711814213914, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-30 15:56:44,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-30 15:56:44,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 181 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:37648 deadline: 1711814213914, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-30 15:56:45,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-30 15:56:45,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 183 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:37648 deadline: 1711814213914, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-30 15:56:46,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-30 15:56:46,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 185 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:37648 deadline: 1711814213915, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-30 15:56:49,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-30 15:56:49,213 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 187 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:37648 deadline: 1711814213915, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-30 15:56:49,214 ERROR [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=3 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10338: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-3' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc., hostname=jenkins-hbase4.apache.org,43311,1711814166949, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor37.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-30 15:56:49,470 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:56:49,470 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-30 15:56:49,471 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711835774117 bypass), TestNs=QuotaState(ts=1711835774117 bypass)} 2024-03-30 15:56:49,471 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1711835774117 bypass), TestQuotaAdmin2=QuotaState(ts=1711835774117 bypass), TestQuotaAdmin1=QuotaState(ts=1711835774117 bypass)} 2024-03-30 15:56:49,471 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1711835774117 bypass)} 2024-03-30 15:56:49,471 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711835774117 bypass)} 2024-03-30 15:56:49,721 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:56:49,721 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-30 15:56:49,721 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711835774117 bypass), TestNs=QuotaState(ts=1711835774117 bypass)} 2024-03-30 15:56:49,721 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1711835774117 bypass), TestNs:TestTable=QuotaState(ts=1711835774117 bypass)} 2024-03-30 15:56:49,721 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1711835774117 bypass)} 2024-03-30 15:56:49,721 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711835774117 bypass)} 2024-03-30 15:56:49,735 INFO [Listener at localhost/42871] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=282 (was 291), OpenFileDescriptor=595 (was 597), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=331 (was 425), ProcessCount=167 (was 167), AvailableMemoryMB=1900 (was 1904) 2024-03-30 15:56:49,749 INFO [Listener at localhost/42871] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=282, OpenFileDescriptor=595, MaxFileDescriptor=60000, SystemLoadAverage=331, ProcessCount=167, AvailableMemoryMB=1900 2024-03-30 15:56:50,006 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:56:50,007 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-30 15:56:50,008 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711839374117 bypass), TestNs=QuotaState(ts=1711839374117 bypass)} 2024-03-30 15:56:50,010 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1711839374117 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin2=QuotaState(ts=1711839374117 bypass), TestQuotaAdmin1=QuotaState(ts=1711839374117 bypass)} 2024-03-30 15:56:50,010 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-30 15:56:50,011 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711839374117 bypass)} 2024-03-30 15:56:50,261 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:56:50,261 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-30 15:56:50,261 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711839374117 bypass), TestNs=QuotaState(ts=1711839374117 bypass)} 2024-03-30 15:56:50,262 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1711839374117 bypass), TestNs:TestTable=QuotaState(ts=1711839374117 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000)))} 2024-03-30 15:56:50,262 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-30 15:56:50,262 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711839374117 bypass)} 2024-03-30 15:56:50,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:50,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] ipc.CallRunner(144): callId: 202 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:34806 deadline: 1711814220276, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:50,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:50,533 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] ipc.CallRunner(144): callId: 204 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:34806 deadline: 1711814220276, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:51,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:51,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] ipc.CallRunner(144): callId: 206 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:34806 deadline: 1711814220276, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:51,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:51,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] ipc.CallRunner(144): callId: 208 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:34806 deadline: 1711814220276, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:53,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:53,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] ipc.CallRunner(144): callId: 210 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:34806 deadline: 1711814220277, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:55,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:55,568 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] ipc.CallRunner(144): callId: 212 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:34806 deadline: 1711814220277, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:55,569 ERROR [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10318: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1711814172822.44d2e09382bc6197f4ccfe7580d6fcef., hostname=jenkins-hbase4.apache.org,44765,1711814166900, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor37.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-30 15:56:55,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:55,570 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] ipc.CallRunner(144): callId: 213 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:34806 deadline: 1711814225570, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:55,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:55,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] ipc.CallRunner(144): callId: 215 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:34806 deadline: 1711814225571, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:56,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:56,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] ipc.CallRunner(144): callId: 217 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:34806 deadline: 1711814225570, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:57,089 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:57,090 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] ipc.CallRunner(144): callId: 219 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:34806 deadline: 1711814225570, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:58,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:56:58,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] ipc.CallRunner(144): callId: 221 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:34806 deadline: 1711814225571, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:57:00,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:57:00,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44765] ipc.CallRunner(144): callId: 223 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:34806 deadline: 1711814225571, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-30 15:57:00,865 ERROR [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10311: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1711814172822.44d2e09382bc6197f4ccfe7580d6fcef., hostname=jenkins-hbase4.apache.org,44765,1711814166900, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor37.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-30 15:57:01,126 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:57:01,126 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-30 15:57:01,126 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711842974117 bypass), TestNs=QuotaState(ts=1711842974117 bypass)} 2024-03-30 15:57:01,126 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1711842974117 bypass), TestQuotaAdmin2=QuotaState(ts=1711842974117 bypass), TestQuotaAdmin1=QuotaState(ts=1711842974117 bypass)} 2024-03-30 15:57:01,126 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1711842974117 bypass)} 2024-03-30 15:57:01,126 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711842974117 bypass)} 2024-03-30 15:57:01,377 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:57:01,377 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-30 15:57:01,377 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711842974117 bypass), TestNs=QuotaState(ts=1711842974117 bypass)} 2024-03-30 15:57:01,377 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1711842974117 bypass), TestNs:TestTable=QuotaState(ts=1711842974117 bypass)} 2024-03-30 15:57:01,377 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-30 15:57:01,377 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711842974117 bypass)} 2024-03-30 15:57:01,394 INFO [Listener at localhost/42871] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=282 (was 282), OpenFileDescriptor=595 (was 595), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=280 (was 331), ProcessCount=167 (was 167), AvailableMemoryMB=1909 (was 1900) - AvailableMemoryMB LEAK? - 2024-03-30 15:57:01,408 INFO [Listener at localhost/42871] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=282, OpenFileDescriptor=595, MaxFileDescriptor=60000, SystemLoadAverage=280, ProcessCount=167, AvailableMemoryMB=1910 2024-03-30 15:57:01,671 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:57:01,671 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-30 15:57:01,672 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711846574117 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1711846574117 bypass)} 2024-03-30 15:57:01,672 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1711846574117 bypass), TestQuotaAdmin2=QuotaState(ts=1711846574117 bypass), TestQuotaAdmin1=QuotaState(ts=1711846574117 bypass)} 2024-03-30 15:57:01,672 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-30 15:57:01,672 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711846574117 bypass)} 2024-03-30 15:57:01,922 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:57:01,922 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-30 15:57:01,923 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711846574117 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1711846574117 bypass)} 2024-03-30 15:57:01,924 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1711846574117 bypass), TestNs:TestTable=QuotaState(ts=1711846574117 bypass)} 2024-03-30 15:57:01,924 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-30 15:57:01,924 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711846574117 bypass)} 2024-03-30 15:57:01,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-30 15:57:01,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 235 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:37648 deadline: 1711814231939, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-30 15:57:02,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-30 15:57:02,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 237 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:37648 deadline: 1711814231938, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-30 15:57:02,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-30 15:57:02,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 239 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:37648 deadline: 1711814231939, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-30 15:57:03,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-30 15:57:03,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 241 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:37648 deadline: 1711814231939, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-30 15:57:04,715 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-30 15:57:04,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 243 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:37648 deadline: 1711814231938, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-30 15:57:07,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-30 15:57:07,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 245 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:37648 deadline: 1711814231939, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-30 15:57:07,241 ERROR [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10326: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc., hostname=jenkins-hbase4.apache.org,43311,1711814166949, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:128) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor37.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-30 15:57:07,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-30 15:57:07,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 252 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:37648 deadline: 1711814237251, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-30 15:57:07,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-30 15:57:07,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 254 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:37648 deadline: 1711814237251, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-30 15:57:08,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-30 15:57:08,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 256 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:37648 deadline: 1711814237252, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-30 15:57:08,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-30 15:57:08,767 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 258 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:37648 deadline: 1711814237252, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-30 15:57:10,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-30 15:57:10,022 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 260 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:37648 deadline: 1711814237251, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-30 15:57:12,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-30 15:57:12,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43311] ipc.CallRunner(144): callId: 262 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:37648 deadline: 1711814237251, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-30 15:57:12,532 ERROR [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10295: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc., hostname=jenkins-hbase4.apache.org,43311,1711814166949, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor37.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-30 15:57:12,790 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:57:12,790 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-30 15:57:12,790 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711850174117 bypass), TestNs=QuotaState(ts=1711850174117 bypass)} 2024-03-30 15:57:12,791 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1711850174117 bypass), TestQuotaAdmin2=QuotaState(ts=1711850174117 bypass), TestQuotaAdmin1=QuotaState(ts=1711850174117 bypass)} 2024-03-30 15:57:12,791 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-30 15:57:12,791 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711850174117 bypass)} 2024-03-30 15:57:13,041 INFO [Listener at localhost/42871] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-30 15:57:13,041 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-30 15:57:13,041 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711850174117 bypass), TestNs=QuotaState(ts=1711850174117 bypass)} 2024-03-30 15:57:13,041 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1711850174117 bypass), TestNs:TestTable=QuotaState(ts=1711850174117 bypass)} 2024-03-30 15:57:13,041 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1711850174117 bypass)} 2024-03-30 15:57:13,041 DEBUG [Listener at localhost/42871] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711850174117 bypass)} 2024-03-30 15:57:13,055 INFO [Listener at localhost/42871] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=266 (was 282), OpenFileDescriptor=586 (was 595), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=267 (was 280), ProcessCount=167 (was 167), AvailableMemoryMB=1729 (was 1910) 2024-03-30 15:57:13,058 INFO [Listener at localhost/42871] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin0 2024-03-30 15:57:13,062 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin0 2024-03-30 15:57:13,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] procedure2.ProcedureExecutor(1075): Stored pid=27, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin0 2024-03-30 15:57:13,073 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711814233073"}]},"ts":"1711814233073"} 2024-03-30 15:57:13,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-03-30 15:57:13,075 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLING in hbase:meta 2024-03-30 15:57:13,077 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set TestQuotaAdmin0 to state=DISABLING 2024-03-30 15:57:13,079 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=f49f78bfd9a64a3375041a4daa036ecc, UNASSIGN}] 2024-03-30 15:57:13,080 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=f49f78bfd9a64a3375041a4daa036ecc, UNASSIGN 2024-03-30 15:57:13,081 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=f49f78bfd9a64a3375041a4daa036ecc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43311,1711814166949 2024-03-30 15:57:13,081 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711814233081"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1711814233081"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1711814233081"}]},"ts":"1711814233081"} 2024-03-30 15:57:13,083 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure f49f78bfd9a64a3375041a4daa036ecc, server=jenkins-hbase4.apache.org,43311,1711814166949}] 2024-03-30 15:57:13,213 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase4.apache.org,43311,1711814166949, timeout=1711814233238, delay=25, operations=[pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure f49f78bfd9a64a3375041a4daa036ecc, server=jenkins-hbase4.apache.org,43311,1711814166949]] 2024-03-30 15:57:13,240 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43311,1711814166949 2024-03-30 15:57:13,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f49f78bfd9a64a3375041a4daa036ecc 2024-03-30 15:57:13,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f49f78bfd9a64a3375041a4daa036ecc, disabling compactions & flushes 2024-03-30 15:57:13,243 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc. 2024-03-30 15:57:13,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc. 2024-03-30 15:57:13,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc. after waiting 0 ms 2024-03-30 15:57:13,243 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc. 2024-03-30 15:57:13,244 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f49f78bfd9a64a3375041a4daa036ecc 1/1 column families, dataSize=578 B heapSize=2.11 KB 2024-03-30 15:57:13,318 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=578 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/default/TestQuotaAdmin0/f49f78bfd9a64a3375041a4daa036ecc/.tmp/cf/6e3bba8985b54b70a864dc21b5cbf464 2024-03-30 15:57:13,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-03-30 15:57:13,365 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/default/TestQuotaAdmin0/f49f78bfd9a64a3375041a4daa036ecc/.tmp/cf/6e3bba8985b54b70a864dc21b5cbf464 as hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/default/TestQuotaAdmin0/f49f78bfd9a64a3375041a4daa036ecc/cf/6e3bba8985b54b70a864dc21b5cbf464 2024-03-30 15:57:13,375 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/default/TestQuotaAdmin0/f49f78bfd9a64a3375041a4daa036ecc/cf/6e3bba8985b54b70a864dc21b5cbf464, entries=6, sequenceid=21, filesize=4.7 K 2024-03-30 15:57:13,378 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~578 B/578, heapSize ~2.09 KB/2144, currentSize=0 B/0 for f49f78bfd9a64a3375041a4daa036ecc in 134ms, sequenceid=21, compaction requested=false 2024-03-30 15:57:13,386 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/default/TestQuotaAdmin0/f49f78bfd9a64a3375041a4daa036ecc/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2024-03-30 15:57:13,388 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc. 2024-03-30 15:57:13,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f49f78bfd9a64a3375041a4daa036ecc: 2024-03-30 15:57:13,390 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f49f78bfd9a64a3375041a4daa036ecc 2024-03-30 15:57:13,391 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=f49f78bfd9a64a3375041a4daa036ecc, regionState=CLOSED 2024-03-30 15:57:13,391 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711814233391"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1711814233391"}]},"ts":"1711814233391"} 2024-03-30 15:57:13,395 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=29, resume processing ppid=28 2024-03-30 15:57:13,395 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=29, ppid=28, state=SUCCESS; CloseRegionProcedure f49f78bfd9a64a3375041a4daa036ecc, server=jenkins-hbase4.apache.org,43311,1711814166949 in 310 msec 2024-03-30 15:57:13,397 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=28, resume processing ppid=27 2024-03-30 15:57:13,397 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=f49f78bfd9a64a3375041a4daa036ecc, UNASSIGN in 316 msec 2024-03-30 15:57:13,398 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711814233398"}]},"ts":"1711814233398"} 2024-03-30 15:57:13,400 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLED in hbase:meta 2024-03-30 15:57:13,402 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set TestQuotaAdmin0 to state=DISABLED 2024-03-30 15:57:13,405 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=27, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin0 in 340 msec 2024-03-30 15:57:13,827 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-03-30 15:57:13,827 INFO [Listener at localhost/42871] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin0, procId: 27 completed 2024-03-30 15:57:13,833 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin0 2024-03-30 15:57:13,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] procedure2.ProcedureExecutor(1075): Stored pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-30 15:57:13,842 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-30 15:57:13,844 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=30, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-30 15:57:13,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-03-30 15:57:13,852 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/default/TestQuotaAdmin0/f49f78bfd9a64a3375041a4daa036ecc 2024-03-30 15:57:13,856 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/default/TestQuotaAdmin0/f49f78bfd9a64a3375041a4daa036ecc/cf, FileablePath, hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/default/TestQuotaAdmin0/f49f78bfd9a64a3375041a4daa036ecc/recovered.edits] 2024-03-30 15:57:13,866 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/default/TestQuotaAdmin0/f49f78bfd9a64a3375041a4daa036ecc/cf/6e3bba8985b54b70a864dc21b5cbf464 to hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/archive/data/default/TestQuotaAdmin0/f49f78bfd9a64a3375041a4daa036ecc/cf/6e3bba8985b54b70a864dc21b5cbf464 2024-03-30 15:57:13,872 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/default/TestQuotaAdmin0/f49f78bfd9a64a3375041a4daa036ecc/recovered.edits/24.seqid to hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/archive/data/default/TestQuotaAdmin0/f49f78bfd9a64a3375041a4daa036ecc/recovered.edits/24.seqid 2024-03-30 15:57:13,874 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/default/TestQuotaAdmin0/f49f78bfd9a64a3375041a4daa036ecc 2024-03-30 15:57:13,874 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-03-30 15:57:13,877 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=30, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-30 15:57:13,899 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin0 from hbase:meta 2024-03-30 15:57:13,902 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin0' descriptor. 2024-03-30 15:57:13,904 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=30, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-30 15:57:13,904 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin0' from region states. 2024-03-30 15:57:13,904 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1711814233904"}]},"ts":"9223372036854775807"} 2024-03-30 15:57:13,907 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-03-30 15:57:13,907 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f49f78bfd9a64a3375041a4daa036ecc, NAME => 'TestQuotaAdmin0,,1711814170188.f49f78bfd9a64a3375041a4daa036ecc.', STARTKEY => '', ENDKEY => ''}] 2024-03-30 15:57:13,907 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin0' as deleted. 2024-03-30 15:57:13,907 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1711814233907"}]},"ts":"9223372036854775807"} 2024-03-30 15:57:13,909 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin0 state from META 2024-03-30 15:57:13,912 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=30, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-30 15:57:13,914 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=30, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin0 in 78 msec 2024-03-30 15:57:14,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-03-30 15:57:14,100 INFO [Listener at localhost/42871] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin0, procId: 30 completed 2024-03-30 15:57:14,101 INFO [Listener at localhost/42871] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin1 2024-03-30 15:57:14,101 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin1 2024-03-30 15:57:14,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] procedure2.ProcedureExecutor(1075): Stored pid=31, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin1 2024-03-30 15:57:14,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-03-30 15:57:14,106 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711814234106"}]},"ts":"1711814234106"} 2024-03-30 15:57:14,108 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLING in hbase:meta 2024-03-30 15:57:14,110 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set TestQuotaAdmin1 to state=DISABLING 2024-03-30 15:57:14,111 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=a81bfcbbc320432e83b32b27cd2ed3f3, UNASSIGN}] 2024-03-30 15:57:14,112 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=a81bfcbbc320432e83b32b27cd2ed3f3, UNASSIGN 2024-03-30 15:57:14,113 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=a81bfcbbc320432e83b32b27cd2ed3f3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44765,1711814166900 2024-03-30 15:57:14,113 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1711814170999.a81bfcbbc320432e83b32b27cd2ed3f3.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711814234113"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1711814234113"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1711814234113"}]},"ts":"1711814234113"} 2024-03-30 15:57:14,115 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=33, ppid=32, state=RUNNABLE; CloseRegionProcedure a81bfcbbc320432e83b32b27cd2ed3f3, server=jenkins-hbase4.apache.org,44765,1711814166900}] 2024-03-30 15:57:14,267 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44765,1711814166900 2024-03-30 15:57:14,268 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a81bfcbbc320432e83b32b27cd2ed3f3 2024-03-30 15:57:14,268 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a81bfcbbc320432e83b32b27cd2ed3f3, disabling compactions & flushes 2024-03-30 15:57:14,268 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1711814170999.a81bfcbbc320432e83b32b27cd2ed3f3. 2024-03-30 15:57:14,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1711814170999.a81bfcbbc320432e83b32b27cd2ed3f3. 2024-03-30 15:57:14,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1711814170999.a81bfcbbc320432e83b32b27cd2ed3f3. after waiting 0 ms 2024-03-30 15:57:14,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1711814170999.a81bfcbbc320432e83b32b27cd2ed3f3. 2024-03-30 15:57:14,276 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/default/TestQuotaAdmin1/a81bfcbbc320432e83b32b27cd2ed3f3/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-03-30 15:57:14,278 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1711814170999.a81bfcbbc320432e83b32b27cd2ed3f3. 2024-03-30 15:57:14,278 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a81bfcbbc320432e83b32b27cd2ed3f3: 2024-03-30 15:57:14,280 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a81bfcbbc320432e83b32b27cd2ed3f3 2024-03-30 15:57:14,281 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=a81bfcbbc320432e83b32b27cd2ed3f3, regionState=CLOSED 2024-03-30 15:57:14,281 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1711814170999.a81bfcbbc320432e83b32b27cd2ed3f3.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711814234281"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1711814234281"}]},"ts":"1711814234281"} 2024-03-30 15:57:14,285 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=33, resume processing ppid=32 2024-03-30 15:57:14,285 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=33, ppid=32, state=SUCCESS; CloseRegionProcedure a81bfcbbc320432e83b32b27cd2ed3f3, server=jenkins-hbase4.apache.org,44765,1711814166900 in 167 msec 2024-03-30 15:57:14,287 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=32, resume processing ppid=31 2024-03-30 15:57:14,287 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=32, ppid=31, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=a81bfcbbc320432e83b32b27cd2ed3f3, UNASSIGN in 174 msec 2024-03-30 15:57:14,288 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711814234288"}]},"ts":"1711814234288"} 2024-03-30 15:57:14,289 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLED in hbase:meta 2024-03-30 15:57:14,291 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set TestQuotaAdmin1 to state=DISABLED 2024-03-30 15:57:14,293 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=31, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin1 in 191 msec 2024-03-30 15:57:14,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-03-30 15:57:14,357 INFO [Listener at localhost/42871] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin1, procId: 31 completed 2024-03-30 15:57:14,358 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin1 2024-03-30 15:57:14,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] procedure2.ProcedureExecutor(1075): Stored pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-30 15:57:14,361 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-30 15:57:14,362 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=34, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-30 15:57:14,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-03-30 15:57:14,367 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/default/TestQuotaAdmin1/a81bfcbbc320432e83b32b27cd2ed3f3 2024-03-30 15:57:14,370 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/default/TestQuotaAdmin1/a81bfcbbc320432e83b32b27cd2ed3f3/cf, FileablePath, hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/default/TestQuotaAdmin1/a81bfcbbc320432e83b32b27cd2ed3f3/recovered.edits] 2024-03-30 15:57:14,378 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/default/TestQuotaAdmin1/a81bfcbbc320432e83b32b27cd2ed3f3/recovered.edits/4.seqid to hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/archive/data/default/TestQuotaAdmin1/a81bfcbbc320432e83b32b27cd2ed3f3/recovered.edits/4.seqid 2024-03-30 15:57:14,379 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/default/TestQuotaAdmin1/a81bfcbbc320432e83b32b27cd2ed3f3 2024-03-30 15:57:14,379 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-03-30 15:57:14,382 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=34, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-30 15:57:14,384 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin1 from hbase:meta 2024-03-30 15:57:14,386 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin1' descriptor. 2024-03-30 15:57:14,388 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=34, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-30 15:57:14,388 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin1' from region states. 2024-03-30 15:57:14,388 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1,,1711814170999.a81bfcbbc320432e83b32b27cd2ed3f3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1711814234388"}]},"ts":"9223372036854775807"} 2024-03-30 15:57:14,390 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-03-30 15:57:14,390 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a81bfcbbc320432e83b32b27cd2ed3f3, NAME => 'TestQuotaAdmin1,,1711814170999.a81bfcbbc320432e83b32b27cd2ed3f3.', STARTKEY => '', ENDKEY => ''}] 2024-03-30 15:57:14,390 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin1' as deleted. 2024-03-30 15:57:14,390 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1711814234390"}]},"ts":"9223372036854775807"} 2024-03-30 15:57:14,392 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin1 state from META 2024-03-30 15:57:14,394 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=34, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-30 15:57:14,396 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=34, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin1 in 36 msec 2024-03-30 15:57:14,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-03-30 15:57:14,616 INFO [Listener at localhost/42871] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin1, procId: 34 completed 2024-03-30 15:57:14,616 INFO [Listener at localhost/42871] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin2 2024-03-30 15:57:14,617 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin2 2024-03-30 15:57:14,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] procedure2.ProcedureExecutor(1075): Stored pid=35, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin2 2024-03-30 15:57:14,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-03-30 15:57:14,621 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711814234621"}]},"ts":"1711814234621"} 2024-03-30 15:57:14,623 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLING in hbase:meta 2024-03-30 15:57:14,625 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set TestQuotaAdmin2 to state=DISABLING 2024-03-30 15:57:14,626 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=d7ae2674055ddc809f1c3ab9c364dd95, UNASSIGN}] 2024-03-30 15:57:14,627 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=d7ae2674055ddc809f1c3ab9c364dd95, UNASSIGN 2024-03-30 15:57:14,628 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=d7ae2674055ddc809f1c3ab9c364dd95, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44765,1711814166900 2024-03-30 15:57:14,628 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1711814171779.d7ae2674055ddc809f1c3ab9c364dd95.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711814234627"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1711814234627"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1711814234627"}]},"ts":"1711814234627"} 2024-03-30 15:57:14,629 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; CloseRegionProcedure d7ae2674055ddc809f1c3ab9c364dd95, server=jenkins-hbase4.apache.org,44765,1711814166900}] 2024-03-30 15:57:14,781 DEBUG [RSProcedureDispatcher-pool-5] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44765,1711814166900 2024-03-30 15:57:14,782 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d7ae2674055ddc809f1c3ab9c364dd95 2024-03-30 15:57:14,782 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d7ae2674055ddc809f1c3ab9c364dd95, disabling compactions & flushes 2024-03-30 15:57:14,783 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1711814171779.d7ae2674055ddc809f1c3ab9c364dd95. 2024-03-30 15:57:14,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1711814171779.d7ae2674055ddc809f1c3ab9c364dd95. 2024-03-30 15:57:14,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1711814171779.d7ae2674055ddc809f1c3ab9c364dd95. after waiting 0 ms 2024-03-30 15:57:14,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1711814171779.d7ae2674055ddc809f1c3ab9c364dd95. 2024-03-30 15:57:14,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/default/TestQuotaAdmin2/d7ae2674055ddc809f1c3ab9c364dd95/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-03-30 15:57:14,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1711814171779.d7ae2674055ddc809f1c3ab9c364dd95. 2024-03-30 15:57:14,789 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d7ae2674055ddc809f1c3ab9c364dd95: 2024-03-30 15:57:14,791 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d7ae2674055ddc809f1c3ab9c364dd95 2024-03-30 15:57:14,791 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=d7ae2674055ddc809f1c3ab9c364dd95, regionState=CLOSED 2024-03-30 15:57:14,791 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1711814171779.d7ae2674055ddc809f1c3ab9c364dd95.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711814234791"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1711814234791"}]},"ts":"1711814234791"} 2024-03-30 15:57:14,795 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=37, resume processing ppid=36 2024-03-30 15:57:14,795 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=37, ppid=36, state=SUCCESS; CloseRegionProcedure d7ae2674055ddc809f1c3ab9c364dd95, server=jenkins-hbase4.apache.org,44765,1711814166900 in 164 msec 2024-03-30 15:57:14,797 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=36, resume processing ppid=35 2024-03-30 15:57:14,798 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=d7ae2674055ddc809f1c3ab9c364dd95, UNASSIGN in 169 msec 2024-03-30 15:57:14,798 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711814234798"}]},"ts":"1711814234798"} 2024-03-30 15:57:14,799 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLED in hbase:meta 2024-03-30 15:57:14,801 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set TestQuotaAdmin2 to state=DISABLED 2024-03-30 15:57:14,803 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=35, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin2 in 185 msec 2024-03-30 15:57:14,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-03-30 15:57:14,873 INFO [Listener at localhost/42871] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin2, procId: 35 completed 2024-03-30 15:57:14,873 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin2 2024-03-30 15:57:14,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] procedure2.ProcedureExecutor(1075): Stored pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-30 15:57:14,877 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-30 15:57:14,878 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=38, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-30 15:57:14,879 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-03-30 15:57:14,882 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/default/TestQuotaAdmin2/d7ae2674055ddc809f1c3ab9c364dd95 2024-03-30 15:57:14,885 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/default/TestQuotaAdmin2/d7ae2674055ddc809f1c3ab9c364dd95/cf, FileablePath, hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/default/TestQuotaAdmin2/d7ae2674055ddc809f1c3ab9c364dd95/recovered.edits] 2024-03-30 15:57:14,892 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/default/TestQuotaAdmin2/d7ae2674055ddc809f1c3ab9c364dd95/recovered.edits/4.seqid to hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/archive/data/default/TestQuotaAdmin2/d7ae2674055ddc809f1c3ab9c364dd95/recovered.edits/4.seqid 2024-03-30 15:57:14,893 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/default/TestQuotaAdmin2/d7ae2674055ddc809f1c3ab9c364dd95 2024-03-30 15:57:14,893 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-03-30 15:57:14,896 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=38, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-30 15:57:14,898 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin2 from hbase:meta 2024-03-30 15:57:14,900 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin2' descriptor. 2024-03-30 15:57:14,901 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=38, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-30 15:57:14,901 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin2' from region states. 2024-03-30 15:57:14,901 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2,,1711814171779.d7ae2674055ddc809f1c3ab9c364dd95.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1711814234901"}]},"ts":"9223372036854775807"} 2024-03-30 15:57:14,903 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-03-30 15:57:14,903 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d7ae2674055ddc809f1c3ab9c364dd95, NAME => 'TestQuotaAdmin2,,1711814171779.d7ae2674055ddc809f1c3ab9c364dd95.', STARTKEY => '', ENDKEY => ''}] 2024-03-30 15:57:14,903 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin2' as deleted. 2024-03-30 15:57:14,903 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1711814234903"}]},"ts":"9223372036854775807"} 2024-03-30 15:57:14,905 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin2 state from META 2024-03-30 15:57:14,907 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=38, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-30 15:57:14,909 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=38, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin2 in 33 msec 2024-03-30 15:57:15,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-03-30 15:57:15,131 INFO [Listener at localhost/42871] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin2, procId: 38 completed 2024-03-30 15:57:15,132 INFO [Listener at localhost/42871] client.HBaseAdmin$15(890): Started disable of TestNs:TestTable 2024-03-30 15:57:15,132 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestNs:TestTable 2024-03-30 15:57:15,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] procedure2.ProcedureExecutor(1075): Stored pid=39, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestNs:TestTable 2024-03-30 15:57:15,136 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-03-30 15:57:15,137 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711814235137"}]},"ts":"1711814235137"} 2024-03-30 15:57:15,138 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLING in hbase:meta 2024-03-30 15:57:15,141 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set TestNs:TestTable to state=DISABLING 2024-03-30 15:57:15,142 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=59d3edc0fa4c3c9e91a7497b1b62f796, UNASSIGN}, {pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=44d2e09382bc6197f4ccfe7580d6fcef, UNASSIGN}] 2024-03-30 15:57:15,143 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=44d2e09382bc6197f4ccfe7580d6fcef, UNASSIGN 2024-03-30 15:57:15,143 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=59d3edc0fa4c3c9e91a7497b1b62f796, UNASSIGN 2024-03-30 15:57:15,144 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=44d2e09382bc6197f4ccfe7580d6fcef, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44765,1711814166900 2024-03-30 15:57:15,144 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=59d3edc0fa4c3c9e91a7497b1b62f796, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43311,1711814166949 2024-03-30 15:57:15,144 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1711814172822.44d2e09382bc6197f4ccfe7580d6fcef.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1711814235144"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1711814235144"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1711814235144"}]},"ts":"1711814235144"} 2024-03-30 15:57:15,144 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1711814172822.59d3edc0fa4c3c9e91a7497b1b62f796.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1711814235144"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1711814235144"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1711814235144"}]},"ts":"1711814235144"} 2024-03-30 15:57:15,146 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=42, ppid=40, state=RUNNABLE; CloseRegionProcedure 59d3edc0fa4c3c9e91a7497b1b62f796, server=jenkins-hbase4.apache.org,43311,1711814166949}] 2024-03-30 15:57:15,147 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=43, ppid=41, state=RUNNABLE; CloseRegionProcedure 44d2e09382bc6197f4ccfe7580d6fcef, server=jenkins-hbase4.apache.org,44765,1711814166900}] 2024-03-30 15:57:15,298 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43311,1711814166949 2024-03-30 15:57:15,299 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 59d3edc0fa4c3c9e91a7497b1b62f796 2024-03-30 15:57:15,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 59d3edc0fa4c3c9e91a7497b1b62f796, disabling compactions & flushes 2024-03-30 15:57:15,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1711814172822.59d3edc0fa4c3c9e91a7497b1b62f796. 2024-03-30 15:57:15,300 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44765,1711814166900 2024-03-30 15:57:15,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1711814172822.59d3edc0fa4c3c9e91a7497b1b62f796. 2024-03-30 15:57:15,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1711814172822.59d3edc0fa4c3c9e91a7497b1b62f796. after waiting 0 ms 2024-03-30 15:57:15,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1711814172822.59d3edc0fa4c3c9e91a7497b1b62f796. 2024-03-30 15:57:15,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 44d2e09382bc6197f4ccfe7580d6fcef 2024-03-30 15:57:15,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 44d2e09382bc6197f4ccfe7580d6fcef, disabling compactions & flushes 2024-03-30 15:57:15,301 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1711814172822.44d2e09382bc6197f4ccfe7580d6fcef. 2024-03-30 15:57:15,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1711814172822.44d2e09382bc6197f4ccfe7580d6fcef. 2024-03-30 15:57:15,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1711814172822.44d2e09382bc6197f4ccfe7580d6fcef. after waiting 0 ms 2024-03-30 15:57:15,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1711814172822.44d2e09382bc6197f4ccfe7580d6fcef. 2024-03-30 15:57:15,305 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/TestNs/TestTable/59d3edc0fa4c3c9e91a7497b1b62f796/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-03-30 15:57:15,306 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/TestNs/TestTable/44d2e09382bc6197f4ccfe7580d6fcef/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-03-30 15:57:15,307 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1711814172822.59d3edc0fa4c3c9e91a7497b1b62f796. 2024-03-30 15:57:15,307 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 59d3edc0fa4c3c9e91a7497b1b62f796: 2024-03-30 15:57:15,308 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1711814172822.44d2e09382bc6197f4ccfe7580d6fcef. 2024-03-30 15:57:15,308 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 44d2e09382bc6197f4ccfe7580d6fcef: 2024-03-30 15:57:15,310 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 59d3edc0fa4c3c9e91a7497b1b62f796 2024-03-30 15:57:15,310 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=59d3edc0fa4c3c9e91a7497b1b62f796, regionState=CLOSED 2024-03-30 15:57:15,310 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,,1711814172822.59d3edc0fa4c3c9e91a7497b1b62f796.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1711814235310"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1711814235310"}]},"ts":"1711814235310"} 2024-03-30 15:57:15,311 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 44d2e09382bc6197f4ccfe7580d6fcef 2024-03-30 15:57:15,312 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=44d2e09382bc6197f4ccfe7580d6fcef, regionState=CLOSED 2024-03-30 15:57:15,312 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1711814172822.44d2e09382bc6197f4ccfe7580d6fcef.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1711814235312"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1711814235312"}]},"ts":"1711814235312"} 2024-03-30 15:57:15,314 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=42, resume processing ppid=40 2024-03-30 15:57:15,315 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=42, ppid=40, state=SUCCESS; CloseRegionProcedure 59d3edc0fa4c3c9e91a7497b1b62f796, server=jenkins-hbase4.apache.org,43311,1711814166949 in 166 msec 2024-03-30 15:57:15,316 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=43, resume processing ppid=41 2024-03-30 15:57:15,316 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=43, ppid=41, state=SUCCESS; CloseRegionProcedure 44d2e09382bc6197f4ccfe7580d6fcef, server=jenkins-hbase4.apache.org,44765,1711814166900 in 167 msec 2024-03-30 15:57:15,317 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=59d3edc0fa4c3c9e91a7497b1b62f796, UNASSIGN in 174 msec 2024-03-30 15:57:15,318 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=41, resume processing ppid=39 2024-03-30 15:57:15,318 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=41, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=44d2e09382bc6197f4ccfe7580d6fcef, UNASSIGN in 175 msec 2024-03-30 15:57:15,319 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711814235319"}]},"ts":"1711814235319"} 2024-03-30 15:57:15,320 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLED in hbase:meta 2024-03-30 15:57:15,322 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set TestNs:TestTable to state=DISABLED 2024-03-30 15:57:15,324 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=39, state=SUCCESS; DisableTableProcedure table=TestNs:TestTable in 191 msec 2024-03-30 15:57:15,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-03-30 15:57:15,388 INFO [Listener at localhost/42871] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: TestNs:TestTable, procId: 39 completed 2024-03-30 15:57:15,388 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestNs:TestTable 2024-03-30 15:57:15,389 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] procedure2.ProcedureExecutor(1075): Stored pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestNs:TestTable 2024-03-30 15:57:15,391 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-30 15:57:15,392 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=44, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-30 15:57:15,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-03-30 15:57:15,399 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/TestNs/TestTable/59d3edc0fa4c3c9e91a7497b1b62f796 2024-03-30 15:57:15,399 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/TestNs/TestTable/44d2e09382bc6197f4ccfe7580d6fcef 2024-03-30 15:57:15,401 DEBUG [HFileArchiver-11] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/TestNs/TestTable/59d3edc0fa4c3c9e91a7497b1b62f796/cf, FileablePath, hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/TestNs/TestTable/59d3edc0fa4c3c9e91a7497b1b62f796/recovered.edits] 2024-03-30 15:57:15,402 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/TestNs/TestTable/44d2e09382bc6197f4ccfe7580d6fcef/cf, FileablePath, hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/TestNs/TestTable/44d2e09382bc6197f4ccfe7580d6fcef/recovered.edits] 2024-03-30 15:57:15,409 DEBUG [HFileArchiver-11] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/TestNs/TestTable/59d3edc0fa4c3c9e91a7497b1b62f796/recovered.edits/4.seqid to hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/archive/data/TestNs/TestTable/59d3edc0fa4c3c9e91a7497b1b62f796/recovered.edits/4.seqid 2024-03-30 15:57:15,409 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/TestNs/TestTable/44d2e09382bc6197f4ccfe7580d6fcef/recovered.edits/4.seqid to hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/archive/data/TestNs/TestTable/44d2e09382bc6197f4ccfe7580d6fcef/recovered.edits/4.seqid 2024-03-30 15:57:15,409 DEBUG [HFileArchiver-11] backup.HFileArchiver(596): Deleted hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/TestNs/TestTable/59d3edc0fa4c3c9e91a7497b1b62f796 2024-03-30 15:57:15,410 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/.tmp/data/TestNs/TestTable/44d2e09382bc6197f4ccfe7580d6fcef 2024-03-30 15:57:15,410 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-03-30 15:57:15,413 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=44, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-30 15:57:15,415 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of TestNs:TestTable from hbase:meta 2024-03-30 15:57:15,417 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'TestNs:TestTable' descriptor. 2024-03-30 15:57:15,419 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=44, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-30 15:57:15,419 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'TestNs:TestTable' from region states. 2024-03-30 15:57:15,419 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,,1711814172822.59d3edc0fa4c3c9e91a7497b1b62f796.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1711814235419"}]},"ts":"9223372036854775807"} 2024-03-30 15:57:15,419 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,1,1711814172822.44d2e09382bc6197f4ccfe7580d6fcef.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1711814235419"}]},"ts":"9223372036854775807"} 2024-03-30 15:57:15,421 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2024-03-30 15:57:15,421 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 59d3edc0fa4c3c9e91a7497b1b62f796, NAME => 'TestNs:TestTable,,1711814172822.59d3edc0fa4c3c9e91a7497b1b62f796.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 44d2e09382bc6197f4ccfe7580d6fcef, NAME => 'TestNs:TestTable,1,1711814172822.44d2e09382bc6197f4ccfe7580d6fcef.', STARTKEY => '1', ENDKEY => ''}] 2024-03-30 15:57:15,421 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'TestNs:TestTable' as deleted. 2024-03-30 15:57:15,421 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1711814235421"}]},"ts":"9223372036854775807"} 2024-03-30 15:57:15,423 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table TestNs:TestTable state from META 2024-03-30 15:57:15,425 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=44, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-30 15:57:15,426 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=44, state=SUCCESS; DeleteTableProcedure table=TestNs:TestTable in 37 msec 2024-03-30 15:57:15,646 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-03-30 15:57:15,646 INFO [Listener at localhost/42871] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: TestNs:TestTable, procId: 44 completed 2024-03-30 15:57:15,650 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.HMaster$17(3092): Client=jenkins//172.31.14.131 delete TestNs 2024-03-30 15:57:15,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] procedure2.ProcedureExecutor(1075): Stored pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE; DeleteNamespaceProcedure, namespace=TestNs 2024-03-30 15:57:15,659 INFO [PEWorker-4] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-30 15:57:15,662 INFO [PEWorker-4] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_FROM_NS_TABLE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-30 15:57:15,664 INFO [PEWorker-4] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_FROM_ZK, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-30 15:57:15,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-03-30 15:57:15,666 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace/TestNs 2024-03-30 15:57:15,666 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-03-30 15:57:15,666 INFO [PEWorker-4] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_DIRECTORIES, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-30 15:57:15,669 INFO [PEWorker-4] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_NAMESPACE_QUOTA, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-30 15:57:15,670 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=45, state=SUCCESS; DeleteNamespaceProcedure, namespace=TestNs in 18 msec 2024-03-30 15:57:15,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=37483] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-03-30 15:57:15,916 INFO [Listener at localhost/42871] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2024-03-30 15:57:15,916 INFO [Listener at localhost/42871] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-03-30 15:57:15,917 DEBUG [Listener at localhost/42871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26bde290 to 127.0.0.1:60178 2024-03-30 15:57:15,917 DEBUG [Listener at localhost/42871] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-30 15:57:15,918 DEBUG [Listener at localhost/42871] util.JVMClusterUtil(237): Shutting down HBase Cluster 2024-03-30 15:57:15,918 DEBUG [Listener at localhost/42871] util.JVMClusterUtil(257): Found active master hash=2104148260, stopped=false 2024-03-30 15:57:15,918 DEBUG [Listener at localhost/42871] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-03-30 15:57:15,918 INFO [Listener at localhost/42871] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,37483,1711814165652 2024-03-30 15:57:15,921 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): regionserver:43311-0x100b57408a30002, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-03-30 15:57:15,921 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-03-30 15:57:15,921 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): regionserver:44765-0x100b57408a30001, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-03-30 15:57:15,921 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-30 15:57:15,921 INFO [Listener at localhost/42871] procedure2.ProcedureExecutor(675): Stopping 2024-03-30 15:57:15,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44765-0x100b57408a30001, quorum=127.0.0.1:60178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-30 15:57:15,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:43311-0x100b57408a30002, quorum=127.0.0.1:60178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-30 15:57:15,922 DEBUG [Listener at localhost/42871] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7e01aae0 to 127.0.0.1:60178 2024-03-30 15:57:15,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-30 15:57:15,922 DEBUG [Listener at localhost/42871] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-30 15:57:15,922 INFO [Listener at localhost/42871] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,44765,1711814166900' ***** 2024-03-30 15:57:15,922 INFO [Listener at localhost/42871] regionserver.HRegionServer(2313): STOPPED: Shutdown requested 2024-03-30 15:57:15,922 INFO [Listener at localhost/42871] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,43311,1711814166949' ***** 2024-03-30 15:57:15,922 INFO [Listener at localhost/42871] regionserver.HRegionServer(2313): STOPPED: Shutdown requested 2024-03-30 15:57:15,922 INFO [RS:0;jenkins-hbase4:44765] regionserver.HeapMemoryManager(220): Stopping 2024-03-30 15:57:15,922 INFO [RS:1;jenkins-hbase4:43311] regionserver.HeapMemoryManager(220): Stopping 2024-03-30 15:57:15,923 INFO [RS:0;jenkins-hbase4:44765] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-03-30 15:57:15,923 INFO [RS:1;jenkins-hbase4:43311] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-03-30 15:57:15,923 INFO [RS:0;jenkins-hbase4:44765] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-03-30 15:57:15,923 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-03-30 15:57:15,923 INFO [RS:1;jenkins-hbase4:43311] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-03-30 15:57:15,923 INFO [RS:0;jenkins-hbase4:44765] regionserver.HRegionServer(3307): Received CLOSE for 82e214ee4fe8f93054806cf06e7f4f38 2024-03-30 15:57:15,923 INFO [RS:1;jenkins-hbase4:43311] regionserver.HRegionServer(3307): Received CLOSE for 63b3222862d662c64b94f1cf48ac7458 2024-03-30 15:57:15,923 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-03-30 15:57:15,923 INFO [RS:0;jenkins-hbase4:44765] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,44765,1711814166900 2024-03-30 15:57:15,923 INFO [RS:1;jenkins-hbase4:43311] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,43311,1711814166949 2024-03-30 15:57:15,923 INFO [RS:0;jenkins-hbase4:44765] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-03-30 15:57:15,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 63b3222862d662c64b94f1cf48ac7458, disabling compactions & flushes 2024-03-30 15:57:15,924 DEBUG [RS:0;jenkins-hbase4:44765] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4b93e7e9 to 127.0.0.1:60178 2024-03-30 15:57:15,924 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1711814168883.63b3222862d662c64b94f1cf48ac7458. 2024-03-30 15:57:15,924 DEBUG [RS:0;jenkins-hbase4:44765] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-30 15:57:15,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 82e214ee4fe8f93054806cf06e7f4f38, disabling compactions & flushes 2024-03-30 15:57:15,923 INFO [RS:1;jenkins-hbase4:43311] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-03-30 15:57:15,925 INFO [RS:0;jenkins-hbase4:44765] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-03-30 15:57:15,925 DEBUG [RS:1;jenkins-hbase4:43311] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0011eb06 to 127.0.0.1:60178 2024-03-30 15:57:15,924 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1711814168883.63b3222862d662c64b94f1cf48ac7458. 2024-03-30 15:57:15,925 DEBUG [RS:1;jenkins-hbase4:43311] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-30 15:57:15,925 INFO [RS:0;jenkins-hbase4:44765] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-03-30 15:57:15,925 INFO [RS:1;jenkins-hbase4:43311] regionserver.HRegionServer(1477): Waiting on 1 regions to close 2024-03-30 15:57:15,925 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:quota,,1711814169610.82e214ee4fe8f93054806cf06e7f4f38. 2024-03-30 15:57:15,925 DEBUG [RS:1;jenkins-hbase4:43311] regionserver.HRegionServer(1481): Online Regions={63b3222862d662c64b94f1cf48ac7458=hbase:namespace,,1711814168883.63b3222862d662c64b94f1cf48ac7458.} 2024-03-30 15:57:15,925 INFO [RS:0;jenkins-hbase4:44765] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-03-30 15:57:15,925 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1711814168883.63b3222862d662c64b94f1cf48ac7458. after waiting 0 ms 2024-03-30 15:57:15,926 INFO [RS:0;jenkins-hbase4:44765] regionserver.HRegionServer(3307): Received CLOSE for 1588230740 2024-03-30 15:57:15,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1711814169610.82e214ee4fe8f93054806cf06e7f4f38. 2024-03-30 15:57:15,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1711814168883.63b3222862d662c64b94f1cf48ac7458. 2024-03-30 15:57:15,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1711814169610.82e214ee4fe8f93054806cf06e7f4f38. after waiting 0 ms 2024-03-30 15:57:15,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 63b3222862d662c64b94f1cf48ac7458 1/1 column families, dataSize=147 B heapSize=704 B 2024-03-30 15:57:15,926 INFO [RS:0;jenkins-hbase4:44765] regionserver.HRegionServer(1477): Waiting on 2 regions to close 2024-03-30 15:57:15,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1711814169610.82e214ee4fe8f93054806cf06e7f4f38. 2024-03-30 15:57:15,926 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-03-30 15:57:15,926 DEBUG [RS:0;jenkins-hbase4:44765] regionserver.HRegionServer(1481): Online Regions={1588230740=hbase:meta,,1.1588230740, 82e214ee4fe8f93054806cf06e7f4f38=hbase:quota,,1711814169610.82e214ee4fe8f93054806cf06e7f4f38.} 2024-03-30 15:57:15,927 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-03-30 15:57:15,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 82e214ee4fe8f93054806cf06e7f4f38 2/2 column families, dataSize=726 B heapSize=2.44 KB 2024-03-30 15:57:15,927 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-03-30 15:57:15,927 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-03-30 15:57:15,927 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-03-30 15:57:15,927 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=14.15 KB heapSize=25.10 KB 2024-03-30 15:57:15,927 DEBUG [RS:1;jenkins-hbase4:43311] regionserver.HRegionServer(1507): Waiting on 63b3222862d662c64b94f1cf48ac7458 2024-03-30 15:57:15,927 DEBUG [RS:0;jenkins-hbase4:44765] regionserver.HRegionServer(1507): Waiting on 1588230740, 82e214ee4fe8f93054806cf06e7f4f38 2024-03-30 15:57:15,979 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=12.16 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/meta/1588230740/.tmp/info/466343bb74e04c5abb532ff14fed9335 2024-03-30 15:57:15,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=147 B at sequenceid=8 (bloomFilter=true), to=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/namespace/63b3222862d662c64b94f1cf48ac7458/.tmp/info/ed09e2ebe8e34912b38285b7206f5158 2024-03-30 15:57:15,984 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=597 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/quota/82e214ee4fe8f93054806cf06e7f4f38/.tmp/q/5a01c1aeff194641a3302e65ea49a986 2024-03-30 15:57:15,993 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 466343bb74e04c5abb532ff14fed9335 2024-03-30 15:57:15,993 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a01c1aeff194641a3302e65ea49a986 2024-03-30 15:57:15,996 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ed09e2ebe8e34912b38285b7206f5158 2024-03-30 15:57:15,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/namespace/63b3222862d662c64b94f1cf48ac7458/.tmp/info/ed09e2ebe8e34912b38285b7206f5158 as hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/namespace/63b3222862d662c64b94f1cf48ac7458/info/ed09e2ebe8e34912b38285b7206f5158 2024-03-30 15:57:16,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ed09e2ebe8e34912b38285b7206f5158 2024-03-30 15:57:16,010 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-03-30 15:57:16,013 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-03-30 15:57:16,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/namespace/63b3222862d662c64b94f1cf48ac7458/info/ed09e2ebe8e34912b38285b7206f5158, entries=3, sequenceid=8, filesize=5.0 K 2024-03-30 15:57:16,017 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~147 B/147, heapSize ~688 B/688, currentSize=0 B/0 for 63b3222862d662c64b94f1cf48ac7458 in 91ms, sequenceid=8, compaction requested=false 2024-03-30 15:57:16,018 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=129 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/quota/82e214ee4fe8f93054806cf06e7f4f38/.tmp/u/d42a01ecd7a241c6832bb1fca6b9592b 2024-03-30 15:57:16,026 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=478 B at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/meta/1588230740/.tmp/rep_barrier/c4027030edca4e1e83c755b1debb07f2 2024-03-30 15:57:16,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d42a01ecd7a241c6832bb1fca6b9592b 2024-03-30 15:57:16,031 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/quota/82e214ee4fe8f93054806cf06e7f4f38/.tmp/q/5a01c1aeff194641a3302e65ea49a986 as hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/quota/82e214ee4fe8f93054806cf06e7f4f38/q/5a01c1aeff194641a3302e65ea49a986 2024-03-30 15:57:16,032 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/namespace/63b3222862d662c64b94f1cf48ac7458/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=1 2024-03-30 15:57:16,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1711814168883.63b3222862d662c64b94f1cf48ac7458. 2024-03-30 15:57:16,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 63b3222862d662c64b94f1cf48ac7458: 2024-03-30 15:57:16,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1711814168883.63b3222862d662c64b94f1cf48ac7458. 2024-03-30 15:57:16,036 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4027030edca4e1e83c755b1debb07f2 2024-03-30 15:57:16,042 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5a01c1aeff194641a3302e65ea49a986 2024-03-30 15:57:16,042 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/quota/82e214ee4fe8f93054806cf06e7f4f38/q/5a01c1aeff194641a3302e65ea49a986, entries=5, sequenceid=17, filesize=5.1 K 2024-03-30 15:57:16,044 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/quota/82e214ee4fe8f93054806cf06e7f4f38/.tmp/u/d42a01ecd7a241c6832bb1fca6b9592b as hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/quota/82e214ee4fe8f93054806cf06e7f4f38/u/d42a01ecd7a241c6832bb1fca6b9592b 2024-03-30 15:57:16,052 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.53 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/meta/1588230740/.tmp/table/ff0c014b3aa042a5a8dfe24de22e445e 2024-03-30 15:57:16,056 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d42a01ecd7a241c6832bb1fca6b9592b 2024-03-30 15:57:16,056 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/quota/82e214ee4fe8f93054806cf06e7f4f38/u/d42a01ecd7a241c6832bb1fca6b9592b, entries=4, sequenceid=17, filesize=5.0 K 2024-03-30 15:57:16,057 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~726 B/726, heapSize ~2.41 KB/2464, currentSize=0 B/0 for 82e214ee4fe8f93054806cf06e7f4f38 in 131ms, sequenceid=17, compaction requested=false 2024-03-30 15:57:16,062 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ff0c014b3aa042a5a8dfe24de22e445e 2024-03-30 15:57:16,063 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/meta/1588230740/.tmp/info/466343bb74e04c5abb532ff14fed9335 as hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/meta/1588230740/info/466343bb74e04c5abb532ff14fed9335 2024-03-30 15:57:16,064 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/quota/82e214ee4fe8f93054806cf06e7f4f38/recovered.edits/20.seqid, newMaxSeqId=20, maxSeqId=1 2024-03-30 15:57:16,066 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:quota,,1711814169610.82e214ee4fe8f93054806cf06e7f4f38. 2024-03-30 15:57:16,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 82e214ee4fe8f93054806cf06e7f4f38: 2024-03-30 15:57:16,066 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:quota,,1711814169610.82e214ee4fe8f93054806cf06e7f4f38. 2024-03-30 15:57:16,072 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 466343bb74e04c5abb532ff14fed9335 2024-03-30 15:57:16,072 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/meta/1588230740/info/466343bb74e04c5abb532ff14fed9335, entries=30, sequenceid=66, filesize=8.0 K 2024-03-30 15:57:16,073 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/meta/1588230740/.tmp/rep_barrier/c4027030edca4e1e83c755b1debb07f2 as hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/meta/1588230740/rep_barrier/c4027030edca4e1e83c755b1debb07f2 2024-03-30 15:57:16,081 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4027030edca4e1e83c755b1debb07f2 2024-03-30 15:57:16,081 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/meta/1588230740/rep_barrier/c4027030edca4e1e83c755b1debb07f2, entries=5, sequenceid=66, filesize=5.3 K 2024-03-30 15:57:16,082 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/meta/1588230740/.tmp/table/ff0c014b3aa042a5a8dfe24de22e445e as hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/meta/1588230740/table/ff0c014b3aa042a5a8dfe24de22e445e 2024-03-30 15:57:16,089 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ff0c014b3aa042a5a8dfe24de22e445e 2024-03-30 15:57:16,089 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/meta/1588230740/table/ff0c014b3aa042a5a8dfe24de22e445e, entries=13, sequenceid=66, filesize=5.6 K 2024-03-30 15:57:16,090 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~14.15 KB/14494, heapSize ~25.05 KB/25656, currentSize=0 B/0 for 1588230740 in 163ms, sequenceid=66, compaction requested=false 2024-03-30 15:57:16,098 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/data/hbase/meta/1588230740/recovered.edits/69.seqid, newMaxSeqId=69, maxSeqId=1 2024-03-30 15:57:16,098 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-03-30 15:57:16,099 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-03-30 15:57:16,099 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-03-30 15:57:16,099 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2024-03-30 15:57:16,128 INFO [RS:1;jenkins-hbase4:43311] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,43311,1711814166949; all regions closed. 2024-03-30 15:57:16,128 INFO [RS:0;jenkins-hbase4:44765] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,44765,1711814166900; all regions closed. 2024-03-30 15:57:16,128 DEBUG [RS:1;jenkins-hbase4:43311] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-03-30 15:57:16,128 DEBUG [RS:0;jenkins-hbase4:44765] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-03-30 15:57:16,141 DEBUG [RS:0;jenkins-hbase4:44765] wal.AbstractFSWAL(1030): Moved 1 WAL file(s) to /user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/oldWALs 2024-03-30 15:57:16,141 INFO [RS:0;jenkins-hbase4:44765] wal.AbstractFSWAL(1033): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44765%2C1711814166900.meta:.meta(num 1711814168616) 2024-03-30 15:57:16,141 DEBUG [RS:1;jenkins-hbase4:43311] wal.AbstractFSWAL(1030): Moved 1 WAL file(s) to /user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/oldWALs 2024-03-30 15:57:16,141 INFO [RS:1;jenkins-hbase4:43311] wal.AbstractFSWAL(1033): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43311%2C1711814166949:(num 1711814168417) 2024-03-30 15:57:16,141 DEBUG [RS:1;jenkins-hbase4:43311] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-30 15:57:16,141 INFO [RS:1;jenkins-hbase4:43311] regionserver.LeaseManager(133): Closed leases 2024-03-30 15:57:16,142 INFO [RS:1;jenkins-hbase4:43311] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2024-03-30 15:57:16,142 INFO [RS:1;jenkins-hbase4:43311] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-03-30 15:57:16,142 INFO [RS:1;jenkins-hbase4:43311] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-03-30 15:57:16,142 INFO [RS:1;jenkins-hbase4:43311] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-03-30 15:57:16,142 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-03-30 15:57:16,144 INFO [RS:1;jenkins-hbase4:43311] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43311 2024-03-30 15:57:16,154 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-03-30 15:57:16,154 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): regionserver:44765-0x100b57408a30001, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43311,1711814166949 2024-03-30 15:57:16,154 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): regionserver:44765-0x100b57408a30001, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-03-30 15:57:16,154 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): regionserver:43311-0x100b57408a30002, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43311,1711814166949 2024-03-30 15:57:16,155 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): regionserver:43311-0x100b57408a30002, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-03-30 15:57:16,156 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43311,1711814166949] 2024-03-30 15:57:16,156 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43311,1711814166949; numProcessing=1 2024-03-30 15:57:16,156 DEBUG [RS:0;jenkins-hbase4:44765] wal.AbstractFSWAL(1030): Moved 1 WAL file(s) to /user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/oldWALs 2024-03-30 15:57:16,156 INFO [RS:0;jenkins-hbase4:44765] wal.AbstractFSWAL(1033): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44765%2C1711814166900:(num 1711814168417) 2024-03-30 15:57:16,156 DEBUG [RS:0;jenkins-hbase4:44765] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-30 15:57:16,156 INFO [RS:0;jenkins-hbase4:44765] regionserver.LeaseManager(133): Closed leases 2024-03-30 15:57:16,156 INFO [RS:0;jenkins-hbase4:44765] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2024-03-30 15:57:16,157 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-03-30 15:57:16,158 INFO [RS:0;jenkins-hbase4:44765] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44765 2024-03-30 15:57:16,158 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43311,1711814166949 already deleted, retry=false 2024-03-30 15:57:16,158 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,43311,1711814166949 expired; onlineServers=1 2024-03-30 15:57:16,160 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): regionserver:44765-0x100b57408a30001, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44765,1711814166900 2024-03-30 15:57:16,160 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-03-30 15:57:16,162 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44765,1711814166900] 2024-03-30 15:57:16,162 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44765,1711814166900; numProcessing=2 2024-03-30 15:57:16,163 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44765,1711814166900 already deleted, retry=false 2024-03-30 15:57:16,163 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,44765,1711814166900 expired; onlineServers=0 2024-03-30 15:57:16,163 INFO [RegionServerTracker-0] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,37483,1711814165652' ***** 2024-03-30 15:57:16,164 INFO [RegionServerTracker-0] regionserver.HRegionServer(2313): STOPPED: Cluster shutdown set; onlineServer=0 2024-03-30 15:57:16,164 DEBUG [M:0;jenkins-hbase4:37483] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2669419d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-03-30 15:57:16,164 INFO [M:0;jenkins-hbase4:37483] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,37483,1711814165652 2024-03-30 15:57:16,165 INFO [M:0;jenkins-hbase4:37483] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,37483,1711814165652; all regions closed. 2024-03-30 15:57:16,165 DEBUG [M:0;jenkins-hbase4:37483] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-30 15:57:16,165 DEBUG [M:0;jenkins-hbase4:37483] cleaner.LogCleaner(198): Cancelling LogCleaner 2024-03-30 15:57:16,165 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2024-03-30 15:57:16,165 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1711814168096] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1711814168096,5,FailOnTimeoutGroup] 2024-03-30 15:57:16,165 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1711814168101] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1711814168101,5,FailOnTimeoutGroup] 2024-03-30 15:57:16,165 DEBUG [M:0;jenkins-hbase4:37483] cleaner.HFileCleaner(317): Stopping file delete threads 2024-03-30 15:57:16,166 INFO [M:0;jenkins-hbase4:37483] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2024-03-30 15:57:16,166 INFO [M:0;jenkins-hbase4:37483] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2024-03-30 15:57:16,166 INFO [M:0;jenkins-hbase4:37483] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS] on shutdown 2024-03-30 15:57:16,166 DEBUG [M:0;jenkins-hbase4:37483] master.HMaster(1517): Stopping service threads 2024-03-30 15:57:16,166 INFO [M:0;jenkins-hbase4:37483] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2024-03-30 15:57:16,166 ERROR [M:0;jenkins-hbase4:37483] procedure2.ProcedureExecutor(699): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-8,5,PEWorkerGroup] Thread[HFileArchiver-9,5,PEWorkerGroup] Thread[HFileArchiver-10,5,PEWorkerGroup] Thread[HFileArchiver-11,5,PEWorkerGroup] Thread[HFileArchiver-12,5,PEWorkerGroup] 2024-03-30 15:57:16,167 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2024-03-30 15:57:16,167 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-30 15:57:16,167 INFO [M:0;jenkins-hbase4:37483] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2024-03-30 15:57:16,167 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2024-03-30 15:57:16,167 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-03-30 15:57:16,168 DEBUG [M:0;jenkins-hbase4:37483] zookeeper.ZKUtil(399): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2024-03-30 15:57:16,168 WARN [M:0;jenkins-hbase4:37483] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2024-03-30 15:57:16,168 INFO [M:0;jenkins-hbase4:37483] assignment.AssignmentManager(315): Stopping assignment manager 2024-03-30 15:57:16,168 INFO [M:0;jenkins-hbase4:37483] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2024-03-30 15:57:16,168 DEBUG [M:0;jenkins-hbase4:37483] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-03-30 15:57:16,168 INFO [M:0;jenkins-hbase4:37483] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-30 15:57:16,168 DEBUG [M:0;jenkins-hbase4:37483] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-30 15:57:16,168 DEBUG [M:0;jenkins-hbase4:37483] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-03-30 15:57:16,168 DEBUG [M:0;jenkins-hbase4:37483] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-30 15:57:16,169 INFO [M:0;jenkins-hbase4:37483] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=152.88 KB heapSize=184.74 KB 2024-03-30 15:57:16,184 INFO [M:0;jenkins-hbase4:37483] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=152.88 KB at sequenceid=376 (bloomFilter=true), to=hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5d0d1e57cf7f484d84eff07ae166d6ce 2024-03-30 15:57:16,191 INFO [M:0;jenkins-hbase4:37483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5d0d1e57cf7f484d84eff07ae166d6ce 2024-03-30 15:57:16,192 DEBUG [M:0;jenkins-hbase4:37483] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/5d0d1e57cf7f484d84eff07ae166d6ce as hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5d0d1e57cf7f484d84eff07ae166d6ce 2024-03-30 15:57:16,200 INFO [M:0;jenkins-hbase4:37483] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5d0d1e57cf7f484d84eff07ae166d6ce 2024-03-30 15:57:16,200 INFO [M:0;jenkins-hbase4:37483] regionserver.HStore(1080): Added hdfs://localhost:33283/user/jenkins/test-data/89cb88d3-ce26-bbea-ad8a-92cdaffd2b5e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/5d0d1e57cf7f484d84eff07ae166d6ce, entries=45, sequenceid=376, filesize=12.0 K 2024-03-30 15:57:16,201 INFO [M:0;jenkins-hbase4:37483] regionserver.HRegion(2948): Finished flush of dataSize ~152.88 KB/156552, heapSize ~184.73 KB/189160, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 33ms, sequenceid=376, compaction requested=false 2024-03-30 15:57:16,202 INFO [M:0;jenkins-hbase4:37483] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-30 15:57:16,202 DEBUG [M:0;jenkins-hbase4:37483] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-03-30 15:57:16,206 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-03-30 15:57:16,206 INFO [M:0;jenkins-hbase4:37483] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2024-03-30 15:57:16,207 INFO [M:0;jenkins-hbase4:37483] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37483 2024-03-30 15:57:16,209 DEBUG [M:0;jenkins-hbase4:37483] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,37483,1711814165652 already deleted, retry=false 2024-03-30 15:57:16,258 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): regionserver:43311-0x100b57408a30002, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-30 15:57:16,258 INFO [RS:1;jenkins-hbase4:43311] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,43311,1711814166949; zookeeper connection closed. 2024-03-30 15:57:16,258 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): regionserver:43311-0x100b57408a30002, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-30 15:57:16,259 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@564bc8f6] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@564bc8f6 2024-03-30 15:57:16,262 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): regionserver:44765-0x100b57408a30001, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-30 15:57:16,262 INFO [RS:0;jenkins-hbase4:44765] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,44765,1711814166900; zookeeper connection closed. 2024-03-30 15:57:16,262 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): regionserver:44765-0x100b57408a30001, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-30 15:57:16,262 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@2f9a2ea7] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@2f9a2ea7 2024-03-30 15:57:16,263 INFO [Listener at localhost/42871] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2024-03-30 15:57:16,311 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-30 15:57:16,311 INFO [M:0;jenkins-hbase4:37483] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,37483,1711814165652; zookeeper connection closed. 2024-03-30 15:57:16,311 DEBUG [Listener at localhost/42871-EventThread] zookeeper.ZKWatcher(600): master:37483-0x100b57408a30000, quorum=127.0.0.1:60178, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-30 15:57:16,313 WARN [Listener at localhost/42871] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-03-30 15:57:16,315 INFO [Listener at localhost/42871] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-03-30 15:57:16,421 WARN [BP-1342274994-172.31.14.131-1711814162497 heartbeating to localhost/127.0.0.1:33283] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-03-30 15:57:16,421 WARN [BP-1342274994-172.31.14.131-1711814162497 heartbeating to localhost/127.0.0.1:33283] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1342274994-172.31.14.131-1711814162497 (Datanode Uuid 6063bd69-f875-47e6-b01c-c4405ca17ad4) service to localhost/127.0.0.1:33283 2024-03-30 15:57:16,423 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/cluster_12dd9d10-0619-2559-0263-7898b1180b87/dfs/data/data3/current/BP-1342274994-172.31.14.131-1711814162497] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-03-30 15:57:16,423 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/cluster_12dd9d10-0619-2559-0263-7898b1180b87/dfs/data/data4/current/BP-1342274994-172.31.14.131-1711814162497] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-03-30 15:57:16,424 WARN [Listener at localhost/42871] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-03-30 15:57:16,426 INFO [Listener at localhost/42871] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-03-30 15:57:16,530 WARN [BP-1342274994-172.31.14.131-1711814162497 heartbeating to localhost/127.0.0.1:33283] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-03-30 15:57:16,530 WARN [BP-1342274994-172.31.14.131-1711814162497 heartbeating to localhost/127.0.0.1:33283] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1342274994-172.31.14.131-1711814162497 (Datanode Uuid 4a07a617-95ee-4379-8aa4-5e0d9f6998e7) service to localhost/127.0.0.1:33283 2024-03-30 15:57:16,531 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/cluster_12dd9d10-0619-2559-0263-7898b1180b87/dfs/data/data1/current/BP-1342274994-172.31.14.131-1711814162497] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-03-30 15:57:16,532 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/153472cd-f6f5-9b95-351c-0b307f0b14c1/cluster_12dd9d10-0619-2559-0263-7898b1180b87/dfs/data/data2/current/BP-1342274994-172.31.14.131-1711814162497] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-03-30 15:57:16,571 INFO [Listener at localhost/42871] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-03-30 15:57:16,688 INFO [Listener at localhost/42871] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2024-03-30 15:57:16,731 INFO [Listener at localhost/42871] hbase.HBaseTestingUtility(1293): Minicluster is down