2024-04-23 15:59:10,895 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle timeout: 13 mins 2024-04-23 15:59:11,138 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6 2024-04-23 15:59:11,151 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2024-04-23 15:59:11,151 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/cluster_d2ca0e05-00cf-2877-a9c8-b5e0a1848c71, deleteOnExit=true 2024-04-23 15:59:11,151 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2024-04-23 15:59:11,152 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/test.cache.data in system properties and HBase conf 2024-04-23 15:59:11,152 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/hadoop.tmp.dir in system properties and HBase conf 2024-04-23 15:59:11,153 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/hadoop.log.dir in system properties and HBase conf 2024-04-23 15:59:11,153 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/mapreduce.cluster.local.dir in system properties and HBase conf 2024-04-23 15:59:11,153 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/mapreduce.cluster.temp.dir in system properties and HBase conf 2024-04-23 15:59:11,153 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2024-04-23 15:59:11,266 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2024-04-23 15:59:11,674 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-04-23 15:59:11,678 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2024-04-23 15:59:11,679 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2024-04-23 15:59:11,679 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/yarn.nodemanager.log-dirs in system properties and HBase conf 2024-04-23 15:59:11,679 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-04-23 15:59:11,679 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2024-04-23 15:59:11,680 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2024-04-23 15:59:11,680 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-04-23 15:59:11,680 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/dfs.journalnode.edits.dir in system properties and HBase conf 2024-04-23 15:59:11,681 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2024-04-23 15:59:11,681 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/nfs.dump.dir in system properties and HBase conf 2024-04-23 15:59:11,681 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/java.io.tmpdir in system properties and HBase conf 2024-04-23 15:59:11,682 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/dfs.journalnode.edits.dir in system properties and HBase conf 2024-04-23 15:59:11,682 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2024-04-23 15:59:11,682 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2024-04-23 15:59:12,288 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-04-23 15:59:12,293 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-04-23 15:59:12,592 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2024-04-23 15:59:12,766 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2024-04-23 15:59:12,782 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-04-23 15:59:12,833 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2024-04-23 15:59:12,868 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/java.io.tmpdir/Jetty_localhost_39657_hdfs____jyy5zw/webapp 2024-04-23 15:59:12,994 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39657 2024-04-23 15:59:13,004 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-04-23 15:59:13,005 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-04-23 15:59:13,519 WARN [Listener at localhost/46537] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-04-23 15:59:13,626 WARN [Listener at localhost/46537] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-04-23 15:59:13,651 WARN [Listener at localhost/46537] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-04-23 15:59:13,659 INFO [Listener at localhost/46537] log.Slf4jLog(67): jetty-6.1.26 2024-04-23 15:59:13,664 INFO [Listener at localhost/46537] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/java.io.tmpdir/Jetty_localhost_46707_datanode____w09qqr/webapp 2024-04-23 15:59:13,761 INFO [Listener at localhost/46537] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46707 2024-04-23 15:59:14,094 WARN [Listener at localhost/46255] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-04-23 15:59:14,115 WARN [Listener at localhost/46255] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-04-23 15:59:14,121 WARN [Listener at localhost/46255] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-04-23 15:59:14,124 INFO [Listener at localhost/46255] log.Slf4jLog(67): jetty-6.1.26 2024-04-23 15:59:14,130 INFO [Listener at localhost/46255] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/java.io.tmpdir/Jetty_localhost_35047_datanode____n6ybug/webapp 2024-04-23 15:59:14,232 INFO [Listener at localhost/46255] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35047 2024-04-23 15:59:14,243 WARN [Listener at localhost/33425] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-04-23 15:59:14,580 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x28ef434c8395b7: Processing first storage report for DS-32128a07-5143-4431-9803-28dd02e0da3a from datanode 480f3df4-f915-4c45-ba26-8d78c5715570 2024-04-23 15:59:14,581 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x28ef434c8395b7: from storage DS-32128a07-5143-4431-9803-28dd02e0da3a node DatanodeRegistration(127.0.0.1:36853, datanodeUuid=480f3df4-f915-4c45-ba26-8d78c5715570, infoPort=34221, infoSecurePort=0, ipcPort=33425, storageInfo=lv=-57;cid=testClusterID;nsid=871879846;c=1713887952377), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2024-04-23 15:59:14,582 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf7584913ecb03b2d: Processing first storage report for DS-3064e21c-075e-4715-81c9-3eec9c4795be from datanode 68e4562e-a79c-4192-aaf7-76b6297004e2 2024-04-23 15:59:14,582 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf7584913ecb03b2d: from storage DS-3064e21c-075e-4715-81c9-3eec9c4795be node DatanodeRegistration(127.0.0.1:34303, datanodeUuid=68e4562e-a79c-4192-aaf7-76b6297004e2, infoPort=42061, infoSecurePort=0, ipcPort=46255, storageInfo=lv=-57;cid=testClusterID;nsid=871879846;c=1713887952377), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2024-04-23 15:59:14,582 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x28ef434c8395b7: Processing first storage report for DS-880120e6-c1ba-4c37-8202-b3df0032e0b9 from datanode 480f3df4-f915-4c45-ba26-8d78c5715570 2024-04-23 15:59:14,582 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x28ef434c8395b7: from storage DS-880120e6-c1ba-4c37-8202-b3df0032e0b9 node DatanodeRegistration(127.0.0.1:36853, datanodeUuid=480f3df4-f915-4c45-ba26-8d78c5715570, infoPort=34221, infoSecurePort=0, ipcPort=33425, storageInfo=lv=-57;cid=testClusterID;nsid=871879846;c=1713887952377), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-04-23 15:59:14,582 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf7584913ecb03b2d: Processing first storage report for DS-8911ba17-3057-4494-ae8a-d293b429d4e4 from datanode 68e4562e-a79c-4192-aaf7-76b6297004e2 2024-04-23 15:59:14,582 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf7584913ecb03b2d: from storage DS-8911ba17-3057-4494-ae8a-d293b429d4e4 node DatanodeRegistration(127.0.0.1:34303, datanodeUuid=68e4562e-a79c-4192-aaf7-76b6297004e2, infoPort=42061, infoSecurePort=0, ipcPort=46255, storageInfo=lv=-57;cid=testClusterID;nsid=871879846;c=1713887952377), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-04-23 15:59:14,674 DEBUG [Listener at localhost/33425] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6 2024-04-23 15:59:14,809 INFO [Listener at localhost/33425] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/cluster_d2ca0e05-00cf-2877-a9c8-b5e0a1848c71/zookeeper_0, clientPort=51085, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/cluster_d2ca0e05-00cf-2877-a9c8-b5e0a1848c71/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/cluster_d2ca0e05-00cf-2877-a9c8-b5e0a1848c71/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2024-04-23 15:59:14,826 INFO [Listener at localhost/33425] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=51085 2024-04-23 15:59:14,833 INFO [Listener at localhost/33425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-23 15:59:14,836 INFO [Listener at localhost/33425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-23 15:59:15,502 INFO [Listener at localhost/33425] util.FSUtils(471): Created version file at hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6 with version=8 2024-04-23 15:59:15,502 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/hbase-staging 2024-04-23 15:59:15,831 INFO [Listener at localhost/33425] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2024-04-23 15:59:16,299 INFO [Listener at localhost/33425] client.ConnectionUtils(126): master/jenkins-hbase4:0 server-side Connection retries=45 2024-04-23 15:59:16,334 INFO [Listener at localhost/33425] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-04-23 15:59:16,335 INFO [Listener at localhost/33425] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-04-23 15:59:16,335 INFO [Listener at localhost/33425] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-04-23 15:59:16,335 INFO [Listener at localhost/33425] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-04-23 15:59:16,335 INFO [Listener at localhost/33425] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-04-23 15:59:16,494 INFO [Listener at localhost/33425] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2024-04-23 15:59:16,570 DEBUG [Listener at localhost/33425] util.ClassSize(228): Using Unsafe to estimate memory layout 2024-04-23 15:59:16,667 INFO [Listener at localhost/33425] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34409 2024-04-23 15:59:16,677 INFO [Listener at localhost/33425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-23 15:59:16,679 INFO [Listener at localhost/33425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-23 15:59:16,701 INFO [Listener at localhost/33425] zookeeper.RecoverableZooKeeper(93): Process identifier=master:34409 connecting to ZooKeeper ensemble=127.0.0.1:51085 2024-04-23 15:59:16,745 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:344090x0, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-04-23 15:59:16,747 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:34409-0x101310f8ecf0000 connected 2024-04-23 15:59:16,778 DEBUG [Listener at localhost/33425] zookeeper.ZKUtil(165): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-04-23 15:59:16,779 DEBUG [Listener at localhost/33425] zookeeper.ZKUtil(165): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-04-23 15:59:16,783 DEBUG [Listener at localhost/33425] zookeeper.ZKUtil(165): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-04-23 15:59:16,791 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34409 2024-04-23 15:59:16,791 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34409 2024-04-23 15:59:16,792 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34409 2024-04-23 15:59:16,792 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34409 2024-04-23 15:59:16,792 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34409 2024-04-23 15:59:16,799 INFO [Listener at localhost/33425] master.HMaster(445): hbase.rootdir=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6, hbase.cluster.distributed=false 2024-04-23 15:59:16,870 INFO [Listener at localhost/33425] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-04-23 15:59:16,871 INFO [Listener at localhost/33425] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-04-23 15:59:16,871 INFO [Listener at localhost/33425] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-04-23 15:59:16,871 INFO [Listener at localhost/33425] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-04-23 15:59:16,871 INFO [Listener at localhost/33425] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-04-23 15:59:16,871 INFO [Listener at localhost/33425] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-04-23 15:59:16,876 INFO [Listener at localhost/33425] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-04-23 15:59:16,879 INFO [Listener at localhost/33425] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38643 2024-04-23 15:59:16,882 INFO [Listener at localhost/33425] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-04-23 15:59:16,888 DEBUG [Listener at localhost/33425] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-04-23 15:59:16,889 INFO [Listener at localhost/33425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-23 15:59:16,891 INFO [Listener at localhost/33425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-23 15:59:16,894 INFO [Listener at localhost/33425] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38643 connecting to ZooKeeper ensemble=127.0.0.1:51085 2024-04-23 15:59:16,898 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:386430x0, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-04-23 15:59:16,899 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38643-0x101310f8ecf0001 connected 2024-04-23 15:59:16,899 DEBUG [Listener at localhost/33425] zookeeper.ZKUtil(165): regionserver:38643-0x101310f8ecf0001, quorum=127.0.0.1:51085, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-04-23 15:59:16,900 DEBUG [Listener at localhost/33425] zookeeper.ZKUtil(165): regionserver:38643-0x101310f8ecf0001, quorum=127.0.0.1:51085, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-04-23 15:59:16,901 DEBUG [Listener at localhost/33425] zookeeper.ZKUtil(165): regionserver:38643-0x101310f8ecf0001, quorum=127.0.0.1:51085, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-04-23 15:59:16,902 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38643 2024-04-23 15:59:16,902 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38643 2024-04-23 15:59:16,903 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38643 2024-04-23 15:59:16,903 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38643 2024-04-23 15:59:16,904 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38643 2024-04-23 15:59:16,917 INFO [Listener at localhost/33425] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-04-23 15:59:16,917 INFO [Listener at localhost/33425] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-04-23 15:59:16,918 INFO [Listener at localhost/33425] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-04-23 15:59:16,918 INFO [Listener at localhost/33425] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-04-23 15:59:16,918 INFO [Listener at localhost/33425] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-04-23 15:59:16,918 INFO [Listener at localhost/33425] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-04-23 15:59:16,918 INFO [Listener at localhost/33425] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-04-23 15:59:16,920 INFO [Listener at localhost/33425] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35681 2024-04-23 15:59:16,920 INFO [Listener at localhost/33425] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-04-23 15:59:16,923 DEBUG [Listener at localhost/33425] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-04-23 15:59:16,924 INFO [Listener at localhost/33425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-23 15:59:16,926 INFO [Listener at localhost/33425] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-23 15:59:16,928 INFO [Listener at localhost/33425] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:35681 connecting to ZooKeeper ensemble=127.0.0.1:51085 2024-04-23 15:59:16,932 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:356810x0, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-04-23 15:59:16,933 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:35681-0x101310f8ecf0002 connected 2024-04-23 15:59:16,933 DEBUG [Listener at localhost/33425] zookeeper.ZKUtil(165): regionserver:35681-0x101310f8ecf0002, quorum=127.0.0.1:51085, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-04-23 15:59:16,934 DEBUG [Listener at localhost/33425] zookeeper.ZKUtil(165): regionserver:35681-0x101310f8ecf0002, quorum=127.0.0.1:51085, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-04-23 15:59:16,935 DEBUG [Listener at localhost/33425] zookeeper.ZKUtil(165): regionserver:35681-0x101310f8ecf0002, quorum=127.0.0.1:51085, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-04-23 15:59:16,936 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35681 2024-04-23 15:59:16,936 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35681 2024-04-23 15:59:16,936 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35681 2024-04-23 15:59:16,937 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35681 2024-04-23 15:59:16,938 DEBUG [Listener at localhost/33425] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35681 2024-04-23 15:59:16,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2174): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,34409,1713887955657 2024-04-23 15:59:16,949 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-04-23 15:59:16,951 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,34409,1713887955657 2024-04-23 15:59:16,971 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-04-23 15:59:16,971 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:35681-0x101310f8ecf0002, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-04-23 15:59:16,971 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:38643-0x101310f8ecf0001, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-04-23 15:59:16,971 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-23 15:59:16,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-04-23 15:59:16,974 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,34409,1713887955657 from backup master directory 2024-04-23 15:59:16,974 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(163): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-04-23 15:59:16,978 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,34409,1713887955657 2024-04-23 15:59:16,978 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-04-23 15:59:16,979 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-04-23 15:59:16,979 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,34409,1713887955657 2024-04-23 15:59:16,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2024-04-23 15:59:16,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2024-04-23 15:59:17,072 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/hbase.id with ID: 99f4ecbf-fa1f-49b9-bc12-dedcdecd9311 2024-04-23 15:59:17,118 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-23 15:59:17,134 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-23 15:59:17,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x7b8dd4c9 to 127.0.0.1:51085 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-04-23 15:59:17,215 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@54de9ea5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-04-23 15:59:17,239 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-04-23 15:59:17,241 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2024-04-23 15:59:17,258 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2024-04-23 15:59:17,259 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2024-04-23 15:59:17,260 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-04-23 15:59:17,265 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-04-23 15:59:17,266 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-04-23 15:59:17,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/MasterData/data/master/store-tmp 2024-04-23 15:59:17,336 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-23 15:59:17,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-04-23 15:59:17,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-23 15:59:17,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-23 15:59:17,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-04-23 15:59:17,337 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-23 15:59:17,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-23 15:59:17,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-04-23 15:59:17,339 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/MasterData/WALs/jenkins-hbase4.apache.org,34409,1713887955657 2024-04-23 15:59:17,360 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(492): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34409%2C1713887955657, suffix=, logDir=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/MasterData/WALs/jenkins-hbase4.apache.org,34409,1713887955657, archiveDir=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/MasterData/oldWALs, maxLogs=10 2024-04-23 15:59:17,420 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34303,DS-3064e21c-075e-4715-81c9-3eec9c4795be,DISK] 2024-04-23 15:59:17,420 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36853,DS-32128a07-5143-4431-9803-28dd02e0da3a,DISK] 2024-04-23 15:59:17,429 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2024-04-23 15:59:17,496 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(809): New WAL /user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/MasterData/WALs/jenkins-hbase4.apache.org,34409,1713887955657/jenkins-hbase4.apache.org%2C34409%2C1713887955657.1713887957371 2024-04-23 15:59:17,497 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(890): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36853,DS-32128a07-5143-4431-9803-28dd02e0da3a,DISK], DatanodeInfoWithStorage[127.0.0.1:34303,DS-3064e21c-075e-4715-81c9-3eec9c4795be,DISK]] 2024-04-23 15:59:17,497 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2024-04-23 15:59:17,498 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-23 15:59:17,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2024-04-23 15:59:17,502 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2024-04-23 15:59:17,562 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2024-04-23 15:59:17,570 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2024-04-23 15:59:17,595 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2024-04-23 15:59:17,607 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-23 15:59:17,613 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-04-23 15:59:17,615 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-04-23 15:59:17,631 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2024-04-23 15:59:17,636 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-23 15:59:17,637 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73549384, jitterRate=0.09597122669219971}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-04-23 15:59:17,638 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2024-04-23 15:59:17,639 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2024-04-23 15:59:17,658 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2024-04-23 15:59:17,658 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(608): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2024-04-23 15:59:17,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2024-04-23 15:59:17,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(628): Recovered RegionProcedureStore lease in 1 msec 2024-04-23 15:59:17,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(642): Loaded RegionProcedureStore in 34 msec 2024-04-23 15:59:17,697 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2024-04-23 15:59:17,723 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2024-04-23 15:59:17,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2024-04-23 15:59:17,753 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2024-04-23 15:59:17,757 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2024-04-23 15:59:17,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2024-04-23 15:59:17,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2024-04-23 15:59:17,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2024-04-23 15:59:17,774 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-23 15:59:17,776 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2024-04-23 15:59:17,776 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2024-04-23 15:59:17,789 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2024-04-23 15:59:17,794 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:35681-0x101310f8ecf0002, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-04-23 15:59:17,794 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-04-23 15:59:17,794 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:38643-0x101310f8ecf0001, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-04-23 15:59:17,794 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-23 15:59:17,798 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(745): Active/primary master=jenkins-hbase4.apache.org,34409,1713887955657, sessionid=0x101310f8ecf0000, setting cluster-up flag (Was=false) 2024-04-23 15:59:17,814 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-23 15:59:17,820 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2024-04-23 15:59:17,822 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34409,1713887955657 2024-04-23 15:59:17,829 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-23 15:59:17,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2024-04-23 15:59:17,838 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,34409,1713887955657 2024-04-23 15:59:17,840 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.hbase-snapshot/.tmp 2024-04-23 15:59:17,885 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver loaded, priority=536870911. 2024-04-23 15:59:17,942 INFO [RS:1;jenkins-hbase4:35681] regionserver.HRegionServer(957): ClusterId : 99f4ecbf-fa1f-49b9-bc12-dedcdecd9311 2024-04-23 15:59:17,944 INFO [RS:0;jenkins-hbase4:38643] regionserver.HRegionServer(957): ClusterId : 99f4ecbf-fa1f-49b9-bc12-dedcdecd9311 2024-04-23 15:59:17,948 DEBUG [RS:1;jenkins-hbase4:35681] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-04-23 15:59:17,948 DEBUG [RS:0;jenkins-hbase4:38643] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-04-23 15:59:17,954 DEBUG [RS:0;jenkins-hbase4:38643] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-04-23 15:59:17,954 DEBUG [RS:1;jenkins-hbase4:35681] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-04-23 15:59:17,954 DEBUG [RS:0;jenkins-hbase4:38643] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-04-23 15:59:17,954 DEBUG [RS:1;jenkins-hbase4:35681] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-04-23 15:59:17,958 DEBUG [RS:0;jenkins-hbase4:38643] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-04-23 15:59:17,958 DEBUG [RS:1;jenkins-hbase4:35681] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-04-23 15:59:17,960 DEBUG [RS:0;jenkins-hbase4:38643] zookeeper.ReadOnlyZKClient(139): Connect 0x1fca8a35 to 127.0.0.1:51085 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-04-23 15:59:17,960 DEBUG [RS:1;jenkins-hbase4:35681] zookeeper.ReadOnlyZKClient(139): Connect 0x638f4a75 to 127.0.0.1:51085 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-04-23 15:59:17,967 DEBUG [RS:0;jenkins-hbase4:38643] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@110d67bc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-04-23 15:59:17,968 DEBUG [RS:0;jenkins-hbase4:38643] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1532e145, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-04-23 15:59:17,968 DEBUG [RS:1;jenkins-hbase4:35681] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6d48b874, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-04-23 15:59:17,968 DEBUG [RS:1;jenkins-hbase4:35681] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@69772105, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-04-23 15:59:17,968 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2024-04-23 15:59:17,978 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-04-23 15:59:17,978 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-04-23 15:59:17,978 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-04-23 15:59:17,978 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-04-23 15:59:17,978 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2024-04-23 15:59:17,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-23 15:59:17,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-04-23 15:59:17,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-23 15:59:17,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1713887987981 2024-04-23 15:59:17,984 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2024-04-23 15:59:17,987 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2024-04-23 15:59:17,988 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2024-04-23 15:59:17,992 DEBUG [RS:0;jenkins-hbase4:38643] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38643 2024-04-23 15:59:17,993 DEBUG [RS:1;jenkins-hbase4:35681] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:35681 2024-04-23 15:59:17,995 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-04-23 15:59:17,995 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2024-04-23 15:59:17,997 INFO [RS:0;jenkins-hbase4:38643] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-04-23 15:59:17,998 INFO [RS:0;jenkins-hbase4:38643] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-04-23 15:59:17,998 DEBUG [RS:0;jenkins-hbase4:38643] regionserver.HRegionServer(1028): About to register with Master. 2024-04-23 15:59:17,997 INFO [RS:1;jenkins-hbase4:35681] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-04-23 15:59:17,998 INFO [RS:1;jenkins-hbase4:35681] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-04-23 15:59:17,998 DEBUG [RS:1;jenkins-hbase4:35681] regionserver.HRegionServer(1028): About to register with Master. 2024-04-23 15:59:18,001 INFO [RS:0;jenkins-hbase4:38643] regionserver.HRegionServer(2820): reportForDuty to master=jenkins-hbase4.apache.org,34409,1713887955657 with isa=jenkins-hbase4.apache.org/172.31.14.131:38643, startcode=1713887956870 2024-04-23 15:59:18,001 INFO [RS:1;jenkins-hbase4:35681] regionserver.HRegionServer(2820): reportForDuty to master=jenkins-hbase4.apache.org,34409,1713887955657 with isa=jenkins-hbase4.apache.org/172.31.14.131:35681, startcode=1713887956917 2024-04-23 15:59:18,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2024-04-23 15:59:18,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2024-04-23 15:59:18,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2024-04-23 15:59:18,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2024-04-23 15:59:18,008 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:18,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2024-04-23 15:59:18,012 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2024-04-23 15:59:18,012 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2024-04-23 15:59:18,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2024-04-23 15:59:18,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2024-04-23 15:59:18,017 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1713887958017,5,FailOnTimeoutGroup] 2024-04-23 15:59:18,017 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1713887958017,5,FailOnTimeoutGroup] 2024-04-23 15:59:18,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:18,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1466): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2024-04-23 15:59:18,019 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:18,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:18,023 DEBUG [RS:1;jenkins-hbase4:35681] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-04-23 15:59:18,023 DEBUG [RS:0;jenkins-hbase4:38643] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-04-23 15:59:18,039 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-04-23 15:59:18,040 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-04-23 15:59:18,041 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6 2024-04-23 15:59:18,068 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-23 15:59:18,071 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-04-23 15:59:18,074 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/meta/1588230740/info 2024-04-23 15:59:18,076 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-04-23 15:59:18,077 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-23 15:59:18,078 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-04-23 15:59:18,081 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/meta/1588230740/rep_barrier 2024-04-23 15:59:18,082 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-04-23 15:59:18,083 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-23 15:59:18,083 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-04-23 15:59:18,087 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/meta/1588230740/table 2024-04-23 15:59:18,087 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-04-23 15:59:18,088 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-23 15:59:18,090 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/meta/1588230740 2024-04-23 15:59:18,091 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/meta/1588230740 2024-04-23 15:59:18,094 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33337, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2024-04-23 15:59:18,094 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53865, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2024-04-23 15:59:18,096 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-04-23 15:59:18,098 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2024-04-23 15:59:18,102 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-23 15:59:18,104 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68570404, jitterRate=0.021778643131256104}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-04-23 15:59:18,104 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2024-04-23 15:59:18,104 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-04-23 15:59:18,105 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-04-23 15:59:18,105 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-04-23 15:59:18,105 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-04-23 15:59:18,105 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-04-23 15:59:18,105 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-04-23 15:59:18,106 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-04-23 15:59:18,108 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34409] master.ServerManager(404): Registering regionserver=jenkins-hbase4.apache.org,35681,1713887956917 2024-04-23 15:59:18,111 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2024-04-23 15:59:18,111 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2024-04-23 15:59:18,119 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2024-04-23 15:59:18,120 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=34409] master.ServerManager(404): Registering regionserver=jenkins-hbase4.apache.org,38643,1713887956870 2024-04-23 15:59:18,127 DEBUG [RS:1;jenkins-hbase4:35681] regionserver.HRegionServer(1601): Config from master: hbase.rootdir=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6 2024-04-23 15:59:18,127 DEBUG [RS:0;jenkins-hbase4:38643] regionserver.HRegionServer(1601): Config from master: hbase.rootdir=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6 2024-04-23 15:59:18,127 DEBUG [RS:1;jenkins-hbase4:35681] regionserver.HRegionServer(1601): Config from master: fs.defaultFS=hdfs://localhost:46537 2024-04-23 15:59:18,127 DEBUG [RS:0;jenkins-hbase4:38643] regionserver.HRegionServer(1601): Config from master: fs.defaultFS=hdfs://localhost:46537 2024-04-23 15:59:18,127 DEBUG [RS:1;jenkins-hbase4:35681] regionserver.HRegionServer(1601): Config from master: hbase.master.info.port=-1 2024-04-23 15:59:18,127 DEBUG [RS:0;jenkins-hbase4:38643] regionserver.HRegionServer(1601): Config from master: hbase.master.info.port=-1 2024-04-23 15:59:18,135 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2024-04-23 15:59:18,137 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-04-23 15:59:18,138 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2024-04-23 15:59:18,138 DEBUG [RS:0;jenkins-hbase4:38643] zookeeper.ZKUtil(163): regionserver:38643-0x101310f8ecf0001, quorum=127.0.0.1:51085, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38643,1713887956870 2024-04-23 15:59:18,139 WARN [RS:0;jenkins-hbase4:38643] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-04-23 15:59:18,139 INFO [RS:0;jenkins-hbase4:38643] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-04-23 15:59:18,139 DEBUG [RS:0;jenkins-hbase4:38643] regionserver.HRegionServer(1953): logDir=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/WALs/jenkins-hbase4.apache.org,38643,1713887956870 2024-04-23 15:59:18,139 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38643,1713887956870] 2024-04-23 15:59:18,140 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,35681,1713887956917] 2024-04-23 15:59:18,140 DEBUG [RS:1;jenkins-hbase4:35681] zookeeper.ZKUtil(163): regionserver:35681-0x101310f8ecf0002, quorum=127.0.0.1:51085, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35681,1713887956917 2024-04-23 15:59:18,140 WARN [RS:1;jenkins-hbase4:35681] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-04-23 15:59:18,142 INFO [RS:1;jenkins-hbase4:35681] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-04-23 15:59:18,142 DEBUG [RS:1;jenkins-hbase4:35681] regionserver.HRegionServer(1953): logDir=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/WALs/jenkins-hbase4.apache.org,35681,1713887956917 2024-04-23 15:59:18,152 DEBUG [RS:1;jenkins-hbase4:35681] zookeeper.ZKUtil(163): regionserver:35681-0x101310f8ecf0002, quorum=127.0.0.1:51085, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38643,1713887956870 2024-04-23 15:59:18,152 DEBUG [RS:0;jenkins-hbase4:38643] zookeeper.ZKUtil(163): regionserver:38643-0x101310f8ecf0001, quorum=127.0.0.1:51085, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38643,1713887956870 2024-04-23 15:59:18,152 DEBUG [RS:1;jenkins-hbase4:35681] zookeeper.ZKUtil(163): regionserver:35681-0x101310f8ecf0002, quorum=127.0.0.1:51085, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35681,1713887956917 2024-04-23 15:59:18,153 DEBUG [RS:0;jenkins-hbase4:38643] zookeeper.ZKUtil(163): regionserver:38643-0x101310f8ecf0001, quorum=127.0.0.1:51085, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,35681,1713887956917 2024-04-23 15:59:18,163 DEBUG [RS:1;jenkins-hbase4:35681] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-04-23 15:59:18,163 DEBUG [RS:0;jenkins-hbase4:38643] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-04-23 15:59:18,172 INFO [RS:1;jenkins-hbase4:35681] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-04-23 15:59:18,172 INFO [RS:0;jenkins-hbase4:38643] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-04-23 15:59:18,192 INFO [RS:0;jenkins-hbase4:38643] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-04-23 15:59:18,192 INFO [RS:1;jenkins-hbase4:35681] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-04-23 15:59:18,196 INFO [RS:0;jenkins-hbase4:38643] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-04-23 15:59:18,196 INFO [RS:1;jenkins-hbase4:35681] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-04-23 15:59:18,197 INFO [RS:0;jenkins-hbase4:38643] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:18,197 INFO [RS:1;jenkins-hbase4:35681] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:18,198 INFO [RS:1;jenkins-hbase4:35681] regionserver.HRegionServer$CompactionChecker(1843): CompactionChecker runs every PT1S 2024-04-23 15:59:18,198 INFO [RS:0;jenkins-hbase4:38643] regionserver.HRegionServer$CompactionChecker(1843): CompactionChecker runs every PT1S 2024-04-23 15:59:18,207 INFO [RS:0;jenkins-hbase4:38643] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:18,207 INFO [RS:1;jenkins-hbase4:35681] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:18,207 DEBUG [RS:0;jenkins-hbase4:38643] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-23 15:59:18,207 DEBUG [RS:1;jenkins-hbase4:35681] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-23 15:59:18,207 DEBUG [RS:0;jenkins-hbase4:38643] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-23 15:59:18,208 DEBUG [RS:1;jenkins-hbase4:35681] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-23 15:59:18,208 DEBUG [RS:0;jenkins-hbase4:38643] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-23 15:59:18,208 DEBUG [RS:1;jenkins-hbase4:35681] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-23 15:59:18,208 DEBUG [RS:0;jenkins-hbase4:38643] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-23 15:59:18,208 DEBUG [RS:1;jenkins-hbase4:35681] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-23 15:59:18,208 DEBUG [RS:0;jenkins-hbase4:38643] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-23 15:59:18,208 DEBUG [RS:1;jenkins-hbase4:35681] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-23 15:59:18,208 DEBUG [RS:0;jenkins-hbase4:38643] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-04-23 15:59:18,208 DEBUG [RS:1;jenkins-hbase4:35681] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-04-23 15:59:18,208 DEBUG [RS:0;jenkins-hbase4:38643] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-23 15:59:18,208 DEBUG [RS:1;jenkins-hbase4:35681] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-23 15:59:18,208 DEBUG [RS:0;jenkins-hbase4:38643] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-23 15:59:18,208 DEBUG [RS:1;jenkins-hbase4:35681] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-23 15:59:18,209 DEBUG [RS:0;jenkins-hbase4:38643] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-23 15:59:18,209 DEBUG [RS:1;jenkins-hbase4:35681] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-23 15:59:18,209 DEBUG [RS:0;jenkins-hbase4:38643] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-23 15:59:18,209 DEBUG [RS:1;jenkins-hbase4:35681] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-23 15:59:18,210 INFO [RS:0;jenkins-hbase4:38643] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:18,210 INFO [RS:0;jenkins-hbase4:38643] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:18,210 INFO [RS:0;jenkins-hbase4:38643] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:18,210 INFO [RS:0;jenkins-hbase4:38643] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:18,212 INFO [RS:1;jenkins-hbase4:35681] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:18,212 INFO [RS:1;jenkins-hbase4:35681] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:18,212 INFO [RS:1;jenkins-hbase4:35681] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:18,212 INFO [RS:1;jenkins-hbase4:35681] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:18,230 INFO [RS:1;jenkins-hbase4:35681] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-04-23 15:59:18,230 INFO [RS:0;jenkins-hbase4:38643] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-04-23 15:59:18,233 INFO [RS:0;jenkins-hbase4:38643] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38643,1713887956870-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:18,233 INFO [RS:1;jenkins-hbase4:35681] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35681,1713887956917-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:18,250 INFO [RS:0;jenkins-hbase4:38643] regionserver.Replication(203): jenkins-hbase4.apache.org,38643,1713887956870 started 2024-04-23 15:59:18,250 INFO [RS:0;jenkins-hbase4:38643] regionserver.HRegionServer(1643): Serving as jenkins-hbase4.apache.org,38643,1713887956870, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38643, sessionid=0x101310f8ecf0001 2024-04-23 15:59:18,250 DEBUG [RS:0;jenkins-hbase4:38643] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-04-23 15:59:18,250 DEBUG [RS:0;jenkins-hbase4:38643] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38643,1713887956870 2024-04-23 15:59:18,250 DEBUG [RS:0;jenkins-hbase4:38643] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38643,1713887956870' 2024-04-23 15:59:18,250 DEBUG [RS:0;jenkins-hbase4:38643] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-04-23 15:59:18,251 DEBUG [RS:0;jenkins-hbase4:38643] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-04-23 15:59:18,252 DEBUG [RS:0;jenkins-hbase4:38643] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-04-23 15:59:18,252 DEBUG [RS:0;jenkins-hbase4:38643] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-04-23 15:59:18,252 DEBUG [RS:0;jenkins-hbase4:38643] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38643,1713887956870 2024-04-23 15:59:18,252 DEBUG [RS:0;jenkins-hbase4:38643] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38643,1713887956870' 2024-04-23 15:59:18,252 DEBUG [RS:0;jenkins-hbase4:38643] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-04-23 15:59:18,253 DEBUG [RS:0;jenkins-hbase4:38643] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-04-23 15:59:18,253 INFO [RS:1;jenkins-hbase4:35681] regionserver.Replication(203): jenkins-hbase4.apache.org,35681,1713887956917 started 2024-04-23 15:59:18,254 INFO [RS:1;jenkins-hbase4:35681] regionserver.HRegionServer(1643): Serving as jenkins-hbase4.apache.org,35681,1713887956917, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:35681, sessionid=0x101310f8ecf0002 2024-04-23 15:59:18,254 DEBUG [RS:1;jenkins-hbase4:35681] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-04-23 15:59:18,254 DEBUG [RS:1;jenkins-hbase4:35681] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,35681,1713887956917 2024-04-23 15:59:18,254 DEBUG [RS:0;jenkins-hbase4:38643] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-04-23 15:59:18,254 DEBUG [RS:1;jenkins-hbase4:35681] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35681,1713887956917' 2024-04-23 15:59:18,255 DEBUG [RS:1;jenkins-hbase4:35681] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-04-23 15:59:18,255 INFO [RS:0;jenkins-hbase4:38643] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-04-23 15:59:18,256 DEBUG [RS:1;jenkins-hbase4:35681] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-04-23 15:59:18,257 DEBUG [RS:1;jenkins-hbase4:35681] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-04-23 15:59:18,257 DEBUG [RS:1;jenkins-hbase4:35681] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-04-23 15:59:18,257 DEBUG [RS:1;jenkins-hbase4:35681] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,35681,1713887956917 2024-04-23 15:59:18,258 INFO [RS:0;jenkins-hbase4:38643] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:18,258 DEBUG [RS:1;jenkins-hbase4:35681] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,35681,1713887956917' 2024-04-23 15:59:18,258 DEBUG [RS:1;jenkins-hbase4:35681] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-04-23 15:59:18,259 DEBUG [RS:0;jenkins-hbase4:38643] zookeeper.ZKUtil(399): regionserver:38643-0x101310f8ecf0001, quorum=127.0.0.1:51085, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-04-23 15:59:18,259 DEBUG [RS:1;jenkins-hbase4:35681] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-04-23 15:59:18,259 INFO [RS:0;jenkins-hbase4:38643] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-04-23 15:59:18,259 DEBUG [RS:1;jenkins-hbase4:35681] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-04-23 15:59:18,259 INFO [RS:0;jenkins-hbase4:38643] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:18,259 INFO [RS:1;jenkins-hbase4:35681] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-04-23 15:59:18,260 INFO [RS:1;jenkins-hbase4:35681] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:18,260 INFO [RS:0;jenkins-hbase4:38643] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:18,261 DEBUG [RS:1;jenkins-hbase4:35681] zookeeper.ZKUtil(399): regionserver:35681-0x101310f8ecf0002, quorum=127.0.0.1:51085, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-04-23 15:59:18,261 INFO [RS:1;jenkins-hbase4:35681] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-04-23 15:59:18,261 INFO [RS:1;jenkins-hbase4:35681] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:18,261 INFO [RS:1;jenkins-hbase4:35681] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:18,290 DEBUG [jenkins-hbase4:34409] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=2, allServersCount=2 2024-04-23 15:59:18,294 DEBUG [jenkins-hbase4:34409] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-04-23 15:59:18,300 DEBUG [jenkins-hbase4:34409] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-04-23 15:59:18,300 DEBUG [jenkins-hbase4:34409] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-04-23 15:59:18,300 DEBUG [jenkins-hbase4:34409] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-04-23 15:59:18,303 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35681,1713887956917, state=OPENING 2024-04-23 15:59:18,310 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2024-04-23 15:59:18,312 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-23 15:59:18,313 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-04-23 15:59:18,316 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35681,1713887956917}] 2024-04-23 15:59:18,373 INFO [RS:0;jenkins-hbase4:38643] wal.AbstractFSWAL(492): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38643%2C1713887956870, suffix=, logDir=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/WALs/jenkins-hbase4.apache.org,38643,1713887956870, archiveDir=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/oldWALs, maxLogs=32 2024-04-23 15:59:18,373 INFO [RS:1;jenkins-hbase4:35681] wal.AbstractFSWAL(492): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35681%2C1713887956917, suffix=, logDir=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/WALs/jenkins-hbase4.apache.org,35681,1713887956917, archiveDir=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/oldWALs, maxLogs=32 2024-04-23 15:59:18,396 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34303,DS-3064e21c-075e-4715-81c9-3eec9c4795be,DISK] 2024-04-23 15:59:18,399 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34303,DS-3064e21c-075e-4715-81c9-3eec9c4795be,DISK] 2024-04-23 15:59:18,399 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36853,DS-32128a07-5143-4431-9803-28dd02e0da3a,DISK] 2024-04-23 15:59:18,400 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36853,DS-32128a07-5143-4431-9803-28dd02e0da3a,DISK] 2024-04-23 15:59:18,419 INFO [RS:0;jenkins-hbase4:38643] wal.AbstractFSWAL(809): New WAL /user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/WALs/jenkins-hbase4.apache.org,38643,1713887956870/jenkins-hbase4.apache.org%2C38643%2C1713887956870.1713887958377 2024-04-23 15:59:18,419 INFO [RS:1;jenkins-hbase4:35681] wal.AbstractFSWAL(809): New WAL /user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/WALs/jenkins-hbase4.apache.org,35681,1713887956917/jenkins-hbase4.apache.org%2C35681%2C1713887956917.1713887958377 2024-04-23 15:59:18,419 DEBUG [RS:0;jenkins-hbase4:38643] wal.AbstractFSWAL(890): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34303,DS-3064e21c-075e-4715-81c9-3eec9c4795be,DISK], DatanodeInfoWithStorage[127.0.0.1:36853,DS-32128a07-5143-4431-9803-28dd02e0da3a,DISK]] 2024-04-23 15:59:18,420 DEBUG [RS:1;jenkins-hbase4:35681] wal.AbstractFSWAL(890): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34303,DS-3064e21c-075e-4715-81c9-3eec9c4795be,DISK], DatanodeInfoWithStorage[127.0.0.1:36853,DS-32128a07-5143-4431-9803-28dd02e0da3a,DISK]] 2024-04-23 15:59:18,501 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,35681,1713887956917 2024-04-23 15:59:18,504 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-04-23 15:59:18,508 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35912, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-04-23 15:59:18,520 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2024-04-23 15:59:18,520 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-04-23 15:59:18,525 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(492): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35681%2C1713887956917.meta, suffix=.meta, logDir=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/WALs/jenkins-hbase4.apache.org,35681,1713887956917, archiveDir=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/oldWALs, maxLogs=32 2024-04-23 15:59:18,549 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34303,DS-3064e21c-075e-4715-81c9-3eec9c4795be,DISK] 2024-04-23 15:59:18,550 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36853,DS-32128a07-5143-4431-9803-28dd02e0da3a,DISK] 2024-04-23 15:59:18,554 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(809): New WAL /user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/WALs/jenkins-hbase4.apache.org,35681,1713887956917/jenkins-hbase4.apache.org%2C35681%2C1713887956917.meta.1713887958526.meta 2024-04-23 15:59:18,555 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(890): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34303,DS-3064e21c-075e-4715-81c9-3eec9c4795be,DISK], DatanodeInfoWithStorage[127.0.0.1:36853,DS-32128a07-5143-4431-9803-28dd02e0da3a,DISK]] 2024-04-23 15:59:18,555 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2024-04-23 15:59:18,557 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2024-04-23 15:59:18,573 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2024-04-23 15:59:18,577 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2024-04-23 15:59:18,582 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2024-04-23 15:59:18,583 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-23 15:59:18,583 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2024-04-23 15:59:18,583 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2024-04-23 15:59:18,586 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-04-23 15:59:18,588 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/meta/1588230740/info 2024-04-23 15:59:18,588 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/meta/1588230740/info 2024-04-23 15:59:18,589 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-04-23 15:59:18,590 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-23 15:59:18,591 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-04-23 15:59:18,592 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/meta/1588230740/rep_barrier 2024-04-23 15:59:18,592 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/meta/1588230740/rep_barrier 2024-04-23 15:59:18,593 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-04-23 15:59:18,594 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-23 15:59:18,594 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-04-23 15:59:18,595 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/meta/1588230740/table 2024-04-23 15:59:18,595 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/meta/1588230740/table 2024-04-23 15:59:18,596 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-04-23 15:59:18,597 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-23 15:59:18,598 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/meta/1588230740 2024-04-23 15:59:18,602 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/meta/1588230740 2024-04-23 15:59:18,605 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-04-23 15:59:18,608 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2024-04-23 15:59:18,610 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66912165, jitterRate=-0.00293104350566864}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-04-23 15:59:18,610 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2024-04-23 15:59:18,620 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2345): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1713887958494 2024-04-23 15:59:18,640 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2372): Finished post open deploy task for hbase:meta,,1.1588230740 2024-04-23 15:59:18,640 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2024-04-23 15:59:18,641 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,35681,1713887956917, state=OPEN 2024-04-23 15:59:18,644 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2024-04-23 15:59:18,644 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-04-23 15:59:18,650 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=3, resume processing ppid=2 2024-04-23 15:59:18,650 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,35681,1713887956917 in 329 msec 2024-04-23 15:59:18,656 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=2, resume processing ppid=1 2024-04-23 15:59:18,656 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 532 msec 2024-04-23 15:59:18,661 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 768 msec 2024-04-23 15:59:18,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(954): Wait for region servers to report in: status=null, state=RUNNING, startTime=1713887958662, completionTime=-1 2024-04-23 15:59:18,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(824): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2024-04-23 15:59:18,662 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2024-04-23 15:59:18,725 DEBUG [hconnection-0x425b2738-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-04-23 15:59:18,728 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35928, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-04-23 15:59:18,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=2 2024-04-23 15:59:18,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1713888018744 2024-04-23 15:59:18,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1713888078744 2024-04-23 15:59:18,744 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 82 msec 2024-04-23 15:59:18,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34409,1713887955657-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:18,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34409,1713887955657-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:18,769 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34409,1713887955657-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:18,771 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:34409, period=300000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:18,771 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:18,777 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2024-04-23 15:59:18,785 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2024-04-23 15:59:18,787 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-04-23 15:59:18,796 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2024-04-23 15:59:18,799 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2024-04-23 15:59:18,801 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-04-23 15:59:18,823 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/hbase/namespace/7156285833ed7202d03c0cd137ce6936 2024-04-23 15:59:18,826 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/hbase/namespace/7156285833ed7202d03c0cd137ce6936 empty. 2024-04-23 15:59:18,827 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/hbase/namespace/7156285833ed7202d03c0cd137ce6936 2024-04-23 15:59:18,827 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2024-04-23 15:59:18,855 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2024-04-23 15:59:18,857 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7156285833ed7202d03c0cd137ce6936, NAME => 'hbase:namespace,,1713887958786.7156285833ed7202d03c0cd137ce6936.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp 2024-04-23 15:59:18,873 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1713887958786.7156285833ed7202d03c0cd137ce6936.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-23 15:59:18,873 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 7156285833ed7202d03c0cd137ce6936, disabling compactions & flushes 2024-04-23 15:59:18,873 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1713887958786.7156285833ed7202d03c0cd137ce6936. 2024-04-23 15:59:18,873 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1713887958786.7156285833ed7202d03c0cd137ce6936. 2024-04-23 15:59:18,873 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1713887958786.7156285833ed7202d03c0cd137ce6936. after waiting 0 ms 2024-04-23 15:59:18,873 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1713887958786.7156285833ed7202d03c0cd137ce6936. 2024-04-23 15:59:18,874 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1713887958786.7156285833ed7202d03c0cd137ce6936. 2024-04-23 15:59:18,874 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 7156285833ed7202d03c0cd137ce6936: 2024-04-23 15:59:18,878 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2024-04-23 15:59:18,893 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1713887958786.7156285833ed7202d03c0cd137ce6936.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1713887958881"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713887958881"}]},"ts":"1713887958881"} 2024-04-23 15:59:18,919 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-04-23 15:59:18,921 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-04-23 15:59:18,927 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713887958921"}]},"ts":"1713887958921"} 2024-04-23 15:59:18,934 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2024-04-23 15:59:18,940 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-04-23 15:59:18,942 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-04-23 15:59:18,942 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-04-23 15:59:18,942 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-04-23 15:59:18,945 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7156285833ed7202d03c0cd137ce6936, ASSIGN}] 2024-04-23 15:59:18,948 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=7156285833ed7202d03c0cd137ce6936, ASSIGN 2024-04-23 15:59:18,951 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=7156285833ed7202d03c0cd137ce6936, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38643,1713887956870; forceNewPlan=false, retain=false 2024-04-23 15:59:19,104 INFO [jenkins-hbase4:34409] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-04-23 15:59:19,105 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7156285833ed7202d03c0cd137ce6936, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38643,1713887956870 2024-04-23 15:59:19,105 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1713887958786.7156285833ed7202d03c0cd137ce6936.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1713887959104"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713887959104"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713887959104"}]},"ts":"1713887959104"} 2024-04-23 15:59:19,112 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 7156285833ed7202d03c0cd137ce6936, server=jenkins-hbase4.apache.org,38643,1713887956870}] 2024-04-23 15:59:19,266 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,38643,1713887956870 2024-04-23 15:59:19,266 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-04-23 15:59:19,269 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44582, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-04-23 15:59:19,276 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1713887958786.7156285833ed7202d03c0cd137ce6936. 2024-04-23 15:59:19,276 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7156285833ed7202d03c0cd137ce6936, NAME => 'hbase:namespace,,1713887958786.7156285833ed7202d03c0cd137ce6936.', STARTKEY => '', ENDKEY => ''} 2024-04-23 15:59:19,277 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 7156285833ed7202d03c0cd137ce6936 2024-04-23 15:59:19,278 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1713887958786.7156285833ed7202d03c0cd137ce6936.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-23 15:59:19,278 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7156285833ed7202d03c0cd137ce6936 2024-04-23 15:59:19,278 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7156285833ed7202d03c0cd137ce6936 2024-04-23 15:59:19,280 INFO [StoreOpener-7156285833ed7202d03c0cd137ce6936-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 7156285833ed7202d03c0cd137ce6936 2024-04-23 15:59:19,284 DEBUG [StoreOpener-7156285833ed7202d03c0cd137ce6936-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/namespace/7156285833ed7202d03c0cd137ce6936/info 2024-04-23 15:59:19,284 DEBUG [StoreOpener-7156285833ed7202d03c0cd137ce6936-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/namespace/7156285833ed7202d03c0cd137ce6936/info 2024-04-23 15:59:19,284 INFO [StoreOpener-7156285833ed7202d03c0cd137ce6936-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7156285833ed7202d03c0cd137ce6936 columnFamilyName info 2024-04-23 15:59:19,285 INFO [StoreOpener-7156285833ed7202d03c0cd137ce6936-1] regionserver.HStore(310): Store=7156285833ed7202d03c0cd137ce6936/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-23 15:59:19,287 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/namespace/7156285833ed7202d03c0cd137ce6936 2024-04-23 15:59:19,288 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/namespace/7156285833ed7202d03c0cd137ce6936 2024-04-23 15:59:19,293 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7156285833ed7202d03c0cd137ce6936 2024-04-23 15:59:19,297 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/namespace/7156285833ed7202d03c0cd137ce6936/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-23 15:59:19,298 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7156285833ed7202d03c0cd137ce6936; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69079453, jitterRate=0.02936406433582306}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-04-23 15:59:19,298 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7156285833ed7202d03c0cd137ce6936: 2024-04-23 15:59:19,300 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2345): Post open deploy tasks for hbase:namespace,,1713887958786.7156285833ed7202d03c0cd137ce6936., pid=6, masterSystemTime=1713887959266 2024-04-23 15:59:19,305 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2372): Finished post open deploy task for hbase:namespace,,1713887958786.7156285833ed7202d03c0cd137ce6936. 2024-04-23 15:59:19,305 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1713887958786.7156285833ed7202d03c0cd137ce6936. 2024-04-23 15:59:19,307 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=7156285833ed7202d03c0cd137ce6936, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38643,1713887956870 2024-04-23 15:59:19,307 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1713887958786.7156285833ed7202d03c0cd137ce6936.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1713887959306"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1713887959306"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1713887959306"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1713887959306"}]},"ts":"1713887959306"} 2024-04-23 15:59:19,315 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=6, resume processing ppid=5 2024-04-23 15:59:19,315 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 7156285833ed7202d03c0cd137ce6936, server=jenkins-hbase4.apache.org,38643,1713887956870 in 199 msec 2024-04-23 15:59:19,319 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=5, resume processing ppid=4 2024-04-23 15:59:19,320 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=7156285833ed7202d03c0cd137ce6936, ASSIGN in 370 msec 2024-04-23 15:59:19,321 INFO [PEWorker-5] procedure.CreateTableProcedure(82): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-04-23 15:59:19,321 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713887959321"}]},"ts":"1713887959321"} 2024-04-23 15:59:19,324 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2024-04-23 15:59:19,328 INFO [PEWorker-5] procedure.CreateTableProcedure(82): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2024-04-23 15:59:19,331 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 541 msec 2024-04-23 15:59:19,399 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2024-04-23 15:59:19,401 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2024-04-23 15:59:19,401 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-23 15:59:19,424 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-04-23 15:59:19,428 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44588, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-04-23 15:59:19,441 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2024-04-23 15:59:19,458 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-04-23 15:59:19,464 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 31 msec 2024-04-23 15:59:19,474 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2024-04-23 15:59:19,486 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-04-23 15:59:19,491 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2024-04-23 15:59:19,500 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2024-04-23 15:59:19,503 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2024-04-23 15:59:19,504 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1084): Master has completed initialization 2.525sec 2024-04-23 15:59:19,506 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(103): Quota table not found. Creating... 2024-04-23 15:59:19,507 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-04-23 15:59:19,508 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:quota 2024-04-23 15:59:19,508 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(107): Initializing quota support 2024-04-23 15:59:19,511 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_PRE_OPERATION 2024-04-23 15:59:19,511 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(59): Namespace State Manager started. 2024-04-23 15:59:19,512 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-04-23 15:59:19,515 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/hbase/quota/11917ae24ca59bc5e35ea04f43ba1f5a 2024-04-23 15:59:19,516 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/hbase/quota/11917ae24ca59bc5e35ea04f43ba1f5a empty. 2024-04-23 15:59:19,519 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/hbase/quota/11917ae24ca59bc5e35ea04f43ba1f5a 2024-04-23 15:59:19,519 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:quota regions 2024-04-23 15:59:19,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(222): Finished updating state of 2 namespaces. 2024-04-23 15:59:19,520 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceAuditor(50): NamespaceAuditor started. 2024-04-23 15:59:19,522 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:19,523 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=300000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:19,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2024-04-23 15:59:19,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2024-04-23 15:59:19,526 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34409,1713887955657-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2024-04-23 15:59:19,527 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34409,1713887955657-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2024-04-23 15:59:19,539 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1176): Balancer post startup initialization complete, took 0 seconds 2024-04-23 15:59:19,540 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34409,1713887955657-OldWALsDirSizeChore, period=300000, unit=MILLISECONDS is enabled. 2024-04-23 15:59:19,541 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/hbase/quota/.tabledesc/.tableinfo.0000000001 2024-04-23 15:59:19,546 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(7675): creating {ENCODED => 11917ae24ca59bc5e35ea04f43ba1f5a, NAME => 'hbase:quota,,1713887959506.11917ae24ca59bc5e35ea04f43ba1f5a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp 2024-04-23 15:59:19,550 DEBUG [Listener at localhost/33425] zookeeper.ReadOnlyZKClient(139): Connect 0x64db2a34 to 127.0.0.1:51085 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-04-23 15:59:19,557 DEBUG [Listener at localhost/33425] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5bc8fc5c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-04-23 15:59:19,577 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(866): Instantiated hbase:quota,,1713887959506.11917ae24ca59bc5e35ea04f43ba1f5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-23 15:59:19,579 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1604): Closing 11917ae24ca59bc5e35ea04f43ba1f5a, disabling compactions & flushes 2024-04-23 15:59:19,579 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1626): Closing region hbase:quota,,1713887959506.11917ae24ca59bc5e35ea04f43ba1f5a. 2024-04-23 15:59:19,579 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1713887959506.11917ae24ca59bc5e35ea04f43ba1f5a. 2024-04-23 15:59:19,579 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1713887959506.11917ae24ca59bc5e35ea04f43ba1f5a. after waiting 0 ms 2024-04-23 15:59:19,579 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1713887959506.11917ae24ca59bc5e35ea04f43ba1f5a. 2024-04-23 15:59:19,579 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1838): Closed hbase:quota,,1713887959506.11917ae24ca59bc5e35ea04f43ba1f5a. 2024-04-23 15:59:19,579 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1558): Region close journal for 11917ae24ca59bc5e35ea04f43ba1f5a: 2024-04-23 15:59:19,581 DEBUG [hconnection-0x63df6b5d-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-04-23 15:59:19,584 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ADD_TO_META 2024-04-23 15:59:19,587 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:quota,,1713887959506.11917ae24ca59bc5e35ea04f43ba1f5a.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1713887959586"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713887959586"}]},"ts":"1713887959586"} 2024-04-23 15:59:19,590 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-04-23 15:59:19,593 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-04-23 15:59:19,594 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713887959593"}]},"ts":"1713887959593"} 2024-04-23 15:59:19,597 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35936, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-04-23 15:59:19,598 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLING in hbase:meta 2024-04-23 15:59:19,607 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-04-23 15:59:19,609 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,34409,1713887955657 2024-04-23 15:59:19,609 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-04-23 15:59:19,609 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-04-23 15:59:19,609 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-04-23 15:59:19,610 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=11917ae24ca59bc5e35ea04f43ba1f5a, ASSIGN}] 2024-04-23 15:59:19,610 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 15:59:19,612 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=11917ae24ca59bc5e35ea04f43ba1f5a, ASSIGN 2024-04-23 15:59:19,614 DEBUG [Listener at localhost/33425] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-04-23 15:59:19,614 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:quota, region=11917ae24ca59bc5e35ea04f43ba1f5a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35681,1713887956917; forceNewPlan=false, retain=false 2024-04-23 15:59:19,717 DEBUG [Listener at localhost/33425] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-04-23 15:59:19,765 INFO [jenkins-hbase4:34409] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-04-23 15:59:19,766 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=11917ae24ca59bc5e35ea04f43ba1f5a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35681,1713887956917 2024-04-23 15:59:19,766 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:quota,,1713887959506.11917ae24ca59bc5e35ea04f43ba1f5a.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1713887959765"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713887959765"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713887959765"}]},"ts":"1713887959765"} 2024-04-23 15:59:19,770 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 11917ae24ca59bc5e35ea04f43ba1f5a, server=jenkins-hbase4.apache.org,35681,1713887956917}] 2024-04-23 15:59:19,819 DEBUG [Listener at localhost/33425] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-04-23 15:59:19,922 DEBUG [Listener at localhost/33425] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-04-23 15:59:19,924 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,35681,1713887956917 2024-04-23 15:59:19,930 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:quota,,1713887959506.11917ae24ca59bc5e35ea04f43ba1f5a. 2024-04-23 15:59:19,931 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 11917ae24ca59bc5e35ea04f43ba1f5a, NAME => 'hbase:quota,,1713887959506.11917ae24ca59bc5e35ea04f43ba1f5a.', STARTKEY => '', ENDKEY => ''} 2024-04-23 15:59:19,931 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table quota 11917ae24ca59bc5e35ea04f43ba1f5a 2024-04-23 15:59:19,931 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:quota,,1713887959506.11917ae24ca59bc5e35ea04f43ba1f5a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-23 15:59:19,931 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 11917ae24ca59bc5e35ea04f43ba1f5a 2024-04-23 15:59:19,931 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 11917ae24ca59bc5e35ea04f43ba1f5a 2024-04-23 15:59:19,933 INFO [StoreOpener-11917ae24ca59bc5e35ea04f43ba1f5a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family q of region 11917ae24ca59bc5e35ea04f43ba1f5a 2024-04-23 15:59:19,936 DEBUG [StoreOpener-11917ae24ca59bc5e35ea04f43ba1f5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/quota/11917ae24ca59bc5e35ea04f43ba1f5a/q 2024-04-23 15:59:19,936 DEBUG [StoreOpener-11917ae24ca59bc5e35ea04f43ba1f5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/quota/11917ae24ca59bc5e35ea04f43ba1f5a/q 2024-04-23 15:59:19,936 INFO [StoreOpener-11917ae24ca59bc5e35ea04f43ba1f5a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 11917ae24ca59bc5e35ea04f43ba1f5a columnFamilyName q 2024-04-23 15:59:19,937 INFO [StoreOpener-11917ae24ca59bc5e35ea04f43ba1f5a-1] regionserver.HStore(310): Store=11917ae24ca59bc5e35ea04f43ba1f5a/q, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-23 15:59:19,937 INFO [StoreOpener-11917ae24ca59bc5e35ea04f43ba1f5a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family u of region 11917ae24ca59bc5e35ea04f43ba1f5a 2024-04-23 15:59:19,939 DEBUG [StoreOpener-11917ae24ca59bc5e35ea04f43ba1f5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/quota/11917ae24ca59bc5e35ea04f43ba1f5a/u 2024-04-23 15:59:19,939 DEBUG [StoreOpener-11917ae24ca59bc5e35ea04f43ba1f5a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/quota/11917ae24ca59bc5e35ea04f43ba1f5a/u 2024-04-23 15:59:19,940 INFO [StoreOpener-11917ae24ca59bc5e35ea04f43ba1f5a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 11917ae24ca59bc5e35ea04f43ba1f5a columnFamilyName u 2024-04-23 15:59:19,941 INFO [StoreOpener-11917ae24ca59bc5e35ea04f43ba1f5a-1] regionserver.HStore(310): Store=11917ae24ca59bc5e35ea04f43ba1f5a/u, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-23 15:59:19,943 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/quota/11917ae24ca59bc5e35ea04f43ba1f5a 2024-04-23 15:59:19,944 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/quota/11917ae24ca59bc5e35ea04f43ba1f5a 2024-04-23 15:59:19,947 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:quota descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2024-04-23 15:59:19,949 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 11917ae24ca59bc5e35ea04f43ba1f5a 2024-04-23 15:59:19,953 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/quota/11917ae24ca59bc5e35ea04f43ba1f5a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-23 15:59:19,954 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 11917ae24ca59bc5e35ea04f43ba1f5a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58911649, jitterRate=-0.12214802205562592}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2024-04-23 15:59:19,954 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 11917ae24ca59bc5e35ea04f43ba1f5a: 2024-04-23 15:59:19,955 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2345): Post open deploy tasks for hbase:quota,,1713887959506.11917ae24ca59bc5e35ea04f43ba1f5a., pid=11, masterSystemTime=1713887959923 2024-04-23 15:59:19,958 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2372): Finished post open deploy task for hbase:quota,,1713887959506.11917ae24ca59bc5e35ea04f43ba1f5a. 2024-04-23 15:59:19,958 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:quota,,1713887959506.11917ae24ca59bc5e35ea04f43ba1f5a. 2024-04-23 15:59:19,959 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=11917ae24ca59bc5e35ea04f43ba1f5a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35681,1713887956917 2024-04-23 15:59:19,960 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:quota,,1713887959506.11917ae24ca59bc5e35ea04f43ba1f5a.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1713887959959"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1713887959959"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1713887959959"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1713887959959"}]},"ts":"1713887959959"} 2024-04-23 15:59:19,966 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=11, resume processing ppid=10 2024-04-23 15:59:19,966 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 11917ae24ca59bc5e35ea04f43ba1f5a, server=jenkins-hbase4.apache.org,35681,1713887956917 in 192 msec 2024-04-23 15:59:19,969 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=10, resume processing ppid=9 2024-04-23 15:59:19,969 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:quota, region=11917ae24ca59bc5e35ea04f43ba1f5a, ASSIGN in 356 msec 2024-04-23 15:59:19,970 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-04-23 15:59:19,971 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713887959970"}]},"ts":"1713887959970"} 2024-04-23 15:59:19,973 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLED in hbase:meta 2024-04-23 15:59:19,976 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_POST_OPERATION 2024-04-23 15:59:19,979 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:quota in 469 msec 2024-04-23 15:59:20,036 DEBUG [Listener at localhost/33425] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-04-23 15:59:20,039 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32910, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2024-04-23 15:59:20,068 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-04-23 15:59:20,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] procedure2.ProcedureExecutor(1075): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin0 2024-04-23 15:59:20,073 INFO [PEWorker-5] procedure.CreateTableProcedure(82): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_PRE_OPERATION 2024-04-23 15:59:20,075 INFO [PEWorker-5] procedure.CreateTableProcedure(82): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-04-23 15:59:20,077 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin0" procId is: 12 2024-04-23 15:59:20,078 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/default/TestQuotaAdmin0/b852ba82e77fd456df29e785f560259c 2024-04-23 15:59:20,079 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/default/TestQuotaAdmin0/b852ba82e77fd456df29e785f560259c empty. 2024-04-23 15:59:20,079 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/default/TestQuotaAdmin0/b852ba82e77fd456df29e785f560259c 2024-04-23 15:59:20,080 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-04-23 15:59:20,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-04-23 15:59:20,101 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/default/TestQuotaAdmin0/.tabledesc/.tableinfo.0000000001 2024-04-23 15:59:20,103 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(7675): creating {ENCODED => b852ba82e77fd456df29e785f560259c, NAME => 'TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp 2024-04-23 15:59:20,123 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-23 15:59:20,123 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1604): Closing b852ba82e77fd456df29e785f560259c, disabling compactions & flushes 2024-04-23 15:59:20,123 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c. 2024-04-23 15:59:20,123 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c. 2024-04-23 15:59:20,123 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c. after waiting 0 ms 2024-04-23 15:59:20,123 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c. 2024-04-23 15:59:20,123 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c. 2024-04-23 15:59:20,123 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1558): Region close journal for b852ba82e77fd456df29e785f560259c: 2024-04-23 15:59:20,128 INFO [PEWorker-5] procedure.CreateTableProcedure(82): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ADD_TO_META 2024-04-23 15:59:20,130 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713887960130"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713887960130"}]},"ts":"1713887960130"} 2024-04-23 15:59:20,134 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-04-23 15:59:20,135 INFO [PEWorker-5] procedure.CreateTableProcedure(82): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-04-23 15:59:20,136 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713887960136"}]},"ts":"1713887960136"} 2024-04-23 15:59:20,138 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLING in hbase:meta 2024-04-23 15:59:20,145 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-04-23 15:59:20,146 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-04-23 15:59:20,146 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-04-23 15:59:20,146 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-04-23 15:59:20,147 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=b852ba82e77fd456df29e785f560259c, ASSIGN}] 2024-04-23 15:59:20,148 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=b852ba82e77fd456df29e785f560259c, ASSIGN 2024-04-23 15:59:20,150 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin0, region=b852ba82e77fd456df29e785f560259c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35681,1713887956917; forceNewPlan=false, retain=false 2024-04-23 15:59:20,301 INFO [jenkins-hbase4:34409] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-04-23 15:59:20,302 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=b852ba82e77fd456df29e785f560259c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35681,1713887956917 2024-04-23 15:59:20,302 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713887960302"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713887960302"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713887960302"}]},"ts":"1713887960302"} 2024-04-23 15:59:20,305 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; OpenRegionProcedure b852ba82e77fd456df29e785f560259c, server=jenkins-hbase4.apache.org,35681,1713887956917}] 2024-04-23 15:59:20,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-04-23 15:59:20,459 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,35681,1713887956917 2024-04-23 15:59:20,466 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c. 2024-04-23 15:59:20,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b852ba82e77fd456df29e785f560259c, NAME => 'TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c.', STARTKEY => '', ENDKEY => ''} 2024-04-23 15:59:20,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin0 b852ba82e77fd456df29e785f560259c 2024-04-23 15:59:20,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-23 15:59:20,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b852ba82e77fd456df29e785f560259c 2024-04-23 15:59:20,466 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b852ba82e77fd456df29e785f560259c 2024-04-23 15:59:20,468 INFO [StoreOpener-b852ba82e77fd456df29e785f560259c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b852ba82e77fd456df29e785f560259c 2024-04-23 15:59:20,471 DEBUG [StoreOpener-b852ba82e77fd456df29e785f560259c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/default/TestQuotaAdmin0/b852ba82e77fd456df29e785f560259c/cf 2024-04-23 15:59:20,471 DEBUG [StoreOpener-b852ba82e77fd456df29e785f560259c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/default/TestQuotaAdmin0/b852ba82e77fd456df29e785f560259c/cf 2024-04-23 15:59:20,471 INFO [StoreOpener-b852ba82e77fd456df29e785f560259c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b852ba82e77fd456df29e785f560259c columnFamilyName cf 2024-04-23 15:59:20,472 INFO [StoreOpener-b852ba82e77fd456df29e785f560259c-1] regionserver.HStore(310): Store=b852ba82e77fd456df29e785f560259c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-23 15:59:20,476 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/default/TestQuotaAdmin0/b852ba82e77fd456df29e785f560259c 2024-04-23 15:59:20,477 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/default/TestQuotaAdmin0/b852ba82e77fd456df29e785f560259c 2024-04-23 15:59:20,482 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b852ba82e77fd456df29e785f560259c 2024-04-23 15:59:20,485 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/default/TestQuotaAdmin0/b852ba82e77fd456df29e785f560259c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-23 15:59:20,486 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b852ba82e77fd456df29e785f560259c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66972920, jitterRate=-0.0020257234573364258}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-04-23 15:59:20,486 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b852ba82e77fd456df29e785f560259c: 2024-04-23 15:59:20,487 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2345): Post open deploy tasks for TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c., pid=14, masterSystemTime=1713887960459 2024-04-23 15:59:20,491 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2372): Finished post open deploy task for TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c. 2024-04-23 15:59:20,491 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c. 2024-04-23 15:59:20,492 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=b852ba82e77fd456df29e785f560259c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35681,1713887956917 2024-04-23 15:59:20,492 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713887960491"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1713887960491"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1713887960491"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1713887960491"}]},"ts":"1713887960491"} 2024-04-23 15:59:20,498 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=14, resume processing ppid=13 2024-04-23 15:59:20,499 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=14, ppid=13, state=SUCCESS; OpenRegionProcedure b852ba82e77fd456df29e785f560259c, server=jenkins-hbase4.apache.org,35681,1713887956917 in 190 msec 2024-04-23 15:59:20,501 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=13, resume processing ppid=12 2024-04-23 15:59:20,502 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=b852ba82e77fd456df29e785f560259c, ASSIGN in 351 msec 2024-04-23 15:59:20,503 INFO [PEWorker-4] procedure.CreateTableProcedure(82): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-04-23 15:59:20,503 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713887960503"}]},"ts":"1713887960503"} 2024-04-23 15:59:20,506 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLED in hbase:meta 2024-04-23 15:59:20,509 INFO [PEWorker-4] procedure.CreateTableProcedure(82): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_POST_OPERATION 2024-04-23 15:59:20,512 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=12, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin0 in 442 msec 2024-04-23 15:59:20,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-04-23 15:59:20,844 INFO [Listener at localhost/33425] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin0, procId: 12 completed 2024-04-23 15:59:20,845 DEBUG [Listener at localhost/33425] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin0 get assigned. Timeout = 60000ms 2024-04-23 15:59:20,845 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 15:59:20,850 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin0 assigned to meta. Checking AM states. 2024-04-23 15:59:20,851 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 15:59:20,851 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin0 assigned. 2024-04-23 15:59:20,851 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 15:59:20,865 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-04-23 15:59:20,867 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32916, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=MasterService 2024-04-23 15:59:20,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-04-23 15:59:20,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] procedure2.ProcedureExecutor(1075): Stored pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin1 2024-04-23 15:59:20,872 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_PRE_OPERATION 2024-04-23 15:59:20,872 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin1" procId is: 15 2024-04-23 15:59:20,874 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=15, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-04-23 15:59:20,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-04-23 15:59:20,876 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/default/TestQuotaAdmin1/8c95a092b150eab1e1eb4c1a1a17602e 2024-04-23 15:59:20,877 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/default/TestQuotaAdmin1/8c95a092b150eab1e1eb4c1a1a17602e empty. 2024-04-23 15:59:20,878 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/default/TestQuotaAdmin1/8c95a092b150eab1e1eb4c1a1a17602e 2024-04-23 15:59:20,878 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-04-23 15:59:20,902 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/default/TestQuotaAdmin1/.tabledesc/.tableinfo.0000000001 2024-04-23 15:59:20,904 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8c95a092b150eab1e1eb4c1a1a17602e, NAME => 'TestQuotaAdmin1,,1713887960868.8c95a092b150eab1e1eb4c1a1a17602e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp 2024-04-23 15:59:20,924 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1713887960868.8c95a092b150eab1e1eb4c1a1a17602e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-23 15:59:20,924 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1604): Closing 8c95a092b150eab1e1eb4c1a1a17602e, disabling compactions & flushes 2024-04-23 15:59:20,924 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1713887960868.8c95a092b150eab1e1eb4c1a1a17602e. 2024-04-23 15:59:20,924 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1713887960868.8c95a092b150eab1e1eb4c1a1a17602e. 2024-04-23 15:59:20,924 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1713887960868.8c95a092b150eab1e1eb4c1a1a17602e. after waiting 0 ms 2024-04-23 15:59:20,924 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1713887960868.8c95a092b150eab1e1eb4c1a1a17602e. 2024-04-23 15:59:20,924 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1713887960868.8c95a092b150eab1e1eb4c1a1a17602e. 2024-04-23 15:59:20,924 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1558): Region close journal for 8c95a092b150eab1e1eb4c1a1a17602e: 2024-04-23 15:59:20,928 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=15, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ADD_TO_META 2024-04-23 15:59:20,931 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1713887960868.8c95a092b150eab1e1eb4c1a1a17602e.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713887960931"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713887960931"}]},"ts":"1713887960931"} 2024-04-23 15:59:20,933 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-04-23 15:59:20,935 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=15, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-04-23 15:59:20,935 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713887960935"}]},"ts":"1713887960935"} 2024-04-23 15:59:20,937 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLING in hbase:meta 2024-04-23 15:59:20,942 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-04-23 15:59:20,943 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-04-23 15:59:20,943 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-04-23 15:59:20,943 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-04-23 15:59:20,943 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=8c95a092b150eab1e1eb4c1a1a17602e, ASSIGN}] 2024-04-23 15:59:20,945 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=8c95a092b150eab1e1eb4c1a1a17602e, ASSIGN 2024-04-23 15:59:20,946 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin1, region=8c95a092b150eab1e1eb4c1a1a17602e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38643,1713887956870; forceNewPlan=false, retain=false 2024-04-23 15:59:21,096 INFO [jenkins-hbase4:34409] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-04-23 15:59:21,097 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=8c95a092b150eab1e1eb4c1a1a17602e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38643,1713887956870 2024-04-23 15:59:21,097 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1713887960868.8c95a092b150eab1e1eb4c1a1a17602e.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713887961097"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713887961097"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713887961097"}]},"ts":"1713887961097"} 2024-04-23 15:59:21,101 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure 8c95a092b150eab1e1eb4c1a1a17602e, server=jenkins-hbase4.apache.org,38643,1713887956870}] 2024-04-23 15:59:21,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-04-23 15:59:21,254 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,38643,1713887956870 2024-04-23 15:59:21,260 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin1,,1713887960868.8c95a092b150eab1e1eb4c1a1a17602e. 2024-04-23 15:59:21,260 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8c95a092b150eab1e1eb4c1a1a17602e, NAME => 'TestQuotaAdmin1,,1713887960868.8c95a092b150eab1e1eb4c1a1a17602e.', STARTKEY => '', ENDKEY => ''} 2024-04-23 15:59:21,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin1 8c95a092b150eab1e1eb4c1a1a17602e 2024-04-23 15:59:21,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1713887960868.8c95a092b150eab1e1eb4c1a1a17602e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-23 15:59:21,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8c95a092b150eab1e1eb4c1a1a17602e 2024-04-23 15:59:21,261 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8c95a092b150eab1e1eb4c1a1a17602e 2024-04-23 15:59:21,263 INFO [StoreOpener-8c95a092b150eab1e1eb4c1a1a17602e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8c95a092b150eab1e1eb4c1a1a17602e 2024-04-23 15:59:21,265 DEBUG [StoreOpener-8c95a092b150eab1e1eb4c1a1a17602e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/default/TestQuotaAdmin1/8c95a092b150eab1e1eb4c1a1a17602e/cf 2024-04-23 15:59:21,265 DEBUG [StoreOpener-8c95a092b150eab1e1eb4c1a1a17602e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/default/TestQuotaAdmin1/8c95a092b150eab1e1eb4c1a1a17602e/cf 2024-04-23 15:59:21,266 INFO [StoreOpener-8c95a092b150eab1e1eb4c1a1a17602e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8c95a092b150eab1e1eb4c1a1a17602e columnFamilyName cf 2024-04-23 15:59:21,267 INFO [StoreOpener-8c95a092b150eab1e1eb4c1a1a17602e-1] regionserver.HStore(310): Store=8c95a092b150eab1e1eb4c1a1a17602e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-23 15:59:21,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/default/TestQuotaAdmin1/8c95a092b150eab1e1eb4c1a1a17602e 2024-04-23 15:59:21,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/default/TestQuotaAdmin1/8c95a092b150eab1e1eb4c1a1a17602e 2024-04-23 15:59:21,276 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8c95a092b150eab1e1eb4c1a1a17602e 2024-04-23 15:59:21,280 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/default/TestQuotaAdmin1/8c95a092b150eab1e1eb4c1a1a17602e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-23 15:59:21,281 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8c95a092b150eab1e1eb4c1a1a17602e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61435870, jitterRate=-0.08453419804573059}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-04-23 15:59:21,281 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8c95a092b150eab1e1eb4c1a1a17602e: 2024-04-23 15:59:21,282 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2345): Post open deploy tasks for TestQuotaAdmin1,,1713887960868.8c95a092b150eab1e1eb4c1a1a17602e., pid=17, masterSystemTime=1713887961253 2024-04-23 15:59:21,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2372): Finished post open deploy task for TestQuotaAdmin1,,1713887960868.8c95a092b150eab1e1eb4c1a1a17602e. 2024-04-23 15:59:21,285 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin1,,1713887960868.8c95a092b150eab1e1eb4c1a1a17602e. 2024-04-23 15:59:21,286 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=8c95a092b150eab1e1eb4c1a1a17602e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38643,1713887956870 2024-04-23 15:59:21,286 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin1,,1713887960868.8c95a092b150eab1e1eb4c1a1a17602e.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713887961285"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1713887961285"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1713887961285"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1713887961285"}]},"ts":"1713887961285"} 2024-04-23 15:59:21,291 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=17, resume processing ppid=16 2024-04-23 15:59:21,291 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure 8c95a092b150eab1e1eb4c1a1a17602e, server=jenkins-hbase4.apache.org,38643,1713887956870 in 188 msec 2024-04-23 15:59:21,294 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=16, resume processing ppid=15 2024-04-23 15:59:21,295 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=8c95a092b150eab1e1eb4c1a1a17602e, ASSIGN in 348 msec 2024-04-23 15:59:21,297 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=15, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-04-23 15:59:21,297 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713887961297"}]},"ts":"1713887961297"} 2024-04-23 15:59:21,300 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLED in hbase:meta 2024-04-23 15:59:21,303 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=15, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_POST_OPERATION 2024-04-23 15:59:21,305 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=15, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin1 in 435 msec 2024-04-23 15:59:21,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-04-23 15:59:21,628 INFO [Listener at localhost/33425] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin1, procId: 15 completed 2024-04-23 15:59:21,628 DEBUG [Listener at localhost/33425] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin1 get assigned. Timeout = 60000ms 2024-04-23 15:59:21,628 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 15:59:21,632 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin1 assigned to meta. Checking AM states. 2024-04-23 15:59:21,632 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 15:59:21,633 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin1 assigned. 2024-04-23 15:59:21,633 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 15:59:21,641 DEBUG [hconnection-0x63df6b5d-shared-pool-5] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-04-23 15:59:21,644 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44600, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-04-23 15:59:21,646 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-04-23 15:59:21,651 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32920, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService 2024-04-23 15:59:21,652 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-04-23 15:59:21,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] procedure2.ProcedureExecutor(1075): Stored pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin2 2024-04-23 15:59:21,658 DEBUG [hconnection-0x65eb36ba-metaLookup-shared--pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-04-23 15:59:21,658 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_PRE_OPERATION 2024-04-23 15:59:21,658 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin2" procId is: 18 2024-04-23 15:59:21,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-04-23 15:59:21,660 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35940, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2024-04-23 15:59:21,660 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=18, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-04-23 15:59:21,663 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/default/TestQuotaAdmin2/784d8adfc0d2d28fd746144871aed29b 2024-04-23 15:59:21,665 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/default/TestQuotaAdmin2/784d8adfc0d2d28fd746144871aed29b empty. 2024-04-23 15:59:21,666 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/default/TestQuotaAdmin2/784d8adfc0d2d28fd746144871aed29b 2024-04-23 15:59:21,666 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-04-23 15:59:21,691 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/default/TestQuotaAdmin2/.tabledesc/.tableinfo.0000000001 2024-04-23 15:59:21,693 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(7675): creating {ENCODED => 784d8adfc0d2d28fd746144871aed29b, NAME => 'TestQuotaAdmin2,,1713887961652.784d8adfc0d2d28fd746144871aed29b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp 2024-04-23 15:59:21,708 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1713887961652.784d8adfc0d2d28fd746144871aed29b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-23 15:59:21,708 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1604): Closing 784d8adfc0d2d28fd746144871aed29b, disabling compactions & flushes 2024-04-23 15:59:21,708 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1713887961652.784d8adfc0d2d28fd746144871aed29b. 2024-04-23 15:59:21,708 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1713887961652.784d8adfc0d2d28fd746144871aed29b. 2024-04-23 15:59:21,708 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1713887961652.784d8adfc0d2d28fd746144871aed29b. after waiting 0 ms 2024-04-23 15:59:21,708 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1713887961652.784d8adfc0d2d28fd746144871aed29b. 2024-04-23 15:59:21,708 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1713887961652.784d8adfc0d2d28fd746144871aed29b. 2024-04-23 15:59:21,708 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1558): Region close journal for 784d8adfc0d2d28fd746144871aed29b: 2024-04-23 15:59:21,712 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=18, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ADD_TO_META 2024-04-23 15:59:21,714 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1713887961652.784d8adfc0d2d28fd746144871aed29b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713887961714"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713887961714"}]},"ts":"1713887961714"} 2024-04-23 15:59:21,716 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-04-23 15:59:21,718 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=18, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-04-23 15:59:21,718 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713887961718"}]},"ts":"1713887961718"} 2024-04-23 15:59:21,720 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLING in hbase:meta 2024-04-23 15:59:21,726 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-04-23 15:59:21,727 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-04-23 15:59:21,727 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-04-23 15:59:21,727 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-04-23 15:59:21,727 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=784d8adfc0d2d28fd746144871aed29b, ASSIGN}] 2024-04-23 15:59:21,728 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=784d8adfc0d2d28fd746144871aed29b, ASSIGN 2024-04-23 15:59:21,730 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin2, region=784d8adfc0d2d28fd746144871aed29b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35681,1713887956917; forceNewPlan=false, retain=false 2024-04-23 15:59:21,880 INFO [jenkins-hbase4:34409] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-04-23 15:59:21,881 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=784d8adfc0d2d28fd746144871aed29b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35681,1713887956917 2024-04-23 15:59:21,881 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1713887961652.784d8adfc0d2d28fd746144871aed29b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713887961881"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713887961881"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713887961881"}]},"ts":"1713887961881"} 2024-04-23 15:59:21,884 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE; OpenRegionProcedure 784d8adfc0d2d28fd746144871aed29b, server=jenkins-hbase4.apache.org,35681,1713887956917}] 2024-04-23 15:59:21,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-04-23 15:59:22,037 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,35681,1713887956917 2024-04-23 15:59:22,043 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin2,,1713887961652.784d8adfc0d2d28fd746144871aed29b. 2024-04-23 15:59:22,043 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 784d8adfc0d2d28fd746144871aed29b, NAME => 'TestQuotaAdmin2,,1713887961652.784d8adfc0d2d28fd746144871aed29b.', STARTKEY => '', ENDKEY => ''} 2024-04-23 15:59:22,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin2 784d8adfc0d2d28fd746144871aed29b 2024-04-23 15:59:22,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1713887961652.784d8adfc0d2d28fd746144871aed29b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-23 15:59:22,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 784d8adfc0d2d28fd746144871aed29b 2024-04-23 15:59:22,044 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 784d8adfc0d2d28fd746144871aed29b 2024-04-23 15:59:22,046 INFO [StoreOpener-784d8adfc0d2d28fd746144871aed29b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 784d8adfc0d2d28fd746144871aed29b 2024-04-23 15:59:22,048 DEBUG [StoreOpener-784d8adfc0d2d28fd746144871aed29b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/default/TestQuotaAdmin2/784d8adfc0d2d28fd746144871aed29b/cf 2024-04-23 15:59:22,048 DEBUG [StoreOpener-784d8adfc0d2d28fd746144871aed29b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/default/TestQuotaAdmin2/784d8adfc0d2d28fd746144871aed29b/cf 2024-04-23 15:59:22,049 INFO [StoreOpener-784d8adfc0d2d28fd746144871aed29b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 784d8adfc0d2d28fd746144871aed29b columnFamilyName cf 2024-04-23 15:59:22,049 INFO [StoreOpener-784d8adfc0d2d28fd746144871aed29b-1] regionserver.HStore(310): Store=784d8adfc0d2d28fd746144871aed29b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-23 15:59:22,051 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/default/TestQuotaAdmin2/784d8adfc0d2d28fd746144871aed29b 2024-04-23 15:59:22,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/default/TestQuotaAdmin2/784d8adfc0d2d28fd746144871aed29b 2024-04-23 15:59:22,057 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 784d8adfc0d2d28fd746144871aed29b 2024-04-23 15:59:22,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/default/TestQuotaAdmin2/784d8adfc0d2d28fd746144871aed29b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-23 15:59:22,061 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 784d8adfc0d2d28fd746144871aed29b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70754460, jitterRate=0.05432361364364624}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-04-23 15:59:22,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 784d8adfc0d2d28fd746144871aed29b: 2024-04-23 15:59:22,063 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2345): Post open deploy tasks for TestQuotaAdmin2,,1713887961652.784d8adfc0d2d28fd746144871aed29b., pid=20, masterSystemTime=1713887962037 2024-04-23 15:59:22,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2372): Finished post open deploy task for TestQuotaAdmin2,,1713887961652.784d8adfc0d2d28fd746144871aed29b. 2024-04-23 15:59:22,065 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin2,,1713887961652.784d8adfc0d2d28fd746144871aed29b. 2024-04-23 15:59:22,066 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=784d8adfc0d2d28fd746144871aed29b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35681,1713887956917 2024-04-23 15:59:22,066 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin2,,1713887961652.784d8adfc0d2d28fd746144871aed29b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713887962066"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1713887962066"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1713887962066"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1713887962066"}]},"ts":"1713887962066"} 2024-04-23 15:59:22,071 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=20, resume processing ppid=19 2024-04-23 15:59:22,071 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=20, ppid=19, state=SUCCESS; OpenRegionProcedure 784d8adfc0d2d28fd746144871aed29b, server=jenkins-hbase4.apache.org,35681,1713887956917 in 184 msec 2024-04-23 15:59:22,077 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=19, resume processing ppid=18 2024-04-23 15:59:22,078 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=19, ppid=18, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=784d8adfc0d2d28fd746144871aed29b, ASSIGN in 344 msec 2024-04-23 15:59:22,079 INFO [PEWorker-5] procedure.CreateTableProcedure(82): pid=18, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-04-23 15:59:22,079 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713887962079"}]},"ts":"1713887962079"} 2024-04-23 15:59:22,082 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLED in hbase:meta 2024-04-23 15:59:22,085 INFO [PEWorker-5] procedure.CreateTableProcedure(82): pid=18, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_POST_OPERATION 2024-04-23 15:59:22,088 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=18, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin2 in 434 msec 2024-04-23 15:59:22,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-04-23 15:59:22,414 INFO [Listener at localhost/33425] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin2, procId: 18 completed 2024-04-23 15:59:22,414 DEBUG [Listener at localhost/33425] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin2 get assigned. Timeout = 60000ms 2024-04-23 15:59:22,415 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 15:59:22,418 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin2 assigned to meta. Checking AM states. 2024-04-23 15:59:22,418 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 15:59:22,418 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin2 assigned. 2024-04-23 15:59:22,418 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 15:59:22,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.HMaster$15(3020): Client=jenkins//172.31.14.131 creating {NAME => 'TestNs'} 2024-04-23 15:59:22,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] procedure2.ProcedureExecutor(1075): Stored pid=21, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=TestNs 2024-04-23 15:59:22,442 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-04-23 15:59:22,451 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-04-23 15:59:22,457 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=21, state=SUCCESS; CreateNamespaceProcedure, namespace=TestNs in 21 msec 2024-04-23 15:59:22,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-04-23 15:59:22,697 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-04-23 15:59:22,699 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] procedure2.ProcedureExecutor(1075): Stored pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestNs:TestTable 2024-04-23 15:59:22,701 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_PRE_OPERATION 2024-04-23 15:59:22,701 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "TestNs" qualifier: "TestTable" procId is: 22 2024-04-23 15:59:22,702 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=22, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-04-23 15:59:22,703 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-04-23 15:59:22,706 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/TestNs/TestTable/baedff6b55b1f9a725328c4d9dc65555 2024-04-23 15:59:22,706 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/TestNs/TestTable/b543438e711b19ba14547290046bf01c 2024-04-23 15:59:22,706 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/TestNs/TestTable/baedff6b55b1f9a725328c4d9dc65555 empty. 2024-04-23 15:59:22,707 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/TestNs/TestTable/b543438e711b19ba14547290046bf01c empty. 2024-04-23 15:59:22,707 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/TestNs/TestTable/baedff6b55b1f9a725328c4d9dc65555 2024-04-23 15:59:22,707 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/TestNs/TestTable/b543438e711b19ba14547290046bf01c 2024-04-23 15:59:22,707 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-04-23 15:59:22,727 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/TestNs/TestTable/.tabledesc/.tableinfo.0000000001 2024-04-23 15:59:22,729 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(7675): creating {ENCODED => baedff6b55b1f9a725328c4d9dc65555, NAME => 'TestNs:TestTable,,1713887962697.baedff6b55b1f9a725328c4d9dc65555.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp 2024-04-23 15:59:22,729 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(7675): creating {ENCODED => b543438e711b19ba14547290046bf01c, NAME => 'TestNs:TestTable,1,1713887962697.b543438e711b19ba14547290046bf01c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp 2024-04-23 15:59:22,749 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1713887962697.baedff6b55b1f9a725328c4d9dc65555.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-23 15:59:22,750 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1604): Closing baedff6b55b1f9a725328c4d9dc65555, disabling compactions & flushes 2024-04-23 15:59:22,750 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1713887962697.baedff6b55b1f9a725328c4d9dc65555. 2024-04-23 15:59:22,750 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1713887962697.baedff6b55b1f9a725328c4d9dc65555. 2024-04-23 15:59:22,750 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1713887962697.baedff6b55b1f9a725328c4d9dc65555. after waiting 0 ms 2024-04-23 15:59:22,750 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1713887962697.baedff6b55b1f9a725328c4d9dc65555. 2024-04-23 15:59:22,750 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1713887962697.b543438e711b19ba14547290046bf01c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-23 15:59:22,750 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1713887962697.baedff6b55b1f9a725328c4d9dc65555. 2024-04-23 15:59:22,750 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1604): Closing b543438e711b19ba14547290046bf01c, disabling compactions & flushes 2024-04-23 15:59:22,751 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1713887962697.b543438e711b19ba14547290046bf01c. 2024-04-23 15:59:22,751 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1713887962697.b543438e711b19ba14547290046bf01c. 2024-04-23 15:59:22,751 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1713887962697.b543438e711b19ba14547290046bf01c. after waiting 0 ms 2024-04-23 15:59:22,751 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1713887962697.b543438e711b19ba14547290046bf01c. 2024-04-23 15:59:22,751 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1713887962697.b543438e711b19ba14547290046bf01c. 2024-04-23 15:59:22,751 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1558): Region close journal for baedff6b55b1f9a725328c4d9dc65555: 2024-04-23 15:59:22,751 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1558): Region close journal for b543438e711b19ba14547290046bf01c: 2024-04-23 15:59:22,756 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=22, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ADD_TO_META 2024-04-23 15:59:22,757 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,,1713887962697.baedff6b55b1f9a725328c4d9dc65555.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713887962757"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713887962757"}]},"ts":"1713887962757"} 2024-04-23 15:59:22,758 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1713887962697.b543438e711b19ba14547290046bf01c.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713887962757"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713887962757"}]},"ts":"1713887962757"} 2024-04-23 15:59:22,764 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2024-04-23 15:59:22,766 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=22, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-04-23 15:59:22,766 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713887962766"}]},"ts":"1713887962766"} 2024-04-23 15:59:22,768 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLING in hbase:meta 2024-04-23 15:59:22,773 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-04-23 15:59:22,775 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-04-23 15:59:22,775 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-04-23 15:59:22,775 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-04-23 15:59:22,776 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=baedff6b55b1f9a725328c4d9dc65555, ASSIGN}, {pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=b543438e711b19ba14547290046bf01c, ASSIGN}] 2024-04-23 15:59:22,777 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=b543438e711b19ba14547290046bf01c, ASSIGN 2024-04-23 15:59:22,777 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=baedff6b55b1f9a725328c4d9dc65555, ASSIGN 2024-04-23 15:59:22,778 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=b543438e711b19ba14547290046bf01c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38643,1713887956870; forceNewPlan=false, retain=false 2024-04-23 15:59:22,778 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=baedff6b55b1f9a725328c4d9dc65555, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,35681,1713887956917; forceNewPlan=false, retain=false 2024-04-23 15:59:22,929 INFO [jenkins-hbase4:34409] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2024-04-23 15:59:22,930 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=b543438e711b19ba14547290046bf01c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38643,1713887956870 2024-04-23 15:59:22,930 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=baedff6b55b1f9a725328c4d9dc65555, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,35681,1713887956917 2024-04-23 15:59:22,930 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1713887962697.b543438e711b19ba14547290046bf01c.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713887962930"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713887962930"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713887962930"}]},"ts":"1713887962930"} 2024-04-23 15:59:22,930 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1713887962697.baedff6b55b1f9a725328c4d9dc65555.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713887962930"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713887962930"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713887962930"}]},"ts":"1713887962930"} 2024-04-23 15:59:22,933 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure b543438e711b19ba14547290046bf01c, server=jenkins-hbase4.apache.org,38643,1713887956870}] 2024-04-23 15:59:22,935 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=26, ppid=23, state=RUNNABLE; OpenRegionProcedure baedff6b55b1f9a725328c4d9dc65555, server=jenkins-hbase4.apache.org,35681,1713887956917}] 2024-04-23 15:59:22,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-04-23 15:59:23,086 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,38643,1713887956870 2024-04-23 15:59:23,088 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,35681,1713887956917 2024-04-23 15:59:23,092 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,1,1713887962697.b543438e711b19ba14547290046bf01c. 2024-04-23 15:59:23,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b543438e711b19ba14547290046bf01c, NAME => 'TestNs:TestTable,1,1713887962697.b543438e711b19ba14547290046bf01c.', STARTKEY => '1', ENDKEY => ''} 2024-04-23 15:59:23,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,,1713887962697.baedff6b55b1f9a725328c4d9dc65555. 2024-04-23 15:59:23,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable b543438e711b19ba14547290046bf01c 2024-04-23 15:59:23,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => baedff6b55b1f9a725328c4d9dc65555, NAME => 'TestNs:TestTable,,1713887962697.baedff6b55b1f9a725328c4d9dc65555.', STARTKEY => '', ENDKEY => '1'} 2024-04-23 15:59:23,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1713887962697.b543438e711b19ba14547290046bf01c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-23 15:59:23,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b543438e711b19ba14547290046bf01c 2024-04-23 15:59:23,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b543438e711b19ba14547290046bf01c 2024-04-23 15:59:23,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable baedff6b55b1f9a725328c4d9dc65555 2024-04-23 15:59:23,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1713887962697.baedff6b55b1f9a725328c4d9dc65555.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-23 15:59:23,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for baedff6b55b1f9a725328c4d9dc65555 2024-04-23 15:59:23,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for baedff6b55b1f9a725328c4d9dc65555 2024-04-23 15:59:23,095 INFO [StoreOpener-b543438e711b19ba14547290046bf01c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b543438e711b19ba14547290046bf01c 2024-04-23 15:59:23,095 INFO [StoreOpener-baedff6b55b1f9a725328c4d9dc65555-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region baedff6b55b1f9a725328c4d9dc65555 2024-04-23 15:59:23,098 DEBUG [StoreOpener-b543438e711b19ba14547290046bf01c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/TestNs/TestTable/b543438e711b19ba14547290046bf01c/cf 2024-04-23 15:59:23,098 DEBUG [StoreOpener-b543438e711b19ba14547290046bf01c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/TestNs/TestTable/b543438e711b19ba14547290046bf01c/cf 2024-04-23 15:59:23,098 DEBUG [StoreOpener-baedff6b55b1f9a725328c4d9dc65555-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/TestNs/TestTable/baedff6b55b1f9a725328c4d9dc65555/cf 2024-04-23 15:59:23,098 DEBUG [StoreOpener-baedff6b55b1f9a725328c4d9dc65555-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/TestNs/TestTable/baedff6b55b1f9a725328c4d9dc65555/cf 2024-04-23 15:59:23,098 INFO [StoreOpener-b543438e711b19ba14547290046bf01c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b543438e711b19ba14547290046bf01c columnFamilyName cf 2024-04-23 15:59:23,098 INFO [StoreOpener-baedff6b55b1f9a725328c4d9dc65555-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region baedff6b55b1f9a725328c4d9dc65555 columnFamilyName cf 2024-04-23 15:59:23,099 INFO [StoreOpener-b543438e711b19ba14547290046bf01c-1] regionserver.HStore(310): Store=b543438e711b19ba14547290046bf01c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-23 15:59:23,100 INFO [StoreOpener-baedff6b55b1f9a725328c4d9dc65555-1] regionserver.HStore(310): Store=baedff6b55b1f9a725328c4d9dc65555/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-23 15:59:23,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/TestNs/TestTable/b543438e711b19ba14547290046bf01c 2024-04-23 15:59:23,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/TestNs/TestTable/baedff6b55b1f9a725328c4d9dc65555 2024-04-23 15:59:23,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/TestNs/TestTable/b543438e711b19ba14547290046bf01c 2024-04-23 15:59:23,103 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/TestNs/TestTable/baedff6b55b1f9a725328c4d9dc65555 2024-04-23 15:59:23,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b543438e711b19ba14547290046bf01c 2024-04-23 15:59:23,108 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for baedff6b55b1f9a725328c4d9dc65555 2024-04-23 15:59:23,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/TestNs/TestTable/b543438e711b19ba14547290046bf01c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-23 15:59:23,111 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/TestNs/TestTable/baedff6b55b1f9a725328c4d9dc65555/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-23 15:59:23,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b543438e711b19ba14547290046bf01c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65528826, jitterRate=-0.023544400930404663}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-04-23 15:59:23,112 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened baedff6b55b1f9a725328c4d9dc65555; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59454850, jitterRate=-0.11405369639396667}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-04-23 15:59:23,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b543438e711b19ba14547290046bf01c: 2024-04-23 15:59:23,112 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for baedff6b55b1f9a725328c4d9dc65555: 2024-04-23 15:59:23,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2345): Post open deploy tasks for TestNs:TestTable,,1713887962697.baedff6b55b1f9a725328c4d9dc65555., pid=26, masterSystemTime=1713887963088 2024-04-23 15:59:23,114 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2345): Post open deploy tasks for TestNs:TestTable,1,1713887962697.b543438e711b19ba14547290046bf01c., pid=25, masterSystemTime=1713887963086 2024-04-23 15:59:23,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2372): Finished post open deploy task for TestNs:TestTable,1,1713887962697.b543438e711b19ba14547290046bf01c. 2024-04-23 15:59:23,117 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,1,1713887962697.b543438e711b19ba14547290046bf01c. 2024-04-23 15:59:23,118 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=b543438e711b19ba14547290046bf01c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38643,1713887956870 2024-04-23 15:59:23,118 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,1,1713887962697.b543438e711b19ba14547290046bf01c.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713887963117"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1713887963117"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1713887963117"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1713887963117"}]},"ts":"1713887963117"} 2024-04-23 15:59:23,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2372): Finished post open deploy task for TestNs:TestTable,,1713887962697.baedff6b55b1f9a725328c4d9dc65555. 2024-04-23 15:59:23,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,,1713887962697.baedff6b55b1f9a725328c4d9dc65555. 2024-04-23 15:59:23,119 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=baedff6b55b1f9a725328c4d9dc65555, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,35681,1713887956917 2024-04-23 15:59:23,120 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,,1713887962697.baedff6b55b1f9a725328c4d9dc65555.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713887963119"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1713887963119"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1713887963119"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1713887963119"}]},"ts":"1713887963119"} 2024-04-23 15:59:23,124 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=25, resume processing ppid=24 2024-04-23 15:59:23,124 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure b543438e711b19ba14547290046bf01c, server=jenkins-hbase4.apache.org,38643,1713887956870 in 188 msec 2024-04-23 15:59:23,126 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=26, resume processing ppid=23 2024-04-23 15:59:23,127 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=24, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=b543438e711b19ba14547290046bf01c, ASSIGN in 349 msec 2024-04-23 15:59:23,127 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=26, ppid=23, state=SUCCESS; OpenRegionProcedure baedff6b55b1f9a725328c4d9dc65555, server=jenkins-hbase4.apache.org,35681,1713887956917 in 188 msec 2024-04-23 15:59:23,129 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=23, resume processing ppid=22 2024-04-23 15:59:23,129 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=23, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=baedff6b55b1f9a725328c4d9dc65555, ASSIGN in 352 msec 2024-04-23 15:59:23,130 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=22, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-04-23 15:59:23,130 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713887963130"}]},"ts":"1713887963130"} 2024-04-23 15:59:23,132 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLED in hbase:meta 2024-04-23 15:59:23,135 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=22, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_POST_OPERATION 2024-04-23 15:59:23,138 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=22, state=SUCCESS; CreateTableProcedure table=TestNs:TestTable in 438 msec 2024-04-23 15:59:23,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-04-23 15:59:23,457 INFO [Listener at localhost/33425] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: TestNs:TestTable, procId: 22 completed 2024-04-23 15:59:23,457 DEBUG [Listener at localhost/33425] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestNs:TestTable get assigned. Timeout = 60000ms 2024-04-23 15:59:23,457 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 15:59:23,461 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(3484): All regions for table TestNs:TestTable assigned to meta. Checking AM states. 2024-04-23 15:59:23,462 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 15:59:23,462 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(3504): All regions for table TestNs:TestTable assigned. 2024-04-23 15:59:23,462 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 15:59:23,518 INFO [Listener at localhost/33425] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=308, OpenFileDescriptor=631, MaxFileDescriptor=60000, SystemLoadAverage=282, ProcessCount=166, AvailableMemoryMB=12903 2024-04-23 15:59:23,812 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 15:59:23,813 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-23 15:59:23,813 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713891563560 bypass), TestNs=QuotaState(ts=1713891563560 bypass)} 2024-04-23 15:59:23,813 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713891563560 bypass), TestQuotaAdmin1=QuotaState(ts=1713891563560 bypass)} 2024-04-23 15:59:23,813 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713891563560 [ TestNs:TestTable ])} 2024-04-23 15:59:23,813 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713891563560 bypass)} 2024-04-23 15:59:24,064 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 15:59:24,064 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-23 15:59:24,064 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713891563560 bypass), TestNs=QuotaState(ts=1713891563560 bypass)} 2024-04-23 15:59:24,064 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713891563560 bypass), TestNs:TestTable=QuotaState(ts=1713891563560 bypass), TestQuotaAdmin2=QuotaState(ts=1713891563560 bypass)} 2024-04-23 15:59:24,064 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713891563560 [ TestNs:TestTable ])} 2024-04-23 15:59:24,064 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713891563560 bypass)} 2024-04-23 15:59:24,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 15:59:24,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] ipc.CallRunner(144): callId: 90 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:44600 deadline: 1713887974079, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 15:59:24,107 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2024-04-23 15:59:24,178 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin0' 2024-04-23 15:59:24,179 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2024-04-23 15:59:24,179 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestNs:TestTable' 2024-04-23 15:59:24,179 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin2' 2024-04-23 15:59:24,180 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:quota' 2024-04-23 15:59:24,180 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2024-04-23 15:59:24,181 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin1' 2024-04-23 15:59:24,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 15:59:24,353 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] ipc.CallRunner(144): callId: 92 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:44600 deadline: 1713887974079, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 15:59:24,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 15:59:24,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] ipc.CallRunner(144): callId: 94 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:44600 deadline: 1713887974080, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 15:59:25,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 15:59:25,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] ipc.CallRunner(144): callId: 96 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:44600 deadline: 1713887974079, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 15:59:25,826 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-04-23 15:59:25,827 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver Metrics about HBase MasterObservers 2024-04-23 15:59:25,827 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-04-23 15:59:25,827 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2024-04-23 15:59:26,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 15:59:26,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] ipc.CallRunner(144): callId: 98 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:44600 deadline: 1713887974080, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 15:59:29,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 15:59:29,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] ipc.CallRunner(144): callId: 100 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:44600 deadline: 1713887974080, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 15:59:29,406 ERROR [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10376: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1713887962697.b543438e711b19ba14547290046bf01c., hostname=jenkins-hbase4.apache.org,38643,1713887956870, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-23 15:59:29,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 15:59:29,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] ipc.CallRunner(144): callId: 101 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:44600 deadline: 1713887979410, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 15:59:29,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 15:59:29,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] ipc.CallRunner(144): callId: 103 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:44600 deadline: 1713887979410, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 15:59:30,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 15:59:30,174 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] ipc.CallRunner(144): callId: 105 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:44600 deadline: 1713887979410, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 15:59:30,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 15:59:30,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] ipc.CallRunner(144): callId: 107 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:44600 deadline: 1713887979409, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 15:59:32,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 15:59:32,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] ipc.CallRunner(144): callId: 109 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:44600 deadline: 1713887979409, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 15:59:34,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 15:59:34,717 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] ipc.CallRunner(144): callId: 111 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:44600 deadline: 1713887979409, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 15:59:34,718 ERROR [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10355: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1713887962697.b543438e711b19ba14547290046bf01c., hostname=jenkins-hbase4.apache.org,38643,1713887956870, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-23 15:59:34,980 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 15:59:34,981 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-23 15:59:34,981 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713895163560 bypass), TestNs=QuotaState(ts=1713895163560 bypass)} 2024-04-23 15:59:34,981 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713895163560 bypass), TestQuotaAdmin1=QuotaState(ts=1713895163560 bypass)} 2024-04-23 15:59:34,981 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713895163560 bypass)} 2024-04-23 15:59:34,981 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713895163560 bypass)} 2024-04-23 15:59:35,231 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 15:59:35,232 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-23 15:59:35,232 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713895163560 bypass), TestNs=QuotaState(ts=1713895163560 bypass)} 2024-04-23 15:59:35,232 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713895163560 bypass), TestNs:TestTable=QuotaState(ts=1713895163560 bypass), TestQuotaAdmin2=QuotaState(ts=1713895163560 bypass)} 2024-04-23 15:59:35,232 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713895163560 bypass)} 2024-04-23 15:59:35,232 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713895163560 bypass)} 2024-04-23 15:59:35,248 INFO [Listener at localhost/33425] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=292 (was 308), OpenFileDescriptor=600 (was 631), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=246 (was 282), ProcessCount=166 (was 166), AvailableMemoryMB=12828 (was 12903) 2024-04-23 15:59:35,262 INFO [Listener at localhost/33425] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=292, OpenFileDescriptor=600, MaxFileDescriptor=60000, SystemLoadAverage=246, ProcessCount=166, AvailableMemoryMB=12828 2024-04-23 15:59:35,526 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 15:59:35,526 INFO [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-04-23 15:59:35,777 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-23 15:59:35,778 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713898763660 bypass), TestNs=QuotaState(ts=1713898763660 bypass)} 2024-04-23 15:59:35,778 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713898763660 bypass), TestQuotaAdmin1=QuotaState(ts=1713898763660 bypass)} 2024-04-23 15:59:35,778 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713898763660 [ default ])} 2024-04-23 15:59:35,779 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713898763660 bypass)} 2024-04-23 15:59:36,029 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 15:59:36,029 INFO [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-04-23 15:59:36,280 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-23 15:59:36,281 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713898763760 bypass), TestNs=QuotaState(ts=1713898763760 bypass)} 2024-04-23 15:59:36,283 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713898763760 bypass), TestNs:TestTable=QuotaState(ts=1713898763760 bypass), TestQuotaAdmin2=QuotaState(ts=1713898763760 bypass)} 2024-04-23 15:59:36,283 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713898763760 [ default ])} 2024-04-23 15:59:36,283 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713898763760 bypass)} 2024-04-23 15:59:36,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-04-23 15:59:36,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 123 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:35936 deadline: 1713887986295, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-04-23 15:59:36,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-04-23 15:59:36,550 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 125 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:35936 deadline: 1713887986295, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-04-23 15:59:37,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-04-23 15:59:37,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 127 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:35936 deadline: 1713887986295, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-04-23 15:59:37,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-04-23 15:59:37,810 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 129 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35936 deadline: 1713887986295, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-04-23 15:59:39,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-04-23 15:59:39,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 131 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35936 deadline: 1713887986294, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-04-23 15:59:41,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-04-23 15:59:41,580 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 133 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35936 deadline: 1713887986295, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-04-23 15:59:41,583 ERROR [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10299: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c., hostname=jenkins-hbase4.apache.org,35681,1713887956917, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:199) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-23 15:59:41,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-23 15:59:41,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 140 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35936 deadline: 1713887991599, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-23 15:59:41,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-23 15:59:41,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 142 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35936 deadline: 1713887991599, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-23 15:59:42,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-23 15:59:42,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 144 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35936 deadline: 1713887991599, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-23 15:59:43,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-23 15:59:43,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 146 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35936 deadline: 1713887991599, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-23 15:59:44,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-23 15:59:44,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 148 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35936 deadline: 1713887991599, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-23 15:59:46,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-23 15:59:46,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 150 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35936 deadline: 1713887991599, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-23 15:59:46,905 ERROR [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10354: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c., hostname=jenkins-hbase4.apache.org,35681,1713887956917, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:200) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-23 15:59:47,162 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 15:59:47,162 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-23 15:59:47,162 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713902363760 bypass), TestNs=QuotaState(ts=1713902363760 bypass)} 2024-04-23 15:59:47,162 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713902363760 bypass), TestQuotaAdmin1=QuotaState(ts=1713902363760 bypass)} 2024-04-23 15:59:47,162 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713902363760 bypass)} 2024-04-23 15:59:47,162 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713902363760 bypass)} 2024-04-23 15:59:47,413 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 15:59:47,413 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-23 15:59:47,413 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713902363760 bypass), TestNs=QuotaState(ts=1713902363760 bypass)} 2024-04-23 15:59:47,413 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713902363760 bypass), TestNs:TestTable=QuotaState(ts=1713902363760 bypass), TestQuotaAdmin2=QuotaState(ts=1713902363760 bypass)} 2024-04-23 15:59:47,413 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713902363760 bypass)} 2024-04-23 15:59:47,413 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713902363760 bypass)} 2024-04-23 15:59:47,428 INFO [Listener at localhost/33425] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=292 (was 292), OpenFileDescriptor=596 (was 600), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=191 (was 246), ProcessCount=166 (was 166), AvailableMemoryMB=12818 (was 12828) 2024-04-23 15:59:47,442 INFO [Listener at localhost/33425] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=292, OpenFileDescriptor=596, MaxFileDescriptor=60000, SystemLoadAverage=191, ProcessCount=166, AvailableMemoryMB=12818 2024-04-23 15:59:47,704 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 15:59:47,704 INFO [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-04-23 15:59:47,954 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-23 15:59:47,955 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713905963860 bypass), TestNs=QuotaState(ts=1713905963860 bypass)} 2024-04-23 15:59:47,956 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713905963860 bypass), TestQuotaAdmin1=QuotaState(ts=1713905963860 bypass)} 2024-04-23 15:59:47,956 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713905963860 global-limiter)} 2024-04-23 15:59:47,956 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713905963860 bypass)} 2024-04-23 15:59:48,207 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 15:59:48,207 INFO [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-04-23 15:59:48,457 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-23 15:59:48,459 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713905963960 bypass), TestNs=QuotaState(ts=1713905963960 bypass)} 2024-04-23 15:59:48,459 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713905963960 bypass), TestNs:TestTable=QuotaState(ts=1713905963960 bypass), TestQuotaAdmin2=QuotaState(ts=1713905963960 bypass)} 2024-04-23 15:59:48,460 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713905963960 global-limiter)} 2024-04-23 15:59:48,460 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713905963960 bypass)} 2024-04-23 15:59:48,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-23 15:59:48,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 163 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35936 deadline: 1713887998477, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-23 15:59:48,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-23 15:59:48,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 165 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35936 deadline: 1713887998477, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-23 15:59:49,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-23 15:59:49,239 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 167 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35936 deadline: 1713887998476, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-23 15:59:49,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-23 15:59:49,994 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 169 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35936 deadline: 1713887998477, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-23 15:59:51,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-23 15:59:51,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 171 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35936 deadline: 1713887998477, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-23 15:59:53,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-23 15:59:53,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 173 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35936 deadline: 1713887998476, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-23 15:59:53,773 ERROR [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10339: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c., hostname=jenkins-hbase4.apache.org,35681,1713887956917, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:178) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-23 15:59:53,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-04-23 15:59:53,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 177 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35936 deadline: 1713888003780, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-04-23 15:59:54,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-04-23 15:59:54,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 179 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35936 deadline: 1713888003780, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-04-23 15:59:54,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-04-23 15:59:54,544 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 181 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35936 deadline: 1713888003780, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-04-23 15:59:55,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-04-23 15:59:55,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 183 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35936 deadline: 1713888003780, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-04-23 15:59:56,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-04-23 15:59:56,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 185 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35936 deadline: 1713888003779, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-04-23 15:59:59,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-04-23 15:59:59,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 187 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35936 deadline: 1713888003780, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-04-23 15:59:59,082 ERROR [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=3 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10330: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-3' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c., hostname=jenkins-hbase4.apache.org,35681,1713887956917, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-23 15:59:59,340 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 15:59:59,340 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-23 15:59:59,340 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713909563960 bypass), TestNs=QuotaState(ts=1713909563960 bypass)} 2024-04-23 15:59:59,340 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713909563960 bypass), TestQuotaAdmin1=QuotaState(ts=1713909563960 bypass)} 2024-04-23 15:59:59,340 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713909563960 bypass)} 2024-04-23 15:59:59,340 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713909563960 bypass)} 2024-04-23 15:59:59,591 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 15:59:59,591 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-23 15:59:59,591 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713909563960 bypass), TestNs=QuotaState(ts=1713909563960 bypass)} 2024-04-23 15:59:59,591 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713909563960 bypass), TestNs:TestTable=QuotaState(ts=1713909563960 bypass), TestQuotaAdmin2=QuotaState(ts=1713909563960 bypass)} 2024-04-23 15:59:59,591 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713909563960 bypass)} 2024-04-23 15:59:59,591 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713909563960 bypass)} 2024-04-23 15:59:59,605 INFO [Listener at localhost/33425] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=283 (was 292), OpenFileDescriptor=594 (was 596), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=177 (was 191), ProcessCount=166 (was 166), AvailableMemoryMB=12821 (was 12818) - AvailableMemoryMB LEAK? - 2024-04-23 15:59:59,618 INFO [Listener at localhost/33425] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=283, OpenFileDescriptor=594, MaxFileDescriptor=60000, SystemLoadAverage=177, ProcessCount=166, AvailableMemoryMB=12821 2024-04-23 15:59:59,877 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 15:59:59,878 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-23 15:59:59,878 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713913163960 bypass), TestNs=QuotaState(ts=1713913163960 bypass)} 2024-04-23 15:59:59,880 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713913163960 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin1=QuotaState(ts=1713913163960 bypass)} 2024-04-23 15:59:59,880 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(218): {} 2024-04-23 15:59:59,880 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713913163960 bypass)} 2024-04-23 16:00:00,130 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 16:00:00,132 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-23 16:00:00,132 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713913163960 bypass), TestNs=QuotaState(ts=1713913163960 bypass)} 2024-04-23 16:00:00,132 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713913163960 bypass), TestNs:TestTable=QuotaState(ts=1713913163960 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin2=QuotaState(ts=1713913163960 bypass)} 2024-04-23 16:00:00,132 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(218): {} 2024-04-23 16:00:00,132 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713913163960 bypass)} 2024-04-23 16:00:00,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 16:00:00,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] ipc.CallRunner(144): callId: 202 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:44600 deadline: 1713888010149, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 16:00:00,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 16:00:00,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] ipc.CallRunner(144): callId: 204 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:44600 deadline: 1713888010149, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 16:00:00,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 16:00:00,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] ipc.CallRunner(144): callId: 206 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:44600 deadline: 1713888010149, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 16:00:01,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 16:00:01,669 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] ipc.CallRunner(144): callId: 208 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:44600 deadline: 1713888010149, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 16:00:02,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 16:00:02,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] ipc.CallRunner(144): callId: 210 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:44600 deadline: 1713888010149, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 16:00:05,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 16:00:05,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] ipc.CallRunner(144): callId: 212 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:44600 deadline: 1713888010150, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 16:00:05,456 ERROR [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10315: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1713887962697.b543438e711b19ba14547290046bf01c., hostname=jenkins-hbase4.apache.org,38643,1713887956870, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-23 16:00:05,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 16:00:05,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] ipc.CallRunner(144): callId: 213 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:44600 deadline: 1713888015458, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 16:00:05,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 16:00:05,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] ipc.CallRunner(144): callId: 215 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:44600 deadline: 1713888015458, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 16:00:06,220 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 16:00:06,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] ipc.CallRunner(144): callId: 217 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:44600 deadline: 1713888015458, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 16:00:06,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 16:00:06,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] ipc.CallRunner(144): callId: 219 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:44600 deadline: 1713888015458, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 16:00:08,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 16:00:08,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] ipc.CallRunner(144): callId: 221 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:44600 deadline: 1713888015459, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 16:00:10,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 16:00:10,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38643] ipc.CallRunner(144): callId: 223 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:44600 deadline: 1713888015459, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-23 16:00:10,740 ERROR [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10282: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1713887962697.b543438e711b19ba14547290046bf01c., hostname=jenkins-hbase4.apache.org,38643,1713887956870, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-23 16:00:10,997 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 16:00:10,997 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-23 16:00:10,997 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713916763960 bypass), TestNs=QuotaState(ts=1713916763960 bypass)} 2024-04-23 16:00:10,997 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713916763960 bypass), TestQuotaAdmin1=QuotaState(ts=1713916763960 bypass)} 2024-04-23 16:00:10,997 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713916763960 bypass)} 2024-04-23 16:00:10,998 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713916763960 bypass)} 2024-04-23 16:00:11,248 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 16:00:11,248 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-23 16:00:11,248 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713916763960 bypass), TestNs=QuotaState(ts=1713916763960 bypass)} 2024-04-23 16:00:11,248 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713916763960 bypass), TestNs:TestTable=QuotaState(ts=1713916763960 bypass), TestQuotaAdmin2=QuotaState(ts=1713916763960 bypass)} 2024-04-23 16:00:11,248 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(218): {} 2024-04-23 16:00:11,248 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713916763960 bypass)} 2024-04-23 16:00:11,262 INFO [Listener at localhost/33425] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=282 (was 283), OpenFileDescriptor=594 (was 594), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=145 (was 177), ProcessCount=166 (was 166), AvailableMemoryMB=12815 (was 12821) 2024-04-23 16:00:11,275 INFO [Listener at localhost/33425] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=282, OpenFileDescriptor=594, MaxFileDescriptor=60000, SystemLoadAverage=145, ProcessCount=166, AvailableMemoryMB=12814 2024-04-23 16:00:11,537 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 16:00:11,537 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-23 16:00:11,538 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713920363960 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1713920363960 bypass)} 2024-04-23 16:00:11,538 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713920363960 bypass), TestQuotaAdmin1=QuotaState(ts=1713920363960 bypass)} 2024-04-23 16:00:11,538 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(218): {} 2024-04-23 16:00:11,538 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713920363960 bypass)} 2024-04-23 16:00:11,788 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 16:00:11,788 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-23 16:00:11,790 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713920363960 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1713920363960 bypass)} 2024-04-23 16:00:11,790 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713920363960 bypass), TestNs:TestTable=QuotaState(ts=1713920363960 bypass), TestQuotaAdmin2=QuotaState(ts=1713920363960 bypass)} 2024-04-23 16:00:11,790 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(218): {} 2024-04-23 16:00:11,790 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713920363960 bypass)} 2024-04-23 16:00:11,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-04-23 16:00:11,805 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 235 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35936 deadline: 1713888021805, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-04-23 16:00:12,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-04-23 16:00:12,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 237 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35936 deadline: 1713888021804, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-04-23 16:00:12,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-04-23 16:00:12,565 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 239 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35936 deadline: 1713888021804, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-04-23 16:00:13,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-04-23 16:00:13,324 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 241 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35936 deadline: 1713888021804, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-04-23 16:00:14,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-04-23 16:00:14,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 243 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35936 deadline: 1713888021804, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-04-23 16:00:17,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-04-23 16:00:17,099 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 245 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35936 deadline: 1713888021804, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-04-23 16:00:17,100 ERROR [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10335: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c., hostname=jenkins-hbase4.apache.org,35681,1713887956917, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:128) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-23 16:00:17,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-04-23 16:00:17,110 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 252 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35936 deadline: 1713888027110, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-04-23 16:00:17,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-04-23 16:00:17,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 254 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35936 deadline: 1713888027110, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-04-23 16:00:17,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-04-23 16:00:17,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 256 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35936 deadline: 1713888027111, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-04-23 16:00:18,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-04-23 16:00:18,627 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 258 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35936 deadline: 1713888027111, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-04-23 16:00:19,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-04-23 16:00:19,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 260 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35936 deadline: 1713888027110, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-04-23 16:00:22,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-04-23 16:00:22,391 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35681] ipc.CallRunner(144): callId: 262 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35936 deadline: 1713888027110, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-04-23 16:00:22,392 ERROR [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10289: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c., hostname=jenkins-hbase4.apache.org,35681,1713887956917, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-23 16:00:22,649 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 16:00:22,650 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-23 16:00:22,650 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713923963960 bypass), TestNs=QuotaState(ts=1713923963960 bypass)} 2024-04-23 16:00:22,650 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713923963960 bypass), TestQuotaAdmin1=QuotaState(ts=1713923963960 bypass)} 2024-04-23 16:00:22,650 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(218): {} 2024-04-23 16:00:22,650 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713923963960 bypass)} 2024-04-23 16:00:22,900 INFO [Listener at localhost/33425] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-23 16:00:22,900 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-23 16:00:22,900 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713923963960 bypass), TestNs=QuotaState(ts=1713923963960 bypass)} 2024-04-23 16:00:22,900 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713923963960 bypass), TestNs:TestTable=QuotaState(ts=1713923963960 bypass), TestQuotaAdmin2=QuotaState(ts=1713923963960 bypass)} 2024-04-23 16:00:22,900 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713923963960 bypass)} 2024-04-23 16:00:22,900 DEBUG [Listener at localhost/33425] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713923963960 bypass)} 2024-04-23 16:00:22,914 INFO [Listener at localhost/33425] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=267 (was 282), OpenFileDescriptor=585 (was 594), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=123 (was 145), ProcessCount=165 (was 166), AvailableMemoryMB=12815 (was 12814) - AvailableMemoryMB LEAK? - 2024-04-23 16:00:22,917 INFO [Listener at localhost/33425] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin0 2024-04-23 16:00:22,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin0 2024-04-23 16:00:22,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] procedure2.ProcedureExecutor(1075): Stored pid=27, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin0 2024-04-23 16:00:22,932 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713888022932"}]},"ts":"1713888022932"} 2024-04-23 16:00:22,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-04-23 16:00:22,934 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLING in hbase:meta 2024-04-23 16:00:22,937 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set TestQuotaAdmin0 to state=DISABLING 2024-04-23 16:00:22,938 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=b852ba82e77fd456df29e785f560259c, UNASSIGN}] 2024-04-23 16:00:22,940 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=b852ba82e77fd456df29e785f560259c, UNASSIGN 2024-04-23 16:00:22,941 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=b852ba82e77fd456df29e785f560259c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35681,1713887956917 2024-04-23 16:00:22,941 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713888022940"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713888022940"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713888022940"}]},"ts":"1713888022940"} 2024-04-23 16:00:22,943 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure b852ba82e77fd456df29e785f560259c, server=jenkins-hbase4.apache.org,35681,1713887956917}] 2024-04-23 16:00:23,089 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase4.apache.org,35681,1713887956917, timeout=1713888023098, delay=9, operations=[pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure b852ba82e77fd456df29e785f560259c, server=jenkins-hbase4.apache.org,35681,1713887956917]] 2024-04-23 16:00:23,100 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,35681,1713887956917 2024-04-23 16:00:23,102 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b852ba82e77fd456df29e785f560259c 2024-04-23 16:00:23,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b852ba82e77fd456df29e785f560259c, disabling compactions & flushes 2024-04-23 16:00:23,103 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c. 2024-04-23 16:00:23,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c. 2024-04-23 16:00:23,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c. after waiting 0 ms 2024-04-23 16:00:23,103 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c. 2024-04-23 16:00:23,104 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing b852ba82e77fd456df29e785f560259c 1/1 column families, dataSize=578 B heapSize=2.11 KB 2024-04-23 16:00:23,178 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=578 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/default/TestQuotaAdmin0/b852ba82e77fd456df29e785f560259c/.tmp/cf/2179dd58a9de475898608f69953582eb 2024-04-23 16:00:23,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-04-23 16:00:23,227 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/default/TestQuotaAdmin0/b852ba82e77fd456df29e785f560259c/.tmp/cf/2179dd58a9de475898608f69953582eb as hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/default/TestQuotaAdmin0/b852ba82e77fd456df29e785f560259c/cf/2179dd58a9de475898608f69953582eb 2024-04-23 16:00:23,240 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/default/TestQuotaAdmin0/b852ba82e77fd456df29e785f560259c/cf/2179dd58a9de475898608f69953582eb, entries=6, sequenceid=21, filesize=4.7 K 2024-04-23 16:00:23,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~578 B/578, heapSize ~2.09 KB/2144, currentSize=0 B/0 for b852ba82e77fd456df29e785f560259c in 138ms, sequenceid=21, compaction requested=false 2024-04-23 16:00:23,251 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/default/TestQuotaAdmin0/b852ba82e77fd456df29e785f560259c/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2024-04-23 16:00:23,253 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c. 2024-04-23 16:00:23,253 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b852ba82e77fd456df29e785f560259c: 2024-04-23 16:00:23,255 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b852ba82e77fd456df29e785f560259c 2024-04-23 16:00:23,256 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=b852ba82e77fd456df29e785f560259c, regionState=CLOSED 2024-04-23 16:00:23,256 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713888023256"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713888023256"}]},"ts":"1713888023256"} 2024-04-23 16:00:23,259 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=29, resume processing ppid=28 2024-04-23 16:00:23,260 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=29, ppid=28, state=SUCCESS; CloseRegionProcedure b852ba82e77fd456df29e785f560259c, server=jenkins-hbase4.apache.org,35681,1713887956917 in 314 msec 2024-04-23 16:00:23,262 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=28, resume processing ppid=27 2024-04-23 16:00:23,262 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=b852ba82e77fd456df29e785f560259c, UNASSIGN in 322 msec 2024-04-23 16:00:23,263 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713888023263"}]},"ts":"1713888023263"} 2024-04-23 16:00:23,265 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLED in hbase:meta 2024-04-23 16:00:23,267 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set TestQuotaAdmin0 to state=DISABLED 2024-04-23 16:00:23,270 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=27, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin0 in 345 msec 2024-04-23 16:00:23,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-04-23 16:00:23,686 INFO [Listener at localhost/33425] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin0, procId: 27 completed 2024-04-23 16:00:23,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin0 2024-04-23 16:00:23,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] procedure2.ProcedureExecutor(1075): Stored pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin0 2024-04-23 16:00:23,700 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-04-23 16:00:23,702 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=30, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-04-23 16:00:23,706 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-04-23 16:00:23,709 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/default/TestQuotaAdmin0/b852ba82e77fd456df29e785f560259c 2024-04-23 16:00:23,714 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/default/TestQuotaAdmin0/b852ba82e77fd456df29e785f560259c/cf, FileablePath, hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/default/TestQuotaAdmin0/b852ba82e77fd456df29e785f560259c/recovered.edits] 2024-04-23 16:00:23,724 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/default/TestQuotaAdmin0/b852ba82e77fd456df29e785f560259c/cf/2179dd58a9de475898608f69953582eb to hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/archive/data/default/TestQuotaAdmin0/b852ba82e77fd456df29e785f560259c/cf/2179dd58a9de475898608f69953582eb 2024-04-23 16:00:23,729 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/default/TestQuotaAdmin0/b852ba82e77fd456df29e785f560259c/recovered.edits/24.seqid to hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/archive/data/default/TestQuotaAdmin0/b852ba82e77fd456df29e785f560259c/recovered.edits/24.seqid 2024-04-23 16:00:23,731 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/default/TestQuotaAdmin0/b852ba82e77fd456df29e785f560259c 2024-04-23 16:00:23,731 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-04-23 16:00:23,734 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=30, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-04-23 16:00:23,755 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin0 from hbase:meta 2024-04-23 16:00:23,758 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin0' descriptor. 2024-04-23 16:00:23,760 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=30, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-04-23 16:00:23,760 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin0' from region states. 2024-04-23 16:00:23,760 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1713888023760"}]},"ts":"9223372036854775807"} 2024-04-23 16:00:23,762 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-04-23 16:00:23,762 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b852ba82e77fd456df29e785f560259c, NAME => 'TestQuotaAdmin0,,1713887960064.b852ba82e77fd456df29e785f560259c.', STARTKEY => '', ENDKEY => ''}] 2024-04-23 16:00:23,762 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin0' as deleted. 2024-04-23 16:00:23,762 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1713888023762"}]},"ts":"9223372036854775807"} 2024-04-23 16:00:23,764 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin0 state from META 2024-04-23 16:00:23,767 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=30, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-04-23 16:00:23,768 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=30, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin0 in 75 msec 2024-04-23 16:00:23,957 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-04-23 16:00:23,958 INFO [Listener at localhost/33425] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin0, procId: 30 completed 2024-04-23 16:00:23,958 INFO [Listener at localhost/33425] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin1 2024-04-23 16:00:23,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin1 2024-04-23 16:00:23,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] procedure2.ProcedureExecutor(1075): Stored pid=31, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin1 2024-04-23 16:00:23,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-04-23 16:00:23,964 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713888023964"}]},"ts":"1713888023964"} 2024-04-23 16:00:23,966 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLING in hbase:meta 2024-04-23 16:00:23,968 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set TestQuotaAdmin1 to state=DISABLING 2024-04-23 16:00:23,969 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=8c95a092b150eab1e1eb4c1a1a17602e, UNASSIGN}] 2024-04-23 16:00:23,971 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=8c95a092b150eab1e1eb4c1a1a17602e, UNASSIGN 2024-04-23 16:00:23,971 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=8c95a092b150eab1e1eb4c1a1a17602e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38643,1713887956870 2024-04-23 16:00:23,972 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1713887960868.8c95a092b150eab1e1eb4c1a1a17602e.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713888023971"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713888023971"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713888023971"}]},"ts":"1713888023971"} 2024-04-23 16:00:23,973 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=33, ppid=32, state=RUNNABLE; CloseRegionProcedure 8c95a092b150eab1e1eb4c1a1a17602e, server=jenkins-hbase4.apache.org,38643,1713887956870}] 2024-04-23 16:00:24,126 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,38643,1713887956870 2024-04-23 16:00:24,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8c95a092b150eab1e1eb4c1a1a17602e 2024-04-23 16:00:24,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8c95a092b150eab1e1eb4c1a1a17602e, disabling compactions & flushes 2024-04-23 16:00:24,128 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1713887960868.8c95a092b150eab1e1eb4c1a1a17602e. 2024-04-23 16:00:24,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1713887960868.8c95a092b150eab1e1eb4c1a1a17602e. 2024-04-23 16:00:24,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1713887960868.8c95a092b150eab1e1eb4c1a1a17602e. after waiting 0 ms 2024-04-23 16:00:24,128 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1713887960868.8c95a092b150eab1e1eb4c1a1a17602e. 2024-04-23 16:00:24,136 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/default/TestQuotaAdmin1/8c95a092b150eab1e1eb4c1a1a17602e/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-04-23 16:00:24,138 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1713887960868.8c95a092b150eab1e1eb4c1a1a17602e. 2024-04-23 16:00:24,138 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8c95a092b150eab1e1eb4c1a1a17602e: 2024-04-23 16:00:24,140 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8c95a092b150eab1e1eb4c1a1a17602e 2024-04-23 16:00:24,140 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=8c95a092b150eab1e1eb4c1a1a17602e, regionState=CLOSED 2024-04-23 16:00:24,141 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1713887960868.8c95a092b150eab1e1eb4c1a1a17602e.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713888024140"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713888024140"}]},"ts":"1713888024140"} 2024-04-23 16:00:24,145 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=33, resume processing ppid=32 2024-04-23 16:00:24,145 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=33, ppid=32, state=SUCCESS; CloseRegionProcedure 8c95a092b150eab1e1eb4c1a1a17602e, server=jenkins-hbase4.apache.org,38643,1713887956870 in 169 msec 2024-04-23 16:00:24,147 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=32, resume processing ppid=31 2024-04-23 16:00:24,147 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=32, ppid=31, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=8c95a092b150eab1e1eb4c1a1a17602e, UNASSIGN in 176 msec 2024-04-23 16:00:24,148 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713888024148"}]},"ts":"1713888024148"} 2024-04-23 16:00:24,150 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLED in hbase:meta 2024-04-23 16:00:24,152 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set TestQuotaAdmin1 to state=DISABLED 2024-04-23 16:00:24,154 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=31, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin1 in 194 msec 2024-04-23 16:00:24,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-04-23 16:00:24,215 INFO [Listener at localhost/33425] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin1, procId: 31 completed 2024-04-23 16:00:24,216 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin1 2024-04-23 16:00:24,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] procedure2.ProcedureExecutor(1075): Stored pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin1 2024-04-23 16:00:24,220 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-04-23 16:00:24,221 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=34, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-04-23 16:00:24,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-04-23 16:00:24,226 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/default/TestQuotaAdmin1/8c95a092b150eab1e1eb4c1a1a17602e 2024-04-23 16:00:24,228 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/default/TestQuotaAdmin1/8c95a092b150eab1e1eb4c1a1a17602e/cf, FileablePath, hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/default/TestQuotaAdmin1/8c95a092b150eab1e1eb4c1a1a17602e/recovered.edits] 2024-04-23 16:00:24,237 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/default/TestQuotaAdmin1/8c95a092b150eab1e1eb4c1a1a17602e/recovered.edits/4.seqid to hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/archive/data/default/TestQuotaAdmin1/8c95a092b150eab1e1eb4c1a1a17602e/recovered.edits/4.seqid 2024-04-23 16:00:24,238 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/default/TestQuotaAdmin1/8c95a092b150eab1e1eb4c1a1a17602e 2024-04-23 16:00:24,238 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-04-23 16:00:24,241 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=34, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-04-23 16:00:24,243 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin1 from hbase:meta 2024-04-23 16:00:24,245 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin1' descriptor. 2024-04-23 16:00:24,247 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=34, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-04-23 16:00:24,247 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin1' from region states. 2024-04-23 16:00:24,247 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1,,1713887960868.8c95a092b150eab1e1eb4c1a1a17602e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1713888024247"}]},"ts":"9223372036854775807"} 2024-04-23 16:00:24,249 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-04-23 16:00:24,249 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8c95a092b150eab1e1eb4c1a1a17602e, NAME => 'TestQuotaAdmin1,,1713887960868.8c95a092b150eab1e1eb4c1a1a17602e.', STARTKEY => '', ENDKEY => ''}] 2024-04-23 16:00:24,249 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin1' as deleted. 2024-04-23 16:00:24,249 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1713888024249"}]},"ts":"9223372036854775807"} 2024-04-23 16:00:24,251 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin1 state from META 2024-04-23 16:00:24,253 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=34, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-04-23 16:00:24,255 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=34, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin1 in 37 msec 2024-04-23 16:00:24,474 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-04-23 16:00:24,475 INFO [Listener at localhost/33425] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin1, procId: 34 completed 2024-04-23 16:00:24,475 INFO [Listener at localhost/33425] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin2 2024-04-23 16:00:24,476 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin2 2024-04-23 16:00:24,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] procedure2.ProcedureExecutor(1075): Stored pid=35, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin2 2024-04-23 16:00:24,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-04-23 16:00:24,481 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713888024480"}]},"ts":"1713888024480"} 2024-04-23 16:00:24,482 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLING in hbase:meta 2024-04-23 16:00:24,485 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set TestQuotaAdmin2 to state=DISABLING 2024-04-23 16:00:24,486 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=784d8adfc0d2d28fd746144871aed29b, UNASSIGN}] 2024-04-23 16:00:24,487 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=784d8adfc0d2d28fd746144871aed29b, UNASSIGN 2024-04-23 16:00:24,488 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=784d8adfc0d2d28fd746144871aed29b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35681,1713887956917 2024-04-23 16:00:24,488 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1713887961652.784d8adfc0d2d28fd746144871aed29b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713888024488"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713888024488"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713888024488"}]},"ts":"1713888024488"} 2024-04-23 16:00:24,489 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; CloseRegionProcedure 784d8adfc0d2d28fd746144871aed29b, server=jenkins-hbase4.apache.org,35681,1713887956917}] 2024-04-23 16:00:24,642 DEBUG [RSProcedureDispatcher-pool-5] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,35681,1713887956917 2024-04-23 16:00:24,642 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 784d8adfc0d2d28fd746144871aed29b 2024-04-23 16:00:24,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 784d8adfc0d2d28fd746144871aed29b, disabling compactions & flushes 2024-04-23 16:00:24,643 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1713887961652.784d8adfc0d2d28fd746144871aed29b. 2024-04-23 16:00:24,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1713887961652.784d8adfc0d2d28fd746144871aed29b. 2024-04-23 16:00:24,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1713887961652.784d8adfc0d2d28fd746144871aed29b. after waiting 0 ms 2024-04-23 16:00:24,643 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1713887961652.784d8adfc0d2d28fd746144871aed29b. 2024-04-23 16:00:24,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/default/TestQuotaAdmin2/784d8adfc0d2d28fd746144871aed29b/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-04-23 16:00:24,650 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1713887961652.784d8adfc0d2d28fd746144871aed29b. 2024-04-23 16:00:24,650 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 784d8adfc0d2d28fd746144871aed29b: 2024-04-23 16:00:24,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 784d8adfc0d2d28fd746144871aed29b 2024-04-23 16:00:24,652 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=784d8adfc0d2d28fd746144871aed29b, regionState=CLOSED 2024-04-23 16:00:24,652 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1713887961652.784d8adfc0d2d28fd746144871aed29b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713888024652"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713888024652"}]},"ts":"1713888024652"} 2024-04-23 16:00:24,656 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=37, resume processing ppid=36 2024-04-23 16:00:24,656 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=37, ppid=36, state=SUCCESS; CloseRegionProcedure 784d8adfc0d2d28fd746144871aed29b, server=jenkins-hbase4.apache.org,35681,1713887956917 in 165 msec 2024-04-23 16:00:24,658 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=36, resume processing ppid=35 2024-04-23 16:00:24,658 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=784d8adfc0d2d28fd746144871aed29b, UNASSIGN in 170 msec 2024-04-23 16:00:24,659 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713888024659"}]},"ts":"1713888024659"} 2024-04-23 16:00:24,661 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLED in hbase:meta 2024-04-23 16:00:24,663 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set TestQuotaAdmin2 to state=DISABLED 2024-04-23 16:00:24,665 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=35, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin2 in 188 msec 2024-04-23 16:00:24,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-04-23 16:00:24,731 INFO [Listener at localhost/33425] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin2, procId: 35 completed 2024-04-23 16:00:24,732 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin2 2024-04-23 16:00:24,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] procedure2.ProcedureExecutor(1075): Stored pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin2 2024-04-23 16:00:24,736 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-04-23 16:00:24,737 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=38, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-04-23 16:00:24,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-04-23 16:00:24,741 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/default/TestQuotaAdmin2/784d8adfc0d2d28fd746144871aed29b 2024-04-23 16:00:24,744 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/default/TestQuotaAdmin2/784d8adfc0d2d28fd746144871aed29b/cf, FileablePath, hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/default/TestQuotaAdmin2/784d8adfc0d2d28fd746144871aed29b/recovered.edits] 2024-04-23 16:00:24,753 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/default/TestQuotaAdmin2/784d8adfc0d2d28fd746144871aed29b/recovered.edits/4.seqid to hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/archive/data/default/TestQuotaAdmin2/784d8adfc0d2d28fd746144871aed29b/recovered.edits/4.seqid 2024-04-23 16:00:24,754 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/default/TestQuotaAdmin2/784d8adfc0d2d28fd746144871aed29b 2024-04-23 16:00:24,754 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-04-23 16:00:24,757 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=38, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-04-23 16:00:24,759 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin2 from hbase:meta 2024-04-23 16:00:24,761 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin2' descriptor. 2024-04-23 16:00:24,762 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=38, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-04-23 16:00:24,762 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin2' from region states. 2024-04-23 16:00:24,763 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2,,1713887961652.784d8adfc0d2d28fd746144871aed29b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1713888024763"}]},"ts":"9223372036854775807"} 2024-04-23 16:00:24,764 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-04-23 16:00:24,764 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 784d8adfc0d2d28fd746144871aed29b, NAME => 'TestQuotaAdmin2,,1713887961652.784d8adfc0d2d28fd746144871aed29b.', STARTKEY => '', ENDKEY => ''}] 2024-04-23 16:00:24,764 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin2' as deleted. 2024-04-23 16:00:24,765 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1713888024765"}]},"ts":"9223372036854775807"} 2024-04-23 16:00:24,766 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin2 state from META 2024-04-23 16:00:24,769 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=38, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-04-23 16:00:24,770 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=38, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin2 in 37 msec 2024-04-23 16:00:24,990 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-04-23 16:00:24,990 INFO [Listener at localhost/33425] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin2, procId: 38 completed 2024-04-23 16:00:24,991 INFO [Listener at localhost/33425] client.HBaseAdmin$15(890): Started disable of TestNs:TestTable 2024-04-23 16:00:24,991 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestNs:TestTable 2024-04-23 16:00:24,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] procedure2.ProcedureExecutor(1075): Stored pid=39, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestNs:TestTable 2024-04-23 16:00:24,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-04-23 16:00:24,996 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713888024996"}]},"ts":"1713888024996"} 2024-04-23 16:00:24,998 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLING in hbase:meta 2024-04-23 16:00:25,000 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set TestNs:TestTable to state=DISABLING 2024-04-23 16:00:25,001 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=baedff6b55b1f9a725328c4d9dc65555, UNASSIGN}, {pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=b543438e711b19ba14547290046bf01c, UNASSIGN}] 2024-04-23 16:00:25,003 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=baedff6b55b1f9a725328c4d9dc65555, UNASSIGN 2024-04-23 16:00:25,003 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=b543438e711b19ba14547290046bf01c, UNASSIGN 2024-04-23 16:00:25,004 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=baedff6b55b1f9a725328c4d9dc65555, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,35681,1713887956917 2024-04-23 16:00:25,004 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1713887962697.baedff6b55b1f9a725328c4d9dc65555.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713888025004"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713888025004"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713888025004"}]},"ts":"1713888025004"} 2024-04-23 16:00:25,004 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=b543438e711b19ba14547290046bf01c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38643,1713887956870 2024-04-23 16:00:25,004 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1713887962697.b543438e711b19ba14547290046bf01c.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713888025004"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713888025004"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713888025004"}]},"ts":"1713888025004"} 2024-04-23 16:00:25,006 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=42, ppid=40, state=RUNNABLE; CloseRegionProcedure baedff6b55b1f9a725328c4d9dc65555, server=jenkins-hbase4.apache.org,35681,1713887956917}] 2024-04-23 16:00:25,007 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=43, ppid=41, state=RUNNABLE; CloseRegionProcedure b543438e711b19ba14547290046bf01c, server=jenkins-hbase4.apache.org,38643,1713887956870}] 2024-04-23 16:00:25,158 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,35681,1713887956917 2024-04-23 16:00:25,159 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close baedff6b55b1f9a725328c4d9dc65555 2024-04-23 16:00:25,159 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing baedff6b55b1f9a725328c4d9dc65555, disabling compactions & flushes 2024-04-23 16:00:25,160 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1713887962697.baedff6b55b1f9a725328c4d9dc65555. 2024-04-23 16:00:25,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1713887962697.baedff6b55b1f9a725328c4d9dc65555. 2024-04-23 16:00:25,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1713887962697.baedff6b55b1f9a725328c4d9dc65555. after waiting 0 ms 2024-04-23 16:00:25,160 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1713887962697.baedff6b55b1f9a725328c4d9dc65555. 2024-04-23 16:00:25,160 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,38643,1713887956870 2024-04-23 16:00:25,161 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b543438e711b19ba14547290046bf01c 2024-04-23 16:00:25,161 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b543438e711b19ba14547290046bf01c, disabling compactions & flushes 2024-04-23 16:00:25,162 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1713887962697.b543438e711b19ba14547290046bf01c. 2024-04-23 16:00:25,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1713887962697.b543438e711b19ba14547290046bf01c. 2024-04-23 16:00:25,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1713887962697.b543438e711b19ba14547290046bf01c. after waiting 0 ms 2024-04-23 16:00:25,162 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1713887962697.b543438e711b19ba14547290046bf01c. 2024-04-23 16:00:25,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/TestNs/TestTable/baedff6b55b1f9a725328c4d9dc65555/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-04-23 16:00:25,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/TestNs/TestTable/b543438e711b19ba14547290046bf01c/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-04-23 16:00:25,169 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1713887962697.baedff6b55b1f9a725328c4d9dc65555. 2024-04-23 16:00:25,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for baedff6b55b1f9a725328c4d9dc65555: 2024-04-23 16:00:25,170 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1713887962697.b543438e711b19ba14547290046bf01c. 2024-04-23 16:00:25,170 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b543438e711b19ba14547290046bf01c: 2024-04-23 16:00:25,171 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed baedff6b55b1f9a725328c4d9dc65555 2024-04-23 16:00:25,172 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=baedff6b55b1f9a725328c4d9dc65555, regionState=CLOSED 2024-04-23 16:00:25,172 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,,1713887962697.baedff6b55b1f9a725328c4d9dc65555.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713888025172"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713888025172"}]},"ts":"1713888025172"} 2024-04-23 16:00:25,172 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b543438e711b19ba14547290046bf01c 2024-04-23 16:00:25,173 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=b543438e711b19ba14547290046bf01c, regionState=CLOSED 2024-04-23 16:00:25,173 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1713887962697.b543438e711b19ba14547290046bf01c.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713888025173"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713888025173"}]},"ts":"1713888025173"} 2024-04-23 16:00:25,176 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=42, resume processing ppid=40 2024-04-23 16:00:25,176 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=42, ppid=40, state=SUCCESS; CloseRegionProcedure baedff6b55b1f9a725328c4d9dc65555, server=jenkins-hbase4.apache.org,35681,1713887956917 in 168 msec 2024-04-23 16:00:25,177 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=43, resume processing ppid=41 2024-04-23 16:00:25,177 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=43, ppid=41, state=SUCCESS; CloseRegionProcedure b543438e711b19ba14547290046bf01c, server=jenkins-hbase4.apache.org,38643,1713887956870 in 168 msec 2024-04-23 16:00:25,178 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=baedff6b55b1f9a725328c4d9dc65555, UNASSIGN in 175 msec 2024-04-23 16:00:25,179 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=41, resume processing ppid=39 2024-04-23 16:00:25,179 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=41, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=b543438e711b19ba14547290046bf01c, UNASSIGN in 176 msec 2024-04-23 16:00:25,180 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713888025180"}]},"ts":"1713888025180"} 2024-04-23 16:00:25,181 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLED in hbase:meta 2024-04-23 16:00:25,184 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set TestNs:TestTable to state=DISABLED 2024-04-23 16:00:25,186 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=39, state=SUCCESS; DisableTableProcedure table=TestNs:TestTable in 194 msec 2024-04-23 16:00:25,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-04-23 16:00:25,247 INFO [Listener at localhost/33425] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: TestNs:TestTable, procId: 39 completed 2024-04-23 16:00:25,248 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestNs:TestTable 2024-04-23 16:00:25,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] procedure2.ProcedureExecutor(1075): Stored pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestNs:TestTable 2024-04-23 16:00:25,251 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-04-23 16:00:25,252 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=44, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-04-23 16:00:25,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-04-23 16:00:25,258 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/TestNs/TestTable/baedff6b55b1f9a725328c4d9dc65555 2024-04-23 16:00:25,258 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/TestNs/TestTable/b543438e711b19ba14547290046bf01c 2024-04-23 16:00:25,261 DEBUG [HFileArchiver-11] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/TestNs/TestTable/baedff6b55b1f9a725328c4d9dc65555/cf, FileablePath, hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/TestNs/TestTable/baedff6b55b1f9a725328c4d9dc65555/recovered.edits] 2024-04-23 16:00:25,261 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/TestNs/TestTable/b543438e711b19ba14547290046bf01c/cf, FileablePath, hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/TestNs/TestTable/b543438e711b19ba14547290046bf01c/recovered.edits] 2024-04-23 16:00:25,270 DEBUG [HFileArchiver-11] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/TestNs/TestTable/baedff6b55b1f9a725328c4d9dc65555/recovered.edits/4.seqid to hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/archive/data/TestNs/TestTable/baedff6b55b1f9a725328c4d9dc65555/recovered.edits/4.seqid 2024-04-23 16:00:25,270 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/TestNs/TestTable/b543438e711b19ba14547290046bf01c/recovered.edits/4.seqid to hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/archive/data/TestNs/TestTable/b543438e711b19ba14547290046bf01c/recovered.edits/4.seqid 2024-04-23 16:00:25,271 DEBUG [HFileArchiver-11] backup.HFileArchiver(596): Deleted hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/TestNs/TestTable/baedff6b55b1f9a725328c4d9dc65555 2024-04-23 16:00:25,271 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/.tmp/data/TestNs/TestTable/b543438e711b19ba14547290046bf01c 2024-04-23 16:00:25,271 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-04-23 16:00:25,275 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=44, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-04-23 16:00:25,276 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of TestNs:TestTable from hbase:meta 2024-04-23 16:00:25,278 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'TestNs:TestTable' descriptor. 2024-04-23 16:00:25,280 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=44, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-04-23 16:00:25,280 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'TestNs:TestTable' from region states. 2024-04-23 16:00:25,280 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,,1713887962697.baedff6b55b1f9a725328c4d9dc65555.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1713888025280"}]},"ts":"9223372036854775807"} 2024-04-23 16:00:25,280 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,1,1713887962697.b543438e711b19ba14547290046bf01c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1713888025280"}]},"ts":"9223372036854775807"} 2024-04-23 16:00:25,282 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2024-04-23 16:00:25,282 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => baedff6b55b1f9a725328c4d9dc65555, NAME => 'TestNs:TestTable,,1713887962697.baedff6b55b1f9a725328c4d9dc65555.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => b543438e711b19ba14547290046bf01c, NAME => 'TestNs:TestTable,1,1713887962697.b543438e711b19ba14547290046bf01c.', STARTKEY => '1', ENDKEY => ''}] 2024-04-23 16:00:25,282 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'TestNs:TestTable' as deleted. 2024-04-23 16:00:25,282 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1713888025282"}]},"ts":"9223372036854775807"} 2024-04-23 16:00:25,283 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table TestNs:TestTable state from META 2024-04-23 16:00:25,287 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=44, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-04-23 16:00:25,288 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=44, state=SUCCESS; DeleteTableProcedure table=TestNs:TestTable in 39 msec 2024-04-23 16:00:25,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-04-23 16:00:25,506 INFO [Listener at localhost/33425] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: TestNs:TestTable, procId: 44 completed 2024-04-23 16:00:25,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.HMaster$17(3092): Client=jenkins//172.31.14.131 delete TestNs 2024-04-23 16:00:25,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] procedure2.ProcedureExecutor(1075): Stored pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE; DeleteNamespaceProcedure, namespace=TestNs 2024-04-23 16:00:25,520 INFO [PEWorker-1] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-04-23 16:00:25,526 INFO [PEWorker-1] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_FROM_NS_TABLE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-04-23 16:00:25,526 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-04-23 16:00:25,531 INFO [PEWorker-1] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_FROM_ZK, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-04-23 16:00:25,533 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace/TestNs 2024-04-23 16:00:25,533 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-04-23 16:00:25,536 INFO [PEWorker-1] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_DIRECTORIES, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-04-23 16:00:25,546 INFO [PEWorker-1] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_NAMESPACE_QUOTA, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-04-23 16:00:25,548 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=45, state=SUCCESS; DeleteNamespaceProcedure, namespace=TestNs in 35 msec 2024-04-23 16:00:25,778 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34409] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-04-23 16:00:25,778 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2024-04-23 16:00:25,778 INFO [Listener at localhost/33425] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-04-23 16:00:25,779 DEBUG [Listener at localhost/33425] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x64db2a34 to 127.0.0.1:51085 2024-04-23 16:00:25,779 DEBUG [Listener at localhost/33425] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-23 16:00:25,779 DEBUG [Listener at localhost/33425] util.JVMClusterUtil(237): Shutting down HBase Cluster 2024-04-23 16:00:25,779 DEBUG [Listener at localhost/33425] util.JVMClusterUtil(257): Found active master hash=1077571258, stopped=false 2024-04-23 16:00:25,780 DEBUG [Listener at localhost/33425] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-04-23 16:00:25,780 INFO [Listener at localhost/33425] master.ServerManager(904): Cluster shutdown requested of master=jenkins-hbase4.apache.org,34409,1713887955657 2024-04-23 16:00:25,783 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:38643-0x101310f8ecf0001, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-04-23 16:00:25,783 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-04-23 16:00:25,783 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:35681-0x101310f8ecf0002, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-04-23 16:00:25,783 INFO [Listener at localhost/33425] procedure2.ProcedureExecutor(675): Stopping 2024-04-23 16:00:25,783 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-23 16:00:25,784 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:38643-0x101310f8ecf0001, quorum=127.0.0.1:51085, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-04-23 16:00:25,784 DEBUG [Listener at localhost/33425] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7b8dd4c9 to 127.0.0.1:51085 2024-04-23 16:00:25,784 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:35681-0x101310f8ecf0002, quorum=127.0.0.1:51085, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-04-23 16:00:25,784 DEBUG [Listener at localhost/33425] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-23 16:00:25,784 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-04-23 16:00:25,784 INFO [Listener at localhost/33425] regionserver.HRegionServer(2306): ***** STOPPING region server 'jenkins-hbase4.apache.org,38643,1713887956870' ***** 2024-04-23 16:00:25,784 INFO [Listener at localhost/33425] regionserver.HRegionServer(2320): STOPPED: Shutdown requested 2024-04-23 16:00:25,784 INFO [Listener at localhost/33425] regionserver.HRegionServer(2306): ***** STOPPING region server 'jenkins-hbase4.apache.org,35681,1713887956917' ***** 2024-04-23 16:00:25,784 INFO [Listener at localhost/33425] regionserver.HRegionServer(2320): STOPPED: Shutdown requested 2024-04-23 16:00:25,785 INFO [RS:0;jenkins-hbase4:38643] regionserver.HeapMemoryManager(220): Stopping 2024-04-23 16:00:25,785 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-04-23 16:00:25,785 INFO [RS:0;jenkins-hbase4:38643] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-04-23 16:00:25,785 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-04-23 16:00:25,785 INFO [RS:1;jenkins-hbase4:35681] regionserver.HeapMemoryManager(220): Stopping 2024-04-23 16:00:25,785 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-04-23 16:00:25,785 INFO [RS:1;jenkins-hbase4:35681] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-04-23 16:00:25,785 INFO [RS:0;jenkins-hbase4:38643] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-04-23 16:00:25,785 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-04-23 16:00:25,785 INFO [RS:1;jenkins-hbase4:35681] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-04-23 16:00:25,786 INFO [RS:0;jenkins-hbase4:38643] regionserver.HRegionServer(3314): Received CLOSE for 7156285833ed7202d03c0cd137ce6936 2024-04-23 16:00:25,786 INFO [RS:1;jenkins-hbase4:35681] regionserver.HRegionServer(3314): Received CLOSE for 11917ae24ca59bc5e35ea04f43ba1f5a 2024-04-23 16:00:25,786 INFO [RS:0;jenkins-hbase4:38643] regionserver.HRegionServer(1150): stopping server jenkins-hbase4.apache.org,38643,1713887956870 2024-04-23 16:00:25,786 INFO [RS:1;jenkins-hbase4:35681] regionserver.HRegionServer(1150): stopping server jenkins-hbase4.apache.org,35681,1713887956917 2024-04-23 16:00:25,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 11917ae24ca59bc5e35ea04f43ba1f5a, disabling compactions & flushes 2024-04-23 16:00:25,786 INFO [RS:0;jenkins-hbase4:38643] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-04-23 16:00:25,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:quota,,1713887959506.11917ae24ca59bc5e35ea04f43ba1f5a. 2024-04-23 16:00:25,787 DEBUG [RS:0;jenkins-hbase4:38643] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1fca8a35 to 127.0.0.1:51085 2024-04-23 16:00:25,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7156285833ed7202d03c0cd137ce6936, disabling compactions & flushes 2024-04-23 16:00:25,787 INFO [RS:1;jenkins-hbase4:35681] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-04-23 16:00:25,787 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1713887958786.7156285833ed7202d03c0cd137ce6936. 2024-04-23 16:00:25,787 DEBUG [RS:1;jenkins-hbase4:35681] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x638f4a75 to 127.0.0.1:51085 2024-04-23 16:00:25,787 DEBUG [RS:0;jenkins-hbase4:38643] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-23 16:00:25,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1713887959506.11917ae24ca59bc5e35ea04f43ba1f5a. 2024-04-23 16:00:25,787 DEBUG [RS:1;jenkins-hbase4:35681] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-23 16:00:25,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1713887958786.7156285833ed7202d03c0cd137ce6936. 2024-04-23 16:00:25,788 INFO [RS:1;jenkins-hbase4:35681] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-04-23 16:00:25,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1713887958786.7156285833ed7202d03c0cd137ce6936. after waiting 0 ms 2024-04-23 16:00:25,787 INFO [RS:0;jenkins-hbase4:38643] regionserver.HRegionServer(1480): Waiting on 1 regions to close 2024-04-23 16:00:25,787 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1713887959506.11917ae24ca59bc5e35ea04f43ba1f5a. after waiting 0 ms 2024-04-23 16:00:25,788 DEBUG [RS:0;jenkins-hbase4:38643] regionserver.HRegionServer(1484): Online Regions={7156285833ed7202d03c0cd137ce6936=hbase:namespace,,1713887958786.7156285833ed7202d03c0cd137ce6936.} 2024-04-23 16:00:25,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1713887958786.7156285833ed7202d03c0cd137ce6936. 2024-04-23 16:00:25,788 INFO [RS:1;jenkins-hbase4:35681] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-04-23 16:00:25,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 7156285833ed7202d03c0cd137ce6936 1/1 column families, dataSize=147 B heapSize=704 B 2024-04-23 16:00:25,788 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1713887959506.11917ae24ca59bc5e35ea04f43ba1f5a. 2024-04-23 16:00:25,789 INFO [RS:1;jenkins-hbase4:35681] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-04-23 16:00:25,789 INFO [RS:1;jenkins-hbase4:35681] regionserver.HRegionServer(3314): Received CLOSE for 1588230740 2024-04-23 16:00:25,789 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 11917ae24ca59bc5e35ea04f43ba1f5a 2/2 column families, dataSize=726 B heapSize=2.44 KB 2024-04-23 16:00:25,789 INFO [RS:1;jenkins-hbase4:35681] regionserver.HRegionServer(1480): Waiting on 2 regions to close 2024-04-23 16:00:25,789 DEBUG [RS:1;jenkins-hbase4:35681] regionserver.HRegionServer(1484): Online Regions={1588230740=hbase:meta,,1.1588230740, 11917ae24ca59bc5e35ea04f43ba1f5a=hbase:quota,,1713887959506.11917ae24ca59bc5e35ea04f43ba1f5a.} 2024-04-23 16:00:25,790 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-04-23 16:00:25,790 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-04-23 16:00:25,790 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-04-23 16:00:25,790 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-04-23 16:00:25,790 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-04-23 16:00:25,790 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=14.15 KB heapSize=25.10 KB 2024-04-23 16:00:25,791 DEBUG [RS:0;jenkins-hbase4:38643] regionserver.HRegionServer(1510): Waiting on 7156285833ed7202d03c0cd137ce6936 2024-04-23 16:00:25,791 DEBUG [RS:1;jenkins-hbase4:35681] regionserver.HRegionServer(1510): Waiting on 11917ae24ca59bc5e35ea04f43ba1f5a, 1588230740 2024-04-23 16:00:25,825 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=12.16 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/meta/1588230740/.tmp/info/a950ac66e5094236ae7d1ff54ecd5247 2024-04-23 16:00:25,826 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-04-23 16:00:25,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=147 B at sequenceid=8 (bloomFilter=true), to=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/namespace/7156285833ed7202d03c0cd137ce6936/.tmp/info/d81a3f1bdff34b4cbd6d4d3c2ebed080 2024-04-23 16:00:25,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=597 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/quota/11917ae24ca59bc5e35ea04f43ba1f5a/.tmp/q/6976ed2135a1413b92beb9dda0de33f7 2024-04-23 16:00:25,849 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a950ac66e5094236ae7d1ff54ecd5247 2024-04-23 16:00:25,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d81a3f1bdff34b4cbd6d4d3c2ebed080 2024-04-23 16:00:25,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6976ed2135a1413b92beb9dda0de33f7 2024-04-23 16:00:25,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/namespace/7156285833ed7202d03c0cd137ce6936/.tmp/info/d81a3f1bdff34b4cbd6d4d3c2ebed080 as hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/namespace/7156285833ed7202d03c0cd137ce6936/info/d81a3f1bdff34b4cbd6d4d3c2ebed080 2024-04-23 16:00:25,866 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=478 B at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/meta/1588230740/.tmp/rep_barrier/fb6c66b6ab1c4128912ebfbebb4d0f02 2024-04-23 16:00:25,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d81a3f1bdff34b4cbd6d4d3c2ebed080 2024-04-23 16:00:25,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/namespace/7156285833ed7202d03c0cd137ce6936/info/d81a3f1bdff34b4cbd6d4d3c2ebed080, entries=3, sequenceid=8, filesize=5.0 K 2024-04-23 16:00:25,872 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~147 B/147, heapSize ~688 B/688, currentSize=0 B/0 for 7156285833ed7202d03c0cd137ce6936 in 83ms, sequenceid=8, compaction requested=false 2024-04-23 16:00:25,877 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=129 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/quota/11917ae24ca59bc5e35ea04f43ba1f5a/.tmp/u/abdd7ae0613c4f83ae5004bfc770aab5 2024-04-23 16:00:25,878 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fb6c66b6ab1c4128912ebfbebb4d0f02 2024-04-23 16:00:25,881 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/namespace/7156285833ed7202d03c0cd137ce6936/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=1 2024-04-23 16:00:25,886 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1713887958786.7156285833ed7202d03c0cd137ce6936. 2024-04-23 16:00:25,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7156285833ed7202d03c0cd137ce6936: 2024-04-23 16:00:25,886 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1713887958786.7156285833ed7202d03c0cd137ce6936. 2024-04-23 16:00:25,889 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for abdd7ae0613c4f83ae5004bfc770aab5 2024-04-23 16:00:25,891 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/quota/11917ae24ca59bc5e35ea04f43ba1f5a/.tmp/q/6976ed2135a1413b92beb9dda0de33f7 as hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/quota/11917ae24ca59bc5e35ea04f43ba1f5a/q/6976ed2135a1413b92beb9dda0de33f7 2024-04-23 16:00:25,903 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.53 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/meta/1588230740/.tmp/table/3beb08752a934007bb17711a21274e8b 2024-04-23 16:00:25,907 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6976ed2135a1413b92beb9dda0de33f7 2024-04-23 16:00:25,908 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/quota/11917ae24ca59bc5e35ea04f43ba1f5a/q/6976ed2135a1413b92beb9dda0de33f7, entries=5, sequenceid=17, filesize=5.1 K 2024-04-23 16:00:25,909 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/quota/11917ae24ca59bc5e35ea04f43ba1f5a/.tmp/u/abdd7ae0613c4f83ae5004bfc770aab5 as hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/quota/11917ae24ca59bc5e35ea04f43ba1f5a/u/abdd7ae0613c4f83ae5004bfc770aab5 2024-04-23 16:00:25,911 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3beb08752a934007bb17711a21274e8b 2024-04-23 16:00:25,912 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/meta/1588230740/.tmp/info/a950ac66e5094236ae7d1ff54ecd5247 as hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/meta/1588230740/info/a950ac66e5094236ae7d1ff54ecd5247 2024-04-23 16:00:25,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for abdd7ae0613c4f83ae5004bfc770aab5 2024-04-23 16:00:25,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/quota/11917ae24ca59bc5e35ea04f43ba1f5a/u/abdd7ae0613c4f83ae5004bfc770aab5, entries=4, sequenceid=17, filesize=5.0 K 2024-04-23 16:00:25,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~726 B/726, heapSize ~2.41 KB/2464, currentSize=0 B/0 for 11917ae24ca59bc5e35ea04f43ba1f5a in 130ms, sequenceid=17, compaction requested=false 2024-04-23 16:00:25,925 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a950ac66e5094236ae7d1ff54ecd5247 2024-04-23 16:00:25,925 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/meta/1588230740/info/a950ac66e5094236ae7d1ff54ecd5247, entries=30, sequenceid=66, filesize=8.0 K 2024-04-23 16:00:25,927 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/meta/1588230740/.tmp/rep_barrier/fb6c66b6ab1c4128912ebfbebb4d0f02 as hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/meta/1588230740/rep_barrier/fb6c66b6ab1c4128912ebfbebb4d0f02 2024-04-23 16:00:25,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/quota/11917ae24ca59bc5e35ea04f43ba1f5a/recovered.edits/20.seqid, newMaxSeqId=20, maxSeqId=1 2024-04-23 16:00:25,929 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:quota,,1713887959506.11917ae24ca59bc5e35ea04f43ba1f5a. 2024-04-23 16:00:25,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 11917ae24ca59bc5e35ea04f43ba1f5a: 2024-04-23 16:00:25,929 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:quota,,1713887959506.11917ae24ca59bc5e35ea04f43ba1f5a. 2024-04-23 16:00:25,936 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for fb6c66b6ab1c4128912ebfbebb4d0f02 2024-04-23 16:00:25,937 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/meta/1588230740/rep_barrier/fb6c66b6ab1c4128912ebfbebb4d0f02, entries=5, sequenceid=66, filesize=5.3 K 2024-04-23 16:00:25,938 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/meta/1588230740/.tmp/table/3beb08752a934007bb17711a21274e8b as hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/meta/1588230740/table/3beb08752a934007bb17711a21274e8b 2024-04-23 16:00:25,946 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3beb08752a934007bb17711a21274e8b 2024-04-23 16:00:25,946 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/meta/1588230740/table/3beb08752a934007bb17711a21274e8b, entries=13, sequenceid=66, filesize=5.6 K 2024-04-23 16:00:25,947 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~14.15 KB/14494, heapSize ~25.05 KB/25656, currentSize=0 B/0 for 1588230740 in 157ms, sequenceid=66, compaction requested=false 2024-04-23 16:00:25,955 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/data/hbase/meta/1588230740/recovered.edits/69.seqid, newMaxSeqId=69, maxSeqId=1 2024-04-23 16:00:25,956 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-04-23 16:00:25,956 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-04-23 16:00:25,956 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-04-23 16:00:25,957 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2024-04-23 16:00:25,991 INFO [RS:0;jenkins-hbase4:38643] regionserver.HRegionServer(1176): stopping server jenkins-hbase4.apache.org,38643,1713887956870; all regions closed. 2024-04-23 16:00:25,991 INFO [RS:1;jenkins-hbase4:35681] regionserver.HRegionServer(1176): stopping server jenkins-hbase4.apache.org,35681,1713887956917; all regions closed. 2024-04-23 16:00:25,991 DEBUG [RS:1;jenkins-hbase4:35681] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-04-23 16:00:25,991 DEBUG [RS:0;jenkins-hbase4:38643] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-04-23 16:00:26,005 DEBUG [RS:0;jenkins-hbase4:38643] wal.AbstractFSWAL(1030): Moved 1 WAL file(s) to /user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/oldWALs 2024-04-23 16:00:26,005 INFO [RS:0;jenkins-hbase4:38643] wal.AbstractFSWAL(1033): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38643%2C1713887956870:(num 1713887958377) 2024-04-23 16:00:26,005 DEBUG [RS:1;jenkins-hbase4:35681] wal.AbstractFSWAL(1030): Moved 1 WAL file(s) to /user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/oldWALs 2024-04-23 16:00:26,005 DEBUG [RS:0;jenkins-hbase4:38643] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-23 16:00:26,005 INFO [RS:1;jenkins-hbase4:35681] wal.AbstractFSWAL(1033): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35681%2C1713887956917.meta:.meta(num 1713887958526) 2024-04-23 16:00:26,005 INFO [RS:0;jenkins-hbase4:38643] regionserver.LeaseManager(133): Closed leases 2024-04-23 16:00:26,006 INFO [RS:0;jenkins-hbase4:38643] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2024-04-23 16:00:26,006 INFO [RS:0;jenkins-hbase4:38643] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-04-23 16:00:26,006 INFO [RS:0;jenkins-hbase4:38643] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-04-23 16:00:26,006 INFO [RS:0;jenkins-hbase4:38643] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-04-23 16:00:26,006 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-04-23 16:00:26,007 INFO [RS:0;jenkins-hbase4:38643] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38643 2024-04-23 16:00:26,014 DEBUG [RS:1;jenkins-hbase4:35681] wal.AbstractFSWAL(1030): Moved 1 WAL file(s) to /user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/oldWALs 2024-04-23 16:00:26,014 INFO [RS:1;jenkins-hbase4:35681] wal.AbstractFSWAL(1033): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C35681%2C1713887956917:(num 1713887958377) 2024-04-23 16:00:26,015 DEBUG [RS:1;jenkins-hbase4:35681] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-23 16:00:26,015 INFO [RS:1;jenkins-hbase4:35681] regionserver.LeaseManager(133): Closed leases 2024-04-23 16:00:26,015 INFO [RS:1;jenkins-hbase4:35681] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2024-04-23 16:00:26,016 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-04-23 16:00:26,016 INFO [RS:1;jenkins-hbase4:35681] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35681 2024-04-23 16:00:26,017 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:35681-0x101310f8ecf0002, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38643,1713887956870 2024-04-23 16:00:26,017 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-04-23 16:00:26,017 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:35681-0x101310f8ecf0002, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-04-23 16:00:26,017 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:38643-0x101310f8ecf0001, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38643,1713887956870 2024-04-23 16:00:26,018 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:38643-0x101310f8ecf0001, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-04-23 16:00:26,019 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:35681-0x101310f8ecf0002, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35681,1713887956917 2024-04-23 16:00:26,019 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:38643-0x101310f8ecf0001, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,35681,1713887956917 2024-04-23 16:00:26,019 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38643,1713887956870] 2024-04-23 16:00:26,019 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38643,1713887956870; numProcessing=1 2024-04-23 16:00:26,021 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38643,1713887956870 already deleted, retry=false 2024-04-23 16:00:26,022 INFO [RegionServerTracker-0] master.ServerManager(570): Cluster shutdown set; jenkins-hbase4.apache.org,38643,1713887956870 expired; onlineServers=1 2024-04-23 16:00:26,022 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,35681,1713887956917] 2024-04-23 16:00:26,022 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,35681,1713887956917; numProcessing=2 2024-04-23 16:00:26,023 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,35681,1713887956917 already deleted, retry=false 2024-04-23 16:00:26,023 INFO [RegionServerTracker-0] master.ServerManager(570): Cluster shutdown set; jenkins-hbase4.apache.org,35681,1713887956917 expired; onlineServers=0 2024-04-23 16:00:26,023 INFO [RegionServerTracker-0] regionserver.HRegionServer(2306): ***** STOPPING region server 'jenkins-hbase4.apache.org,34409,1713887955657' ***** 2024-04-23 16:00:26,023 INFO [RegionServerTracker-0] regionserver.HRegionServer(2320): STOPPED: Cluster shutdown set; onlineServer=0 2024-04-23 16:00:26,024 DEBUG [M:0;jenkins-hbase4:34409] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1076481, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-04-23 16:00:26,024 INFO [M:0;jenkins-hbase4:34409] regionserver.HRegionServer(1150): stopping server jenkins-hbase4.apache.org,34409,1713887955657 2024-04-23 16:00:26,024 INFO [M:0;jenkins-hbase4:34409] regionserver.HRegionServer(1176): stopping server jenkins-hbase4.apache.org,34409,1713887955657; all regions closed. 2024-04-23 16:00:26,024 DEBUG [M:0;jenkins-hbase4:34409] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-23 16:00:26,024 DEBUG [M:0;jenkins-hbase4:34409] cleaner.LogCleaner(198): Cancelling LogCleaner 2024-04-23 16:00:26,024 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2024-04-23 16:00:26,024 DEBUG [M:0;jenkins-hbase4:34409] cleaner.HFileCleaner(317): Stopping file delete threads 2024-04-23 16:00:26,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1713887958017] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1713887958017,5,FailOnTimeoutGroup] 2024-04-23 16:00:26,024 INFO [M:0;jenkins-hbase4:34409] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2024-04-23 16:00:26,024 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1713887958017] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1713887958017,5,FailOnTimeoutGroup] 2024-04-23 16:00:26,024 INFO [M:0;jenkins-hbase4:34409] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2024-04-23 16:00:26,025 INFO [M:0;jenkins-hbase4:34409] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS] on shutdown 2024-04-23 16:00:26,025 DEBUG [M:0;jenkins-hbase4:34409] master.HMaster(1517): Stopping service threads 2024-04-23 16:00:26,025 INFO [M:0;jenkins-hbase4:34409] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2024-04-23 16:00:26,025 ERROR [M:0;jenkins-hbase4:34409] procedure2.ProcedureExecutor(699): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-8,5,PEWorkerGroup] Thread[HFileArchiver-9,5,PEWorkerGroup] Thread[HFileArchiver-10,5,PEWorkerGroup] Thread[HFileArchiver-11,5,PEWorkerGroup] Thread[HFileArchiver-12,5,PEWorkerGroup] 2024-04-23 16:00:26,026 INFO [M:0;jenkins-hbase4:34409] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2024-04-23 16:00:26,026 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2024-04-23 16:00:26,026 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2024-04-23 16:00:26,026 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-23 16:00:26,027 DEBUG [M:0;jenkins-hbase4:34409] zookeeper.ZKUtil(399): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2024-04-23 16:00:26,027 WARN [M:0;jenkins-hbase4:34409] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2024-04-23 16:00:26,027 INFO [M:0;jenkins-hbase4:34409] assignment.AssignmentManager(315): Stopping assignment manager 2024-04-23 16:00:26,027 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-04-23 16:00:26,027 INFO [M:0;jenkins-hbase4:34409] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2024-04-23 16:00:26,028 DEBUG [M:0;jenkins-hbase4:34409] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-04-23 16:00:26,028 INFO [M:0;jenkins-hbase4:34409] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-23 16:00:26,028 DEBUG [M:0;jenkins-hbase4:34409] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-23 16:00:26,028 DEBUG [M:0;jenkins-hbase4:34409] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-04-23 16:00:26,028 DEBUG [M:0;jenkins-hbase4:34409] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-23 16:00:26,028 INFO [M:0;jenkins-hbase4:34409] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=153.08 KB heapSize=184.84 KB 2024-04-23 16:00:26,044 INFO [M:0;jenkins-hbase4:34409] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=153.08 KB at sequenceid=376 (bloomFilter=true), to=hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/69a353a6d4314cdc98d4a13f364bf26d 2024-04-23 16:00:26,051 INFO [M:0;jenkins-hbase4:34409] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69a353a6d4314cdc98d4a13f364bf26d 2024-04-23 16:00:26,053 DEBUG [M:0;jenkins-hbase4:34409] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/69a353a6d4314cdc98d4a13f364bf26d as hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/69a353a6d4314cdc98d4a13f364bf26d 2024-04-23 16:00:26,060 INFO [M:0;jenkins-hbase4:34409] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 69a353a6d4314cdc98d4a13f364bf26d 2024-04-23 16:00:26,060 INFO [M:0;jenkins-hbase4:34409] regionserver.HStore(1080): Added hdfs://localhost:46537/user/jenkins/test-data/99c3ba84-b6a1-fe0d-1ff0-a6dac2a7a4e6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/69a353a6d4314cdc98d4a13f364bf26d, entries=45, sequenceid=376, filesize=12.0 K 2024-04-23 16:00:26,061 INFO [M:0;jenkins-hbase4:34409] regionserver.HRegion(2948): Finished flush of dataSize ~153.08 KB/156749, heapSize ~184.83 KB/189264, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 33ms, sequenceid=376, compaction requested=false 2024-04-23 16:00:26,062 INFO [M:0;jenkins-hbase4:34409] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-23 16:00:26,062 DEBUG [M:0;jenkins-hbase4:34409] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-04-23 16:00:26,066 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-04-23 16:00:26,066 INFO [M:0;jenkins-hbase4:34409] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2024-04-23 16:00:26,066 INFO [M:0;jenkins-hbase4:34409] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34409 2024-04-23 16:00:26,068 DEBUG [M:0;jenkins-hbase4:34409] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,34409,1713887955657 already deleted, retry=false 2024-04-23 16:00:26,121 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:38643-0x101310f8ecf0001, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-04-23 16:00:26,121 INFO [RS:0;jenkins-hbase4:38643] regionserver.HRegionServer(1233): Exiting; stopping=jenkins-hbase4.apache.org,38643,1713887956870; zookeeper connection closed. 2024-04-23 16:00:26,121 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:38643-0x101310f8ecf0001, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-04-23 16:00:26,121 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@38ff2662] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@38ff2662 2024-04-23 16:00:26,122 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:35681-0x101310f8ecf0002, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-04-23 16:00:26,122 INFO [RS:1;jenkins-hbase4:35681] regionserver.HRegionServer(1233): Exiting; stopping=jenkins-hbase4.apache.org,35681,1713887956917; zookeeper connection closed. 2024-04-23 16:00:26,122 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): regionserver:35681-0x101310f8ecf0002, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-04-23 16:00:26,122 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@66709f1b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@66709f1b 2024-04-23 16:00:26,122 INFO [Listener at localhost/33425] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2024-04-23 16:00:26,171 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-04-23 16:00:26,171 INFO [M:0;jenkins-hbase4:34409] regionserver.HRegionServer(1233): Exiting; stopping=jenkins-hbase4.apache.org,34409,1713887955657; zookeeper connection closed. 2024-04-23 16:00:26,171 DEBUG [Listener at localhost/33425-EventThread] zookeeper.ZKWatcher(600): master:34409-0x101310f8ecf0000, quorum=127.0.0.1:51085, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-04-23 16:00:26,172 WARN [Listener at localhost/33425] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-04-23 16:00:26,176 INFO [Listener at localhost/33425] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-04-23 16:00:26,281 WARN [BP-1377267789-172.31.14.131-1713887952377 heartbeating to localhost/127.0.0.1:46537] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-04-23 16:00:26,281 WARN [BP-1377267789-172.31.14.131-1713887952377 heartbeating to localhost/127.0.0.1:46537] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1377267789-172.31.14.131-1713887952377 (Datanode Uuid 480f3df4-f915-4c45-ba26-8d78c5715570) service to localhost/127.0.0.1:46537 2024-04-23 16:00:26,283 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/cluster_d2ca0e05-00cf-2877-a9c8-b5e0a1848c71/dfs/data/data3/current/BP-1377267789-172.31.14.131-1713887952377] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-04-23 16:00:26,283 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/cluster_d2ca0e05-00cf-2877-a9c8-b5e0a1848c71/dfs/data/data4/current/BP-1377267789-172.31.14.131-1713887952377] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-04-23 16:00:26,286 WARN [Listener at localhost/33425] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-04-23 16:00:26,289 INFO [Listener at localhost/33425] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-04-23 16:00:26,393 WARN [BP-1377267789-172.31.14.131-1713887952377 heartbeating to localhost/127.0.0.1:46537] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-04-23 16:00:26,393 WARN [BP-1377267789-172.31.14.131-1713887952377 heartbeating to localhost/127.0.0.1:46537] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1377267789-172.31.14.131-1713887952377 (Datanode Uuid 68e4562e-a79c-4192-aaf7-76b6297004e2) service to localhost/127.0.0.1:46537 2024-04-23 16:00:26,394 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/cluster_d2ca0e05-00cf-2877-a9c8-b5e0a1848c71/dfs/data/data1/current/BP-1377267789-172.31.14.131-1713887952377] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-04-23 16:00:26,394 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2f4fe317-94cd-851a-9716-b8e28e9b22d6/cluster_d2ca0e05-00cf-2877-a9c8-b5e0a1848c71/dfs/data/data2/current/BP-1377267789-172.31.14.131-1713887952377] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-04-23 16:00:26,432 INFO [Listener at localhost/33425] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-04-23 16:00:26,549 INFO [Listener at localhost/33425] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2024-04-23 16:00:26,597 INFO [Listener at localhost/33425] hbase.HBaseTestingUtility(1293): Minicluster is down