2024-01-14 12:55:26,642 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle timeout: 13 mins 2024-01-14 12:55:26,858 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff 2024-01-14 12:55:26,870 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2024-01-14 12:55:26,871 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/cluster_7ca30cfd-5fc2-8b91-2431-1c30bd8c205f, deleteOnExit=true 2024-01-14 12:55:26,871 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2024-01-14 12:55:26,872 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/test.cache.data in system properties and HBase conf 2024-01-14 12:55:26,872 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/hadoop.tmp.dir in system properties and HBase conf 2024-01-14 12:55:26,872 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/hadoop.log.dir in system properties and HBase conf 2024-01-14 12:55:26,873 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/mapreduce.cluster.local.dir in system properties and HBase conf 2024-01-14 12:55:26,873 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/mapreduce.cluster.temp.dir in system properties and HBase conf 2024-01-14 12:55:26,874 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2024-01-14 12:55:26,994 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2024-01-14 12:55:27,403 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-01-14 12:55:27,407 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2024-01-14 12:55:27,408 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2024-01-14 12:55:27,408 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/yarn.nodemanager.log-dirs in system properties and HBase conf 2024-01-14 12:55:27,408 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-01-14 12:55:27,408 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2024-01-14 12:55:27,409 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2024-01-14 12:55:27,409 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-01-14 12:55:27,410 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/dfs.journalnode.edits.dir in system properties and HBase conf 2024-01-14 12:55:27,410 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2024-01-14 12:55:27,411 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/nfs.dump.dir in system properties and HBase conf 2024-01-14 12:55:27,411 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/java.io.tmpdir in system properties and HBase conf 2024-01-14 12:55:27,411 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/dfs.journalnode.edits.dir in system properties and HBase conf 2024-01-14 12:55:27,412 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2024-01-14 12:55:27,412 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2024-01-14 12:55:27,996 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-01-14 12:55:28,003 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-01-14 12:55:28,364 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2024-01-14 12:55:28,549 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2024-01-14 12:55:28,566 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-01-14 12:55:28,606 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2024-01-14 12:55:28,639 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/java.io.tmpdir/Jetty_localhost_45575_hdfs____ijtpwc/webapp 2024-01-14 12:55:28,771 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45575 2024-01-14 12:55:28,781 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-01-14 12:55:28,781 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-01-14 12:55:29,229 WARN [Listener at localhost/38453] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-01-14 12:55:29,291 WARN [Listener at localhost/38453] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-01-14 12:55:29,309 WARN [Listener at localhost/38453] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-01-14 12:55:29,316 INFO [Listener at localhost/38453] log.Slf4jLog(67): jetty-6.1.26 2024-01-14 12:55:29,321 INFO [Listener at localhost/38453] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/java.io.tmpdir/Jetty_localhost_40285_datanode____.s5952e/webapp 2024-01-14 12:55:29,417 INFO [Listener at localhost/38453] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40285 2024-01-14 12:55:29,723 WARN [Listener at localhost/45485] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-01-14 12:55:29,742 WARN [Listener at localhost/45485] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-01-14 12:55:29,748 WARN [Listener at localhost/45485] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-01-14 12:55:29,751 INFO [Listener at localhost/45485] log.Slf4jLog(67): jetty-6.1.26 2024-01-14 12:55:29,759 INFO [Listener at localhost/45485] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/java.io.tmpdir/Jetty_localhost_40335_datanode____.wftqyo/webapp 2024-01-14 12:55:29,865 INFO [Listener at localhost/45485] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40335 2024-01-14 12:55:29,874 WARN [Listener at localhost/35643] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-01-14 12:55:30,162 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x47e36830141e10b9: Processing first storage report for DS-b0932e4c-ef65-4503-8023-1698e4095b1a from datanode 985fe5d6-a5ac-4b33-bb59-9378bf0468a7 2024-01-14 12:55:30,164 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x47e36830141e10b9: from storage DS-b0932e4c-ef65-4503-8023-1698e4095b1a node DatanodeRegistration(127.0.0.1:44141, datanodeUuid=985fe5d6-a5ac-4b33-bb59-9378bf0468a7, infoPort=34231, infoSecurePort=0, ipcPort=35643, storageInfo=lv=-57;cid=testClusterID;nsid=1359158651;c=1705236928116), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2024-01-14 12:55:30,164 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe447c54da61ea329: Processing first storage report for DS-59b120c0-07d7-411f-a81b-4d34689d2aff from datanode e12a4588-aeff-4370-b38a-ca63337296d6 2024-01-14 12:55:30,164 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe447c54da61ea329: from storage DS-59b120c0-07d7-411f-a81b-4d34689d2aff node DatanodeRegistration(127.0.0.1:37215, datanodeUuid=e12a4588-aeff-4370-b38a-ca63337296d6, infoPort=46553, infoSecurePort=0, ipcPort=45485, storageInfo=lv=-57;cid=testClusterID;nsid=1359158651;c=1705236928116), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2024-01-14 12:55:30,164 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x47e36830141e10b9: Processing first storage report for DS-02f949eb-b891-4522-9b66-ab1179ffc059 from datanode 985fe5d6-a5ac-4b33-bb59-9378bf0468a7 2024-01-14 12:55:30,164 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x47e36830141e10b9: from storage DS-02f949eb-b891-4522-9b66-ab1179ffc059 node DatanodeRegistration(127.0.0.1:44141, datanodeUuid=985fe5d6-a5ac-4b33-bb59-9378bf0468a7, infoPort=34231, infoSecurePort=0, ipcPort=35643, storageInfo=lv=-57;cid=testClusterID;nsid=1359158651;c=1705236928116), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-01-14 12:55:30,165 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xe447c54da61ea329: Processing first storage report for DS-a29e645a-750d-453c-a704-c47c749c7a19 from datanode e12a4588-aeff-4370-b38a-ca63337296d6 2024-01-14 12:55:30,165 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xe447c54da61ea329: from storage DS-a29e645a-750d-453c-a704-c47c749c7a19 node DatanodeRegistration(127.0.0.1:37215, datanodeUuid=e12a4588-aeff-4370-b38a-ca63337296d6, infoPort=46553, infoSecurePort=0, ipcPort=45485, storageInfo=lv=-57;cid=testClusterID;nsid=1359158651;c=1705236928116), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-01-14 12:55:30,251 DEBUG [Listener at localhost/35643] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff 2024-01-14 12:55:30,363 INFO [Listener at localhost/35643] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/cluster_7ca30cfd-5fc2-8b91-2431-1c30bd8c205f/zookeeper_0, clientPort=56570, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/cluster_7ca30cfd-5fc2-8b91-2431-1c30bd8c205f/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/cluster_7ca30cfd-5fc2-8b91-2431-1c30bd8c205f/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2024-01-14 12:55:30,379 INFO [Listener at localhost/35643] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56570 2024-01-14 12:55:30,387 INFO [Listener at localhost/35643] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-14 12:55:30,390 INFO [Listener at localhost/35643] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-14 12:55:31,073 INFO [Listener at localhost/35643] util.FSUtils(471): Created version file at hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa with version=8 2024-01-14 12:55:31,073 INFO [Listener at localhost/35643] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/hbase-staging 2024-01-14 12:55:31,381 INFO [Listener at localhost/35643] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2024-01-14 12:55:31,841 INFO [Listener at localhost/35643] client.ConnectionUtils(126): master/jenkins-hbase4:0 server-side Connection retries=45 2024-01-14 12:55:31,873 INFO [Listener at localhost/35643] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-14 12:55:31,873 INFO [Listener at localhost/35643] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-01-14 12:55:31,874 INFO [Listener at localhost/35643] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-01-14 12:55:31,874 INFO [Listener at localhost/35643] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-14 12:55:31,874 INFO [Listener at localhost/35643] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-01-14 12:55:32,028 INFO [Listener at localhost/35643] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2024-01-14 12:55:32,114 DEBUG [Listener at localhost/35643] util.ClassSize(228): Using Unsafe to estimate memory layout 2024-01-14 12:55:32,276 INFO [Listener at localhost/35643] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39225 2024-01-14 12:55:32,309 INFO [Listener at localhost/35643] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-14 12:55:32,331 INFO [Listener at localhost/35643] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-14 12:55:32,363 INFO [Listener at localhost/35643] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39225 connecting to ZooKeeper ensemble=127.0.0.1:56570 2024-01-14 12:55:32,569 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:392250x0, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-01-14 12:55:32,576 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:39225-0x101261a83410000 connected 2024-01-14 12:55:32,857 DEBUG [Listener at localhost/35643] zookeeper.ZKUtil(165): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-01-14 12:55:32,858 DEBUG [Listener at localhost/35643] zookeeper.ZKUtil(165): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-14 12:55:32,864 DEBUG [Listener at localhost/35643] zookeeper.ZKUtil(165): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-01-14 12:55:32,924 DEBUG [Listener at localhost/35643] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39225 2024-01-14 12:55:32,965 DEBUG [Listener at localhost/35643] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39225 2024-01-14 12:55:32,975 DEBUG [Listener at localhost/35643] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39225 2024-01-14 12:55:32,976 DEBUG [Listener at localhost/35643] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39225 2024-01-14 12:55:32,977 DEBUG [Listener at localhost/35643] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39225 2024-01-14 12:55:32,984 INFO [Listener at localhost/35643] master.HMaster(445): hbase.rootdir=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa, hbase.cluster.distributed=false 2024-01-14 12:55:33,217 INFO [Listener at localhost/35643] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-01-14 12:55:33,218 INFO [Listener at localhost/35643] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-14 12:55:33,218 INFO [Listener at localhost/35643] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-01-14 12:55:33,218 INFO [Listener at localhost/35643] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-01-14 12:55:33,218 INFO [Listener at localhost/35643] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-14 12:55:33,218 INFO [Listener at localhost/35643] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-01-14 12:55:33,223 INFO [Listener at localhost/35643] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-01-14 12:55:33,226 INFO [Listener at localhost/35643] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46767 2024-01-14 12:55:33,228 INFO [Listener at localhost/35643] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-01-14 12:55:33,234 DEBUG [Listener at localhost/35643] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-01-14 12:55:33,236 INFO [Listener at localhost/35643] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-14 12:55:33,237 INFO [Listener at localhost/35643] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-14 12:55:33,240 INFO [Listener at localhost/35643] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:46767 connecting to ZooKeeper ensemble=127.0.0.1:56570 2024-01-14 12:55:33,245 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): regionserver:467670x0, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-01-14 12:55:33,246 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:46767-0x101261a83410001 connected 2024-01-14 12:55:33,246 DEBUG [Listener at localhost/35643] zookeeper.ZKUtil(165): regionserver:46767-0x101261a83410001, quorum=127.0.0.1:56570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-01-14 12:55:33,247 DEBUG [Listener at localhost/35643] zookeeper.ZKUtil(165): regionserver:46767-0x101261a83410001, quorum=127.0.0.1:56570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-14 12:55:33,249 DEBUG [Listener at localhost/35643] zookeeper.ZKUtil(165): regionserver:46767-0x101261a83410001, quorum=127.0.0.1:56570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-01-14 12:55:33,250 DEBUG [Listener at localhost/35643] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46767 2024-01-14 12:55:33,250 DEBUG [Listener at localhost/35643] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46767 2024-01-14 12:55:33,251 DEBUG [Listener at localhost/35643] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46767 2024-01-14 12:55:33,252 DEBUG [Listener at localhost/35643] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46767 2024-01-14 12:55:33,253 DEBUG [Listener at localhost/35643] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46767 2024-01-14 12:55:33,266 INFO [Listener at localhost/35643] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-01-14 12:55:33,266 INFO [Listener at localhost/35643] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-14 12:55:33,266 INFO [Listener at localhost/35643] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-01-14 12:55:33,267 INFO [Listener at localhost/35643] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-01-14 12:55:33,267 INFO [Listener at localhost/35643] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-14 12:55:33,267 INFO [Listener at localhost/35643] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-01-14 12:55:33,267 INFO [Listener at localhost/35643] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-01-14 12:55:33,269 INFO [Listener at localhost/35643] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43387 2024-01-14 12:55:33,270 INFO [Listener at localhost/35643] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-01-14 12:55:33,271 DEBUG [Listener at localhost/35643] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-01-14 12:55:33,272 INFO [Listener at localhost/35643] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-14 12:55:33,273 INFO [Listener at localhost/35643] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-14 12:55:33,276 INFO [Listener at localhost/35643] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43387 connecting to ZooKeeper ensemble=127.0.0.1:56570 2024-01-14 12:55:33,280 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): regionserver:433870x0, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-01-14 12:55:33,281 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43387-0x101261a83410002 connected 2024-01-14 12:55:33,282 DEBUG [Listener at localhost/35643] zookeeper.ZKUtil(165): regionserver:43387-0x101261a83410002, quorum=127.0.0.1:56570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-01-14 12:55:33,283 DEBUG [Listener at localhost/35643] zookeeper.ZKUtil(165): regionserver:43387-0x101261a83410002, quorum=127.0.0.1:56570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-14 12:55:33,284 DEBUG [Listener at localhost/35643] zookeeper.ZKUtil(165): regionserver:43387-0x101261a83410002, quorum=127.0.0.1:56570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-01-14 12:55:33,284 DEBUG [Listener at localhost/35643] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43387 2024-01-14 12:55:33,284 DEBUG [Listener at localhost/35643] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43387 2024-01-14 12:55:33,285 DEBUG [Listener at localhost/35643] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43387 2024-01-14 12:55:33,285 DEBUG [Listener at localhost/35643] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43387 2024-01-14 12:55:33,286 DEBUG [Listener at localhost/35643] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43387 2024-01-14 12:55:33,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2174): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39225,1705236931219 2024-01-14 12:55:33,298 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-01-14 12:55:33,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39225,1705236931219 2024-01-14 12:55:33,320 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): regionserver:43387-0x101261a83410002, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-01-14 12:55:33,320 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-01-14 12:55:33,320 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): regionserver:46767-0x101261a83410001, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-01-14 12:55:33,320 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-14 12:55:33,322 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-01-14 12:55:33,323 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39225,1705236931219 from backup master directory 2024-01-14 12:55:33,323 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(163): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-01-14 12:55:33,328 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39225,1705236931219 2024-01-14 12:55:33,328 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-01-14 12:55:33,329 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-01-14 12:55:33,329 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,39225,1705236931219 2024-01-14 12:55:33,332 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2024-01-14 12:55:33,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2024-01-14 12:55:33,428 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/hbase.id with ID: 174cb5f1-2acc-4896-947a-d0fd465a957d 2024-01-14 12:55:33,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-14 12:55:33,489 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-14 12:55:33,534 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x13ce864d to 127.0.0.1:56570 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-01-14 12:55:33,572 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@261460f0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-01-14 12:55:33,598 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-14 12:55:33,600 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2024-01-14 12:55:33,618 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2024-01-14 12:55:33,618 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2024-01-14 12:55:33,620 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-01-14 12:55:33,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-01-14 12:55:33,625 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-01-14 12:55:33,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/MasterData/data/master/store-tmp 2024-01-14 12:55:33,694 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 12:55:33,694 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-01-14 12:55:33,694 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-14 12:55:33,694 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-14 12:55:33,694 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-01-14 12:55:33,694 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-14 12:55:33,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-14 12:55:33,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-01-14 12:55:33,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/MasterData/WALs/jenkins-hbase4.apache.org,39225,1705236931219 2024-01-14 12:55:33,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39225%2C1705236931219, suffix=, logDir=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/MasterData/WALs/jenkins-hbase4.apache.org,39225,1705236931219, archiveDir=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/MasterData/oldWALs, maxLogs=10 2024-01-14 12:55:33,785 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37215,DS-59b120c0-07d7-411f-a81b-4d34689d2aff,DISK] 2024-01-14 12:55:33,785 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44141,DS-b0932e4c-ef65-4503-8023-1698e4095b1a,DISK] 2024-01-14 12:55:33,793 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2024-01-14 12:55:33,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/MasterData/WALs/jenkins-hbase4.apache.org,39225,1705236931219/jenkins-hbase4.apache.org%2C39225%2C1705236931219.1705236933727 2024-01-14 12:55:33,858 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44141,DS-b0932e4c-ef65-4503-8023-1698e4095b1a,DISK], DatanodeInfoWithStorage[127.0.0.1:37215,DS-59b120c0-07d7-411f-a81b-4d34689d2aff,DISK]] 2024-01-14 12:55:33,859 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2024-01-14 12:55:33,859 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 12:55:33,863 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2024-01-14 12:55:33,864 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2024-01-14 12:55:33,922 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2024-01-14 12:55:33,929 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2024-01-14 12:55:33,953 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2024-01-14 12:55:33,965 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 12:55:33,971 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-01-14 12:55:33,973 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-01-14 12:55:33,987 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2024-01-14 12:55:33,992 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-14 12:55:33,993 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68252733, jitterRate=0.017044976353645325}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-14 12:55:33,993 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2024-01-14 12:55:33,994 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2024-01-14 12:55:34,013 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2024-01-14 12:55:34,013 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(608): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2024-01-14 12:55:34,015 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2024-01-14 12:55:34,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(628): Recovered RegionProcedureStore lease in 1 msec 2024-01-14 12:55:34,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(642): Loaded RegionProcedureStore in 32 msec 2024-01-14 12:55:34,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2024-01-14 12:55:34,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2024-01-14 12:55:34,080 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2024-01-14 12:55:34,105 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2024-01-14 12:55:34,109 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2024-01-14 12:55:34,110 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2024-01-14 12:55:34,116 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2024-01-14 12:55:34,120 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2024-01-14 12:55:34,124 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-14 12:55:34,125 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2024-01-14 12:55:34,126 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2024-01-14 12:55:34,138 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2024-01-14 12:55:34,143 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): regionserver:43387-0x101261a83410002, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-01-14 12:55:34,143 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-01-14 12:55:34,143 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): regionserver:46767-0x101261a83410001, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-01-14 12:55:34,143 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-14 12:55:34,143 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(745): Active/primary master=jenkins-hbase4.apache.org,39225,1705236931219, sessionid=0x101261a83410000, setting cluster-up flag (Was=false) 2024-01-14 12:55:34,160 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-14 12:55:34,166 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2024-01-14 12:55:34,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39225,1705236931219 2024-01-14 12:55:34,174 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-14 12:55:34,179 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2024-01-14 12:55:34,181 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39225,1705236931219 2024-01-14 12:55:34,183 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.hbase-snapshot/.tmp 2024-01-14 12:55:34,189 INFO [RS:1;jenkins-hbase4:43387] regionserver.HRegionServer(954): ClusterId : 174cb5f1-2acc-4896-947a-d0fd465a957d 2024-01-14 12:55:34,190 INFO [RS:0;jenkins-hbase4:46767] regionserver.HRegionServer(954): ClusterId : 174cb5f1-2acc-4896-947a-d0fd465a957d 2024-01-14 12:55:34,194 DEBUG [RS:1;jenkins-hbase4:43387] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-01-14 12:55:34,194 DEBUG [RS:0;jenkins-hbase4:46767] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-01-14 12:55:34,201 DEBUG [RS:1;jenkins-hbase4:43387] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-01-14 12:55:34,201 DEBUG [RS:0;jenkins-hbase4:46767] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-01-14 12:55:34,201 DEBUG [RS:1;jenkins-hbase4:43387] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-01-14 12:55:34,201 DEBUG [RS:0;jenkins-hbase4:46767] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-01-14 12:55:34,205 DEBUG [RS:1;jenkins-hbase4:43387] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-01-14 12:55:34,205 DEBUG [RS:0;jenkins-hbase4:46767] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-01-14 12:55:34,207 DEBUG [RS:0;jenkins-hbase4:46767] zookeeper.ReadOnlyZKClient(139): Connect 0x6d34cd73 to 127.0.0.1:56570 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-01-14 12:55:34,207 DEBUG [RS:1;jenkins-hbase4:43387] zookeeper.ReadOnlyZKClient(139): Connect 0x6aefd968 to 127.0.0.1:56570 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-01-14 12:55:34,215 DEBUG [RS:0;jenkins-hbase4:46767] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@63f33ea5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-01-14 12:55:34,215 DEBUG [RS:1;jenkins-hbase4:43387] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64283a45, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-01-14 12:55:34,215 DEBUG [RS:0;jenkins-hbase4:46767] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@67cca603, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-01-14 12:55:34,215 DEBUG [RS:1;jenkins-hbase4:43387] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6017b218, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-01-14 12:55:34,233 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver loaded, priority=536870911. 2024-01-14 12:55:34,239 DEBUG [RS:0;jenkins-hbase4:46767] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:46767 2024-01-14 12:55:34,239 DEBUG [RS:1;jenkins-hbase4:43387] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43387 2024-01-14 12:55:34,243 INFO [RS:0;jenkins-hbase4:46767] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-01-14 12:55:34,243 INFO [RS:1;jenkins-hbase4:43387] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-01-14 12:55:34,243 INFO [RS:0;jenkins-hbase4:46767] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-01-14 12:55:34,243 INFO [RS:1;jenkins-hbase4:43387] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-01-14 12:55:34,243 DEBUG [RS:0;jenkins-hbase4:46767] regionserver.HRegionServer(1025): About to register with Master. 2024-01-14 12:55:34,243 DEBUG [RS:1;jenkins-hbase4:43387] regionserver.HRegionServer(1025): About to register with Master. 2024-01-14 12:55:34,246 INFO [RS:1;jenkins-hbase4:43387] regionserver.HRegionServer(2814): reportForDuty to master=jenkins-hbase4.apache.org,39225,1705236931219 with isa=jenkins-hbase4.apache.org/172.31.14.131:43387, startcode=1705236933265 2024-01-14 12:55:34,246 INFO [RS:0;jenkins-hbase4:46767] regionserver.HRegionServer(2814): reportForDuty to master=jenkins-hbase4.apache.org,39225,1705236931219 with isa=jenkins-hbase4.apache.org/172.31.14.131:46767, startcode=1705236933216 2024-01-14 12:55:34,265 DEBUG [RS:0;jenkins-hbase4:46767] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-01-14 12:55:34,265 DEBUG [RS:1;jenkins-hbase4:43387] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-01-14 12:55:34,317 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2024-01-14 12:55:34,327 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-01-14 12:55:34,327 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-01-14 12:55:34,327 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-01-14 12:55:34,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-01-14 12:55:34,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2024-01-14 12:55:34,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 12:55:34,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-01-14 12:55:34,328 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 12:55:34,330 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44819, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2024-01-14 12:55:34,330 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34153, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2024-01-14 12:55:34,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1705236964333 2024-01-14 12:55:34,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2024-01-14 12:55:34,339 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2024-01-14 12:55:34,339 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2024-01-14 12:55:34,340 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39225] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2838) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15910) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2024-01-14 12:55:34,345 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-01-14 12:55:34,347 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2024-01-14 12:55:34,350 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39225] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2838) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15910) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2024-01-14 12:55:34,356 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2024-01-14 12:55:34,357 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2024-01-14 12:55:34,357 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2024-01-14 12:55:34,357 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2024-01-14 12:55:34,358 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:34,359 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2024-01-14 12:55:34,360 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2024-01-14 12:55:34,360 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2024-01-14 12:55:34,362 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2024-01-14 12:55:34,363 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2024-01-14 12:55:34,364 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1705236934364,5,FailOnTimeoutGroup] 2024-01-14 12:55:34,366 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1705236934364,5,FailOnTimeoutGroup] 2024-01-14 12:55:34,366 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:34,366 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1466): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2024-01-14 12:55:34,368 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:34,368 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:34,377 DEBUG [RS:1;jenkins-hbase4:43387] regionserver.HRegionServer(2833): Master is not running yet 2024-01-14 12:55:34,377 DEBUG [RS:0;jenkins-hbase4:46767] regionserver.HRegionServer(2833): Master is not running yet 2024-01-14 12:55:34,378 WARN [RS:1;jenkins-hbase4:43387] regionserver.HRegionServer(1033): reportForDuty failed; sleeping 100 ms and then retrying. 2024-01-14 12:55:34,378 WARN [RS:0;jenkins-hbase4:46767] regionserver.HRegionServer(1033): reportForDuty failed; sleeping 100 ms and then retrying. 2024-01-14 12:55:34,384 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-01-14 12:55:34,385 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-01-14 12:55:34,386 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa 2024-01-14 12:55:34,404 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 12:55:34,406 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-01-14 12:55:34,409 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/meta/1588230740/info 2024-01-14 12:55:34,410 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-01-14 12:55:34,411 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 12:55:34,411 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-01-14 12:55:34,414 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/meta/1588230740/rep_barrier 2024-01-14 12:55:34,414 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-01-14 12:55:34,415 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 12:55:34,415 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-01-14 12:55:34,417 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/meta/1588230740/table 2024-01-14 12:55:34,418 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-01-14 12:55:34,419 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 12:55:34,420 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/meta/1588230740 2024-01-14 12:55:34,421 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/meta/1588230740 2024-01-14 12:55:34,425 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-01-14 12:55:34,427 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2024-01-14 12:55:34,430 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-14 12:55:34,432 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63777350, jitterRate=-0.04964342713356018}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-01-14 12:55:34,432 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2024-01-14 12:55:34,432 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-01-14 12:55:34,432 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-01-14 12:55:34,432 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-01-14 12:55:34,433 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-01-14 12:55:34,433 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-01-14 12:55:34,433 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-01-14 12:55:34,434 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-01-14 12:55:34,438 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2024-01-14 12:55:34,438 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2024-01-14 12:55:34,446 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2024-01-14 12:55:34,457 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2024-01-14 12:55:34,460 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2024-01-14 12:55:34,479 INFO [RS:0;jenkins-hbase4:46767] regionserver.HRegionServer(2814): reportForDuty to master=jenkins-hbase4.apache.org,39225,1705236931219 with isa=jenkins-hbase4.apache.org/172.31.14.131:46767, startcode=1705236933216 2024-01-14 12:55:34,479 INFO [RS:1;jenkins-hbase4:43387] regionserver.HRegionServer(2814): reportForDuty to master=jenkins-hbase4.apache.org,39225,1705236931219 with isa=jenkins-hbase4.apache.org/172.31.14.131:43387, startcode=1705236933265 2024-01-14 12:55:34,485 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39225] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,43387,1705236933265 2024-01-14 12:55:34,490 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39225] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,46767,1705236933216 2024-01-14 12:55:34,491 DEBUG [RS:1;jenkins-hbase4:43387] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa 2024-01-14 12:55:34,491 DEBUG [RS:1;jenkins-hbase4:43387] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:38453 2024-01-14 12:55:34,491 DEBUG [RS:1;jenkins-hbase4:43387] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-01-14 12:55:34,491 DEBUG [RS:0;jenkins-hbase4:46767] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa 2024-01-14 12:55:34,491 DEBUG [RS:0;jenkins-hbase4:46767] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:38453 2024-01-14 12:55:34,491 DEBUG [RS:0;jenkins-hbase4:46767] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-01-14 12:55:34,501 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-01-14 12:55:34,502 DEBUG [RS:1;jenkins-hbase4:43387] zookeeper.ZKUtil(163): regionserver:43387-0x101261a83410002, quorum=127.0.0.1:56570, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43387,1705236933265 2024-01-14 12:55:34,502 DEBUG [RS:0;jenkins-hbase4:46767] zookeeper.ZKUtil(163): regionserver:46767-0x101261a83410001, quorum=127.0.0.1:56570, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46767,1705236933216 2024-01-14 12:55:34,502 WARN [RS:1;jenkins-hbase4:43387] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-01-14 12:55:34,502 WARN [RS:0;jenkins-hbase4:46767] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-01-14 12:55:34,503 INFO [RS:1;jenkins-hbase4:43387] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-01-14 12:55:34,503 INFO [RS:0;jenkins-hbase4:46767] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-01-14 12:55:34,503 DEBUG [RS:1;jenkins-hbase4:43387] regionserver.HRegionServer(1951): logDir=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/WALs/jenkins-hbase4.apache.org,43387,1705236933265 2024-01-14 12:55:34,503 DEBUG [RS:0;jenkins-hbase4:46767] regionserver.HRegionServer(1951): logDir=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/WALs/jenkins-hbase4.apache.org,46767,1705236933216 2024-01-14 12:55:34,504 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,46767,1705236933216] 2024-01-14 12:55:34,504 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43387,1705236933265] 2024-01-14 12:55:34,514 DEBUG [RS:0;jenkins-hbase4:46767] zookeeper.ZKUtil(163): regionserver:46767-0x101261a83410001, quorum=127.0.0.1:56570, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46767,1705236933216 2024-01-14 12:55:34,514 DEBUG [RS:1;jenkins-hbase4:43387] zookeeper.ZKUtil(163): regionserver:43387-0x101261a83410002, quorum=127.0.0.1:56570, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,46767,1705236933216 2024-01-14 12:55:34,515 DEBUG [RS:0;jenkins-hbase4:46767] zookeeper.ZKUtil(163): regionserver:46767-0x101261a83410001, quorum=127.0.0.1:56570, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43387,1705236933265 2024-01-14 12:55:34,515 DEBUG [RS:1;jenkins-hbase4:43387] zookeeper.ZKUtil(163): regionserver:43387-0x101261a83410002, quorum=127.0.0.1:56570, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43387,1705236933265 2024-01-14 12:55:34,525 DEBUG [RS:1;jenkins-hbase4:43387] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-01-14 12:55:34,525 DEBUG [RS:0;jenkins-hbase4:46767] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-01-14 12:55:34,535 INFO [RS:0;jenkins-hbase4:46767] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-01-14 12:55:34,535 INFO [RS:1;jenkins-hbase4:43387] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-01-14 12:55:34,554 INFO [RS:1;jenkins-hbase4:43387] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-01-14 12:55:34,554 INFO [RS:0;jenkins-hbase4:46767] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-01-14 12:55:34,558 INFO [RS:1;jenkins-hbase4:43387] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-01-14 12:55:34,558 INFO [RS:0;jenkins-hbase4:46767] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-01-14 12:55:34,558 INFO [RS:1;jenkins-hbase4:43387] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:34,558 INFO [RS:0;jenkins-hbase4:46767] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:34,560 INFO [RS:1;jenkins-hbase4:43387] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-01-14 12:55:34,560 INFO [RS:0;jenkins-hbase4:46767] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-01-14 12:55:34,567 INFO [RS:1;jenkins-hbase4:43387] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:34,567 INFO [RS:0;jenkins-hbase4:46767] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:34,567 DEBUG [RS:1;jenkins-hbase4:43387] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 12:55:34,568 DEBUG [RS:0;jenkins-hbase4:46767] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 12:55:34,568 DEBUG [RS:1;jenkins-hbase4:43387] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 12:55:34,568 DEBUG [RS:0;jenkins-hbase4:46767] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 12:55:34,568 DEBUG [RS:1;jenkins-hbase4:43387] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 12:55:34,568 DEBUG [RS:0;jenkins-hbase4:46767] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 12:55:34,568 DEBUG [RS:1;jenkins-hbase4:43387] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 12:55:34,568 DEBUG [RS:0;jenkins-hbase4:46767] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 12:55:34,568 DEBUG [RS:1;jenkins-hbase4:43387] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 12:55:34,568 DEBUG [RS:0;jenkins-hbase4:46767] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 12:55:34,568 DEBUG [RS:1;jenkins-hbase4:43387] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-01-14 12:55:34,568 DEBUG [RS:0;jenkins-hbase4:46767] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-01-14 12:55:34,569 DEBUG [RS:1;jenkins-hbase4:43387] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 12:55:34,569 DEBUG [RS:0;jenkins-hbase4:46767] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 12:55:34,569 DEBUG [RS:1;jenkins-hbase4:43387] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 12:55:34,569 DEBUG [RS:0;jenkins-hbase4:46767] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 12:55:34,569 DEBUG [RS:1;jenkins-hbase4:43387] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 12:55:34,569 DEBUG [RS:0;jenkins-hbase4:46767] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 12:55:34,569 DEBUG [RS:1;jenkins-hbase4:43387] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 12:55:34,569 DEBUG [RS:0;jenkins-hbase4:46767] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-14 12:55:34,571 INFO [RS:0;jenkins-hbase4:46767] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:34,571 INFO [RS:1;jenkins-hbase4:43387] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:34,571 INFO [RS:0;jenkins-hbase4:46767] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:34,571 INFO [RS:1;jenkins-hbase4:43387] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:34,571 INFO [RS:0;jenkins-hbase4:46767] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:34,572 INFO [RS:1;jenkins-hbase4:43387] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:34,572 INFO [RS:0;jenkins-hbase4:46767] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:34,572 INFO [RS:1;jenkins-hbase4:43387] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:34,589 INFO [RS:0;jenkins-hbase4:46767] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-01-14 12:55:34,589 INFO [RS:1;jenkins-hbase4:43387] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-01-14 12:55:34,592 INFO [RS:1;jenkins-hbase4:43387] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43387,1705236933265-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:34,592 INFO [RS:0;jenkins-hbase4:46767] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46767,1705236933216-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:34,611 DEBUG [jenkins-hbase4:39225] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=2, allServersCount=2 2024-01-14 12:55:34,615 DEBUG [jenkins-hbase4:39225] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-14 12:55:34,620 INFO [RS:0;jenkins-hbase4:46767] regionserver.Replication(203): jenkins-hbase4.apache.org,46767,1705236933216 started 2024-01-14 12:55:34,620 INFO [RS:0;jenkins-hbase4:46767] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,46767,1705236933216, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:46767, sessionid=0x101261a83410001 2024-01-14 12:55:34,621 INFO [RS:1;jenkins-hbase4:43387] regionserver.Replication(203): jenkins-hbase4.apache.org,43387,1705236933265 started 2024-01-14 12:55:34,621 INFO [RS:1;jenkins-hbase4:43387] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,43387,1705236933265, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43387, sessionid=0x101261a83410002 2024-01-14 12:55:34,621 DEBUG [RS:0;jenkins-hbase4:46767] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-01-14 12:55:34,621 DEBUG [RS:1;jenkins-hbase4:43387] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-01-14 12:55:34,621 DEBUG [RS:0;jenkins-hbase4:46767] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,46767,1705236933216 2024-01-14 12:55:34,621 DEBUG [RS:1;jenkins-hbase4:43387] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43387,1705236933265 2024-01-14 12:55:34,621 DEBUG [RS:0;jenkins-hbase4:46767] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46767,1705236933216' 2024-01-14 12:55:34,622 DEBUG [RS:1;jenkins-hbase4:43387] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43387,1705236933265' 2024-01-14 12:55:34,622 DEBUG [RS:1;jenkins-hbase4:43387] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-01-14 12:55:34,622 DEBUG [RS:0;jenkins-hbase4:46767] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-01-14 12:55:34,622 DEBUG [jenkins-hbase4:39225] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-14 12:55:34,622 DEBUG [jenkins-hbase4:39225] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-14 12:55:34,622 DEBUG [jenkins-hbase4:39225] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-14 12:55:34,623 DEBUG [RS:1;jenkins-hbase4:43387] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-01-14 12:55:34,623 DEBUG [RS:0;jenkins-hbase4:46767] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-01-14 12:55:34,624 DEBUG [RS:1;jenkins-hbase4:43387] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-01-14 12:55:34,624 DEBUG [RS:0;jenkins-hbase4:46767] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-01-14 12:55:34,624 DEBUG [RS:0;jenkins-hbase4:46767] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-01-14 12:55:34,624 DEBUG [RS:1;jenkins-hbase4:43387] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-01-14 12:55:34,624 DEBUG [RS:0;jenkins-hbase4:46767] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,46767,1705236933216 2024-01-14 12:55:34,624 DEBUG [RS:1;jenkins-hbase4:43387] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43387,1705236933265 2024-01-14 12:55:34,625 DEBUG [RS:0;jenkins-hbase4:46767] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,46767,1705236933216' 2024-01-14 12:55:34,625 DEBUG [RS:0;jenkins-hbase4:46767] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-01-14 12:55:34,625 DEBUG [RS:1;jenkins-hbase4:43387] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43387,1705236933265' 2024-01-14 12:55:34,625 DEBUG [RS:1;jenkins-hbase4:43387] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-01-14 12:55:34,625 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43387,1705236933265, state=OPENING 2024-01-14 12:55:34,626 DEBUG [RS:0;jenkins-hbase4:46767] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-01-14 12:55:34,626 DEBUG [RS:1;jenkins-hbase4:43387] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-01-14 12:55:34,626 DEBUG [RS:0;jenkins-hbase4:46767] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-01-14 12:55:34,626 DEBUG [RS:1;jenkins-hbase4:43387] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-01-14 12:55:34,626 INFO [RS:0;jenkins-hbase4:46767] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-01-14 12:55:34,626 INFO [RS:1;jenkins-hbase4:43387] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-01-14 12:55:34,629 INFO [RS:1;jenkins-hbase4:43387] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:34,629 INFO [RS:0;jenkins-hbase4:46767] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:34,630 DEBUG [RS:1;jenkins-hbase4:43387] zookeeper.ZKUtil(399): regionserver:43387-0x101261a83410002, quorum=127.0.0.1:56570, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-01-14 12:55:34,630 INFO [RS:1;jenkins-hbase4:43387] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-01-14 12:55:34,630 DEBUG [RS:0;jenkins-hbase4:46767] zookeeper.ZKUtil(399): regionserver:46767-0x101261a83410001, quorum=127.0.0.1:56570, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-01-14 12:55:34,630 INFO [RS:0;jenkins-hbase4:46767] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-01-14 12:55:34,631 INFO [RS:0;jenkins-hbase4:46767] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:34,631 INFO [RS:1;jenkins-hbase4:43387] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:34,631 INFO [RS:0;jenkins-hbase4:46767] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:34,631 INFO [RS:1;jenkins-hbase4:43387] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:34,633 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2024-01-14 12:55:34,635 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-14 12:55:34,636 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-01-14 12:55:34,639 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43387,1705236933265}] 2024-01-14 12:55:34,743 INFO [RS:0;jenkins-hbase4:46767] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46767%2C1705236933216, suffix=, logDir=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/WALs/jenkins-hbase4.apache.org,46767,1705236933216, archiveDir=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/oldWALs, maxLogs=32 2024-01-14 12:55:34,743 INFO [RS:1;jenkins-hbase4:43387] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43387%2C1705236933265, suffix=, logDir=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/WALs/jenkins-hbase4.apache.org,43387,1705236933265, archiveDir=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/oldWALs, maxLogs=32 2024-01-14 12:55:34,768 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37215,DS-59b120c0-07d7-411f-a81b-4d34689d2aff,DISK] 2024-01-14 12:55:34,788 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44141,DS-b0932e4c-ef65-4503-8023-1698e4095b1a,DISK] 2024-01-14 12:55:34,788 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44141,DS-b0932e4c-ef65-4503-8023-1698e4095b1a,DISK] 2024-01-14 12:55:34,791 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37215,DS-59b120c0-07d7-411f-a81b-4d34689d2aff,DISK] 2024-01-14 12:55:34,796 INFO [RS:1;jenkins-hbase4:43387] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/WALs/jenkins-hbase4.apache.org,43387,1705236933265/jenkins-hbase4.apache.org%2C43387%2C1705236933265.1705236934748 2024-01-14 12:55:34,796 DEBUG [RS:1;jenkins-hbase4:43387] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37215,DS-59b120c0-07d7-411f-a81b-4d34689d2aff,DISK], DatanodeInfoWithStorage[127.0.0.1:44141,DS-b0932e4c-ef65-4503-8023-1698e4095b1a,DISK]] 2024-01-14 12:55:34,796 INFO [RS:0;jenkins-hbase4:46767] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/WALs/jenkins-hbase4.apache.org,46767,1705236933216/jenkins-hbase4.apache.org%2C46767%2C1705236933216.1705236934748 2024-01-14 12:55:34,797 DEBUG [RS:0;jenkins-hbase4:46767] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44141,DS-b0932e4c-ef65-4503-8023-1698e4095b1a,DISK], DatanodeInfoWithStorage[127.0.0.1:37215,DS-59b120c0-07d7-411f-a81b-4d34689d2aff,DISK]] 2024-01-14 12:55:34,825 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43387,1705236933265 2024-01-14 12:55:34,828 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-01-14 12:55:34,831 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32780, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-01-14 12:55:34,842 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2024-01-14 12:55:34,842 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-01-14 12:55:34,845 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43387%2C1705236933265.meta, suffix=.meta, logDir=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/WALs/jenkins-hbase4.apache.org,43387,1705236933265, archiveDir=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/oldWALs, maxLogs=32 2024-01-14 12:55:34,863 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37215,DS-59b120c0-07d7-411f-a81b-4d34689d2aff,DISK] 2024-01-14 12:55:34,864 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44141,DS-b0932e4c-ef65-4503-8023-1698e4095b1a,DISK] 2024-01-14 12:55:34,870 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/WALs/jenkins-hbase4.apache.org,43387,1705236933265/jenkins-hbase4.apache.org%2C43387%2C1705236933265.meta.1705236934847.meta 2024-01-14 12:55:34,871 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37215,DS-59b120c0-07d7-411f-a81b-4d34689d2aff,DISK], DatanodeInfoWithStorage[127.0.0.1:44141,DS-b0932e4c-ef65-4503-8023-1698e4095b1a,DISK]] 2024-01-14 12:55:34,871 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2024-01-14 12:55:34,873 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2024-01-14 12:55:34,888 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2024-01-14 12:55:34,893 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2024-01-14 12:55:34,898 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2024-01-14 12:55:34,898 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 12:55:34,898 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2024-01-14 12:55:34,898 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2024-01-14 12:55:34,902 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-01-14 12:55:34,904 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/meta/1588230740/info 2024-01-14 12:55:34,904 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/meta/1588230740/info 2024-01-14 12:55:34,904 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-01-14 12:55:34,905 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 12:55:34,906 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-01-14 12:55:34,907 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/meta/1588230740/rep_barrier 2024-01-14 12:55:34,907 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/meta/1588230740/rep_barrier 2024-01-14 12:55:34,908 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-01-14 12:55:34,909 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 12:55:34,909 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-01-14 12:55:34,911 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/meta/1588230740/table 2024-01-14 12:55:34,911 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/meta/1588230740/table 2024-01-14 12:55:34,911 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-01-14 12:55:34,912 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 12:55:34,914 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/meta/1588230740 2024-01-14 12:55:34,917 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/meta/1588230740 2024-01-14 12:55:34,923 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-01-14 12:55:34,925 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2024-01-14 12:55:34,927 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61803832, jitterRate=-0.07905113697052002}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-01-14 12:55:34,927 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2024-01-14 12:55:34,936 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1705236934818 2024-01-14 12:55:34,955 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for hbase:meta,,1.1588230740 2024-01-14 12:55:34,956 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2024-01-14 12:55:34,957 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43387,1705236933265, state=OPEN 2024-01-14 12:55:34,961 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2024-01-14 12:55:34,962 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-01-14 12:55:34,966 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=3, resume processing ppid=2 2024-01-14 12:55:34,966 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43387,1705236933265 in 323 msec 2024-01-14 12:55:34,972 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=2, resume processing ppid=1 2024-01-14 12:55:34,972 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 521 msec 2024-01-14 12:55:34,977 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 736 msec 2024-01-14 12:55:34,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(954): Wait for region servers to report in: status=null, state=RUNNING, startTime=1705236934978, completionTime=-1 2024-01-14 12:55:34,978 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2024-01-14 12:55:34,978 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2024-01-14 12:55:35,043 DEBUG [hconnection-0x620db0d5-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-01-14 12:55:35,046 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32782, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-01-14 12:55:35,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=2 2024-01-14 12:55:35,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1705236995062 2024-01-14 12:55:35,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1705237055062 2024-01-14 12:55:35,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 84 msec 2024-01-14 12:55:35,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39225,1705236931219-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:35,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39225,1705236931219-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:35,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39225,1705236931219-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:35,087 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39225, period=300000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:35,087 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:35,093 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2024-01-14 12:55:35,101 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2024-01-14 12:55:35,102 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-01-14 12:55:35,111 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2024-01-14 12:55:35,114 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2024-01-14 12:55:35,117 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-14 12:55:35,139 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/hbase/namespace/1087cef0e34ba5a7689c8b4bb8203c42 2024-01-14 12:55:35,142 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/hbase/namespace/1087cef0e34ba5a7689c8b4bb8203c42 empty. 2024-01-14 12:55:35,143 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/hbase/namespace/1087cef0e34ba5a7689c8b4bb8203c42 2024-01-14 12:55:35,143 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2024-01-14 12:55:35,170 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2024-01-14 12:55:35,172 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1087cef0e34ba5a7689c8b4bb8203c42, NAME => 'hbase:namespace,,1705236935101.1087cef0e34ba5a7689c8b4bb8203c42.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp 2024-01-14 12:55:35,189 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1705236935101.1087cef0e34ba5a7689c8b4bb8203c42.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 12:55:35,189 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 1087cef0e34ba5a7689c8b4bb8203c42, disabling compactions & flushes 2024-01-14 12:55:35,189 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1705236935101.1087cef0e34ba5a7689c8b4bb8203c42. 2024-01-14 12:55:35,189 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1705236935101.1087cef0e34ba5a7689c8b4bb8203c42. 2024-01-14 12:55:35,189 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1705236935101.1087cef0e34ba5a7689c8b4bb8203c42. after waiting 0 ms 2024-01-14 12:55:35,189 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1705236935101.1087cef0e34ba5a7689c8b4bb8203c42. 2024-01-14 12:55:35,189 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1705236935101.1087cef0e34ba5a7689c8b4bb8203c42. 2024-01-14 12:55:35,189 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 1087cef0e34ba5a7689c8b4bb8203c42: 2024-01-14 12:55:35,194 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2024-01-14 12:55:35,209 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1705236935101.1087cef0e34ba5a7689c8b4bb8203c42.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1705236935197"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705236935197"}]},"ts":"1705236935197"} 2024-01-14 12:55:35,239 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-14 12:55:35,241 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-14 12:55:35,246 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705236935241"}]},"ts":"1705236935241"} 2024-01-14 12:55:35,249 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2024-01-14 12:55:35,255 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-14 12:55:35,257 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-14 12:55:35,257 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-14 12:55:35,257 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-14 12:55:35,259 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1087cef0e34ba5a7689c8b4bb8203c42, ASSIGN}] 2024-01-14 12:55:35,262 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=1087cef0e34ba5a7689c8b4bb8203c42, ASSIGN 2024-01-14 12:55:35,264 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=1087cef0e34ba5a7689c8b4bb8203c42, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46767,1705236933216; forceNewPlan=false, retain=false 2024-01-14 12:55:35,417 INFO [jenkins-hbase4:39225] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-14 12:55:35,418 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1087cef0e34ba5a7689c8b4bb8203c42, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46767,1705236933216 2024-01-14 12:55:35,418 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1705236935101.1087cef0e34ba5a7689c8b4bb8203c42.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1705236935417"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705236935417"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705236935417"}]},"ts":"1705236935417"} 2024-01-14 12:55:35,424 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 1087cef0e34ba5a7689c8b4bb8203c42, server=jenkins-hbase4.apache.org,46767,1705236933216}] 2024-01-14 12:55:35,579 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46767,1705236933216 2024-01-14 12:55:35,579 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-01-14 12:55:35,582 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45736, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-01-14 12:55:35,588 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1705236935101.1087cef0e34ba5a7689c8b4bb8203c42. 2024-01-14 12:55:35,589 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1087cef0e34ba5a7689c8b4bb8203c42, NAME => 'hbase:namespace,,1705236935101.1087cef0e34ba5a7689c8b4bb8203c42.', STARTKEY => '', ENDKEY => ''} 2024-01-14 12:55:35,590 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 1087cef0e34ba5a7689c8b4bb8203c42 2024-01-14 12:55:35,590 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1705236935101.1087cef0e34ba5a7689c8b4bb8203c42.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 12:55:35,590 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1087cef0e34ba5a7689c8b4bb8203c42 2024-01-14 12:55:35,590 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1087cef0e34ba5a7689c8b4bb8203c42 2024-01-14 12:55:35,592 INFO [StoreOpener-1087cef0e34ba5a7689c8b4bb8203c42-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1087cef0e34ba5a7689c8b4bb8203c42 2024-01-14 12:55:35,595 DEBUG [StoreOpener-1087cef0e34ba5a7689c8b4bb8203c42-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/namespace/1087cef0e34ba5a7689c8b4bb8203c42/info 2024-01-14 12:55:35,595 DEBUG [StoreOpener-1087cef0e34ba5a7689c8b4bb8203c42-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/namespace/1087cef0e34ba5a7689c8b4bb8203c42/info 2024-01-14 12:55:35,595 INFO [StoreOpener-1087cef0e34ba5a7689c8b4bb8203c42-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1087cef0e34ba5a7689c8b4bb8203c42 columnFamilyName info 2024-01-14 12:55:35,596 INFO [StoreOpener-1087cef0e34ba5a7689c8b4bb8203c42-1] regionserver.HStore(310): Store=1087cef0e34ba5a7689c8b4bb8203c42/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 12:55:35,598 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/namespace/1087cef0e34ba5a7689c8b4bb8203c42 2024-01-14 12:55:35,599 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/namespace/1087cef0e34ba5a7689c8b4bb8203c42 2024-01-14 12:55:35,604 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1087cef0e34ba5a7689c8b4bb8203c42 2024-01-14 12:55:35,608 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/namespace/1087cef0e34ba5a7689c8b4bb8203c42/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-14 12:55:35,609 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1087cef0e34ba5a7689c8b4bb8203c42; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65895722, jitterRate=-0.018077224493026733}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-14 12:55:35,609 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1087cef0e34ba5a7689c8b4bb8203c42: 2024-01-14 12:55:35,611 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for hbase:namespace,,1705236935101.1087cef0e34ba5a7689c8b4bb8203c42., pid=6, masterSystemTime=1705236935579 2024-01-14 12:55:35,616 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for hbase:namespace,,1705236935101.1087cef0e34ba5a7689c8b4bb8203c42. 2024-01-14 12:55:35,616 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1705236935101.1087cef0e34ba5a7689c8b4bb8203c42. 2024-01-14 12:55:35,618 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=1087cef0e34ba5a7689c8b4bb8203c42, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46767,1705236933216 2024-01-14 12:55:35,618 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1705236935101.1087cef0e34ba5a7689c8b4bb8203c42.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1705236935617"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1705236935617"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1705236935617"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1705236935617"}]},"ts":"1705236935617"} 2024-01-14 12:55:35,627 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=6, resume processing ppid=5 2024-01-14 12:55:35,628 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 1087cef0e34ba5a7689c8b4bb8203c42, server=jenkins-hbase4.apache.org,46767,1705236933216 in 199 msec 2024-01-14 12:55:35,631 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=5, resume processing ppid=4 2024-01-14 12:55:35,631 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=1087cef0e34ba5a7689c8b4bb8203c42, ASSIGN in 368 msec 2024-01-14 12:55:35,632 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-14 12:55:35,633 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705236935633"}]},"ts":"1705236935633"} 2024-01-14 12:55:35,636 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2024-01-14 12:55:35,640 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2024-01-14 12:55:35,643 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 537 msec 2024-01-14 12:55:35,715 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2024-01-14 12:55:35,721 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2024-01-14 12:55:35,721 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-14 12:55:35,743 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-01-14 12:55:35,746 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45746, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-01-14 12:55:35,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2024-01-14 12:55:35,780 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-01-14 12:55:35,788 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 36 msec 2024-01-14 12:55:35,795 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2024-01-14 12:55:35,807 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-01-14 12:55:35,813 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2024-01-14 12:55:35,822 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2024-01-14 12:55:35,824 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2024-01-14 12:55:35,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1084): Master has completed initialization 2.496sec 2024-01-14 12:55:35,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(103): Quota table not found. Creating... 2024-01-14 12:55:35,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-14 12:55:35,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:quota 2024-01-14 12:55:35,830 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(107): Initializing quota support 2024-01-14 12:55:35,832 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_PRE_OPERATION 2024-01-14 12:55:35,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(59): Namespace State Manager started. 2024-01-14 12:55:35,834 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-14 12:55:35,837 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/hbase/quota/fb246572de1d9acdcf6c8de873cbb51f 2024-01-14 12:55:35,838 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/hbase/quota/fb246572de1d9acdcf6c8de873cbb51f empty. 2024-01-14 12:55:35,840 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/hbase/quota/fb246572de1d9acdcf6c8de873cbb51f 2024-01-14 12:55:35,840 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:quota regions 2024-01-14 12:55:35,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(222): Finished updating state of 2 namespaces. 2024-01-14 12:55:35,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceAuditor(50): NamespaceAuditor started. 2024-01-14 12:55:35,843 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:35,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:35,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2024-01-14 12:55:35,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2024-01-14 12:55:35,847 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39225,1705236931219-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2024-01-14 12:55:35,848 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39225,1705236931219-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2024-01-14 12:55:35,862 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1176): Balancer post startup initialization complete, took 0 seconds 2024-01-14 12:55:35,863 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39225,1705236931219-OldWALsDirSizeChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-14 12:55:35,864 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/hbase/quota/.tabledesc/.tableinfo.0000000001 2024-01-14 12:55:35,866 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(7675): creating {ENCODED => fb246572de1d9acdcf6c8de873cbb51f, NAME => 'hbase:quota,,1705236935828.fb246572de1d9acdcf6c8de873cbb51f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp 2024-01-14 12:55:35,887 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(866): Instantiated hbase:quota,,1705236935828.fb246572de1d9acdcf6c8de873cbb51f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 12:55:35,887 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1604): Closing fb246572de1d9acdcf6c8de873cbb51f, disabling compactions & flushes 2024-01-14 12:55:35,887 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1626): Closing region hbase:quota,,1705236935828.fb246572de1d9acdcf6c8de873cbb51f. 2024-01-14 12:55:35,887 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1705236935828.fb246572de1d9acdcf6c8de873cbb51f. 2024-01-14 12:55:35,888 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1705236935828.fb246572de1d9acdcf6c8de873cbb51f. after waiting 1 ms 2024-01-14 12:55:35,888 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1705236935828.fb246572de1d9acdcf6c8de873cbb51f. 2024-01-14 12:55:35,888 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1838): Closed hbase:quota,,1705236935828.fb246572de1d9acdcf6c8de873cbb51f. 2024-01-14 12:55:35,888 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1558): Region close journal for fb246572de1d9acdcf6c8de873cbb51f: 2024-01-14 12:55:35,892 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ADD_TO_META 2024-01-14 12:55:35,895 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:quota,,1705236935828.fb246572de1d9acdcf6c8de873cbb51f.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1705236935894"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705236935894"}]},"ts":"1705236935894"} 2024-01-14 12:55:35,897 DEBUG [Listener at localhost/35643] zookeeper.ReadOnlyZKClient(139): Connect 0x26bde290 to 127.0.0.1:56570 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-01-14 12:55:35,898 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-14 12:55:35,901 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-14 12:55:35,902 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705236935902"}]},"ts":"1705236935902"} 2024-01-14 12:55:35,903 DEBUG [Listener at localhost/35643] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a92e372, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-01-14 12:55:35,904 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLING in hbase:meta 2024-01-14 12:55:35,913 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-14 12:55:35,915 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-14 12:55:35,915 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-14 12:55:35,915 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-14 12:55:35,915 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=fb246572de1d9acdcf6c8de873cbb51f, ASSIGN}] 2024-01-14 12:55:35,919 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=fb246572de1d9acdcf6c8de873cbb51f, ASSIGN 2024-01-14 12:55:35,919 DEBUG [hconnection-0x64ecc13b-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-01-14 12:55:35,920 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:quota, region=fb246572de1d9acdcf6c8de873cbb51f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43387,1705236933265; forceNewPlan=false, retain=false 2024-01-14 12:55:35,932 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32796, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-01-14 12:55:35,943 INFO [Listener at localhost/35643] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39225,1705236931219 2024-01-14 12:55:35,944 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:55:35,948 DEBUG [Listener at localhost/35643] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-01-14 12:55:36,050 DEBUG [Listener at localhost/35643] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-01-14 12:55:36,071 INFO [jenkins-hbase4:39225] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-14 12:55:36,072 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=fb246572de1d9acdcf6c8de873cbb51f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43387,1705236933265 2024-01-14 12:55:36,072 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:quota,,1705236935828.fb246572de1d9acdcf6c8de873cbb51f.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1705236936071"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705236936071"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705236936071"}]},"ts":"1705236936071"} 2024-01-14 12:55:36,075 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure fb246572de1d9acdcf6c8de873cbb51f, server=jenkins-hbase4.apache.org,43387,1705236933265}] 2024-01-14 12:55:36,153 DEBUG [Listener at localhost/35643] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-01-14 12:55:36,229 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43387,1705236933265 2024-01-14 12:55:36,235 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:quota,,1705236935828.fb246572de1d9acdcf6c8de873cbb51f. 2024-01-14 12:55:36,236 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fb246572de1d9acdcf6c8de873cbb51f, NAME => 'hbase:quota,,1705236935828.fb246572de1d9acdcf6c8de873cbb51f.', STARTKEY => '', ENDKEY => ''} 2024-01-14 12:55:36,236 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table quota fb246572de1d9acdcf6c8de873cbb51f 2024-01-14 12:55:36,236 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:quota,,1705236935828.fb246572de1d9acdcf6c8de873cbb51f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 12:55:36,236 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fb246572de1d9acdcf6c8de873cbb51f 2024-01-14 12:55:36,236 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fb246572de1d9acdcf6c8de873cbb51f 2024-01-14 12:55:36,238 INFO [StoreOpener-fb246572de1d9acdcf6c8de873cbb51f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family q of region fb246572de1d9acdcf6c8de873cbb51f 2024-01-14 12:55:36,240 DEBUG [StoreOpener-fb246572de1d9acdcf6c8de873cbb51f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/quota/fb246572de1d9acdcf6c8de873cbb51f/q 2024-01-14 12:55:36,240 DEBUG [StoreOpener-fb246572de1d9acdcf6c8de873cbb51f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/quota/fb246572de1d9acdcf6c8de873cbb51f/q 2024-01-14 12:55:36,241 INFO [StoreOpener-fb246572de1d9acdcf6c8de873cbb51f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb246572de1d9acdcf6c8de873cbb51f columnFamilyName q 2024-01-14 12:55:36,242 INFO [StoreOpener-fb246572de1d9acdcf6c8de873cbb51f-1] regionserver.HStore(310): Store=fb246572de1d9acdcf6c8de873cbb51f/q, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 12:55:36,242 INFO [StoreOpener-fb246572de1d9acdcf6c8de873cbb51f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family u of region fb246572de1d9acdcf6c8de873cbb51f 2024-01-14 12:55:36,244 DEBUG [StoreOpener-fb246572de1d9acdcf6c8de873cbb51f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/quota/fb246572de1d9acdcf6c8de873cbb51f/u 2024-01-14 12:55:36,244 DEBUG [StoreOpener-fb246572de1d9acdcf6c8de873cbb51f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/quota/fb246572de1d9acdcf6c8de873cbb51f/u 2024-01-14 12:55:36,245 INFO [StoreOpener-fb246572de1d9acdcf6c8de873cbb51f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fb246572de1d9acdcf6c8de873cbb51f columnFamilyName u 2024-01-14 12:55:36,245 INFO [StoreOpener-fb246572de1d9acdcf6c8de873cbb51f-1] regionserver.HStore(310): Store=fb246572de1d9acdcf6c8de873cbb51f/u, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 12:55:36,247 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/quota/fb246572de1d9acdcf6c8de873cbb51f 2024-01-14 12:55:36,248 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/quota/fb246572de1d9acdcf6c8de873cbb51f 2024-01-14 12:55:36,251 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:quota descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2024-01-14 12:55:36,254 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fb246572de1d9acdcf6c8de873cbb51f 2024-01-14 12:55:36,256 DEBUG [Listener at localhost/35643] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-01-14 12:55:36,257 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/quota/fb246572de1d9acdcf6c8de873cbb51f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-14 12:55:36,258 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fb246572de1d9acdcf6c8de873cbb51f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74887885, jitterRate=0.11591644585132599}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2024-01-14 12:55:36,258 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fb246572de1d9acdcf6c8de873cbb51f: 2024-01-14 12:55:36,259 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for hbase:quota,,1705236935828.fb246572de1d9acdcf6c8de873cbb51f., pid=11, masterSystemTime=1705236936229 2024-01-14 12:55:36,262 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for hbase:quota,,1705236935828.fb246572de1d9acdcf6c8de873cbb51f. 2024-01-14 12:55:36,262 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:quota,,1705236935828.fb246572de1d9acdcf6c8de873cbb51f. 2024-01-14 12:55:36,263 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=fb246572de1d9acdcf6c8de873cbb51f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43387,1705236933265 2024-01-14 12:55:36,263 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:quota,,1705236935828.fb246572de1d9acdcf6c8de873cbb51f.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1705236936263"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1705236936263"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1705236936263"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1705236936263"}]},"ts":"1705236936263"} 2024-01-14 12:55:36,269 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=11, resume processing ppid=10 2024-01-14 12:55:36,269 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure fb246572de1d9acdcf6c8de873cbb51f, server=jenkins-hbase4.apache.org,43387,1705236933265 in 191 msec 2024-01-14 12:55:36,273 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=10, resume processing ppid=9 2024-01-14 12:55:36,273 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:quota, region=fb246572de1d9acdcf6c8de873cbb51f, ASSIGN in 354 msec 2024-01-14 12:55:36,274 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-14 12:55:36,274 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705236936274"}]},"ts":"1705236936274"} 2024-01-14 12:55:36,276 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLED in hbase:meta 2024-01-14 12:55:36,280 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_POST_OPERATION 2024-01-14 12:55:36,282 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:quota in 452 msec 2024-01-14 12:55:36,370 DEBUG [Listener at localhost/35643] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-01-14 12:55:36,373 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55098, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2024-01-14 12:55:36,401 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-14 12:55:36,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] procedure2.ProcedureExecutor(1075): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin0 2024-01-14 12:55:36,406 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_PRE_OPERATION 2024-01-14 12:55:36,408 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-14 12:55:36,410 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin0" procId is: 12 2024-01-14 12:55:36,411 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/default/TestQuotaAdmin0/27fc6a9820537cf92a89f6d5429859b7 2024-01-14 12:55:36,411 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/default/TestQuotaAdmin0/27fc6a9820537cf92a89f6d5429859b7 empty. 2024-01-14 12:55:36,412 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/default/TestQuotaAdmin0/27fc6a9820537cf92a89f6d5429859b7 2024-01-14 12:55:36,412 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-01-14 12:55:36,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-01-14 12:55:36,432 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/default/TestQuotaAdmin0/.tabledesc/.tableinfo.0000000001 2024-01-14 12:55:36,433 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(7675): creating {ENCODED => 27fc6a9820537cf92a89f6d5429859b7, NAME => 'TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp 2024-01-14 12:55:36,449 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 12:55:36,449 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1604): Closing 27fc6a9820537cf92a89f6d5429859b7, disabling compactions & flushes 2024-01-14 12:55:36,449 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7. 2024-01-14 12:55:36,449 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7. 2024-01-14 12:55:36,449 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7. after waiting 0 ms 2024-01-14 12:55:36,449 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7. 2024-01-14 12:55:36,449 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7. 2024-01-14 12:55:36,449 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1558): Region close journal for 27fc6a9820537cf92a89f6d5429859b7: 2024-01-14 12:55:36,454 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ADD_TO_META 2024-01-14 12:55:36,455 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705236936455"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705236936455"}]},"ts":"1705236936455"} 2024-01-14 12:55:36,458 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-14 12:55:36,460 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-14 12:55:36,460 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705236936460"}]},"ts":"1705236936460"} 2024-01-14 12:55:36,462 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLING in hbase:meta 2024-01-14 12:55:36,467 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-14 12:55:36,469 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-14 12:55:36,469 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-14 12:55:36,469 DEBUG [PEWorker-5] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-14 12:55:36,469 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=27fc6a9820537cf92a89f6d5429859b7, ASSIGN}] 2024-01-14 12:55:36,471 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=27fc6a9820537cf92a89f6d5429859b7, ASSIGN 2024-01-14 12:55:36,472 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin0, region=27fc6a9820537cf92a89f6d5429859b7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43387,1705236933265; forceNewPlan=false, retain=false 2024-01-14 12:55:36,623 INFO [jenkins-hbase4:39225] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-14 12:55:36,624 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=27fc6a9820537cf92a89f6d5429859b7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43387,1705236933265 2024-01-14 12:55:36,624 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705236936623"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705236936623"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705236936623"}]},"ts":"1705236936623"} 2024-01-14 12:55:36,627 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; OpenRegionProcedure 27fc6a9820537cf92a89f6d5429859b7, server=jenkins-hbase4.apache.org,43387,1705236933265}] 2024-01-14 12:55:36,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-01-14 12:55:36,780 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43387,1705236933265 2024-01-14 12:55:36,786 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7. 2024-01-14 12:55:36,786 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 27fc6a9820537cf92a89f6d5429859b7, NAME => 'TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7.', STARTKEY => '', ENDKEY => ''} 2024-01-14 12:55:36,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin0 27fc6a9820537cf92a89f6d5429859b7 2024-01-14 12:55:36,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 12:55:36,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 27fc6a9820537cf92a89f6d5429859b7 2024-01-14 12:55:36,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 27fc6a9820537cf92a89f6d5429859b7 2024-01-14 12:55:36,789 INFO [StoreOpener-27fc6a9820537cf92a89f6d5429859b7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 27fc6a9820537cf92a89f6d5429859b7 2024-01-14 12:55:36,791 DEBUG [StoreOpener-27fc6a9820537cf92a89f6d5429859b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/default/TestQuotaAdmin0/27fc6a9820537cf92a89f6d5429859b7/cf 2024-01-14 12:55:36,791 DEBUG [StoreOpener-27fc6a9820537cf92a89f6d5429859b7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/default/TestQuotaAdmin0/27fc6a9820537cf92a89f6d5429859b7/cf 2024-01-14 12:55:36,792 INFO [StoreOpener-27fc6a9820537cf92a89f6d5429859b7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 27fc6a9820537cf92a89f6d5429859b7 columnFamilyName cf 2024-01-14 12:55:36,793 INFO [StoreOpener-27fc6a9820537cf92a89f6d5429859b7-1] regionserver.HStore(310): Store=27fc6a9820537cf92a89f6d5429859b7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 12:55:36,795 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/default/TestQuotaAdmin0/27fc6a9820537cf92a89f6d5429859b7 2024-01-14 12:55:36,796 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/default/TestQuotaAdmin0/27fc6a9820537cf92a89f6d5429859b7 2024-01-14 12:55:36,801 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 27fc6a9820537cf92a89f6d5429859b7 2024-01-14 12:55:36,804 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/default/TestQuotaAdmin0/27fc6a9820537cf92a89f6d5429859b7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-14 12:55:36,805 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 27fc6a9820537cf92a89f6d5429859b7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74738127, jitterRate=0.11368487775325775}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-14 12:55:36,805 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 27fc6a9820537cf92a89f6d5429859b7: 2024-01-14 12:55:36,806 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7., pid=14, masterSystemTime=1705236936780 2024-01-14 12:55:36,809 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7. 2024-01-14 12:55:36,809 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7. 2024-01-14 12:55:36,810 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=27fc6a9820537cf92a89f6d5429859b7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43387,1705236933265 2024-01-14 12:55:36,810 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705236936810"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1705236936810"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1705236936810"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1705236936810"}]},"ts":"1705236936810"} 2024-01-14 12:55:36,815 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=14, resume processing ppid=13 2024-01-14 12:55:36,815 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=14, ppid=13, state=SUCCESS; OpenRegionProcedure 27fc6a9820537cf92a89f6d5429859b7, server=jenkins-hbase4.apache.org,43387,1705236933265 in 185 msec 2024-01-14 12:55:36,819 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=13, resume processing ppid=12 2024-01-14 12:55:36,820 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=27fc6a9820537cf92a89f6d5429859b7, ASSIGN in 346 msec 2024-01-14 12:55:36,821 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-14 12:55:36,821 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705236936821"}]},"ts":"1705236936821"} 2024-01-14 12:55:36,823 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLED in hbase:meta 2024-01-14 12:55:36,826 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_POST_OPERATION 2024-01-14 12:55:36,828 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=12, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin0 in 425 msec 2024-01-14 12:55:37,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-01-14 12:55:37,176 INFO [Listener at localhost/35643] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin0, procId: 12 completed 2024-01-14 12:55:37,176 DEBUG [Listener at localhost/35643] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin0 get assigned. Timeout = 60000ms 2024-01-14 12:55:37,177 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:55:37,181 INFO [Listener at localhost/35643] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin0 assigned to meta. Checking AM states. 2024-01-14 12:55:37,181 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:55:37,182 INFO [Listener at localhost/35643] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin0 assigned. 2024-01-14 12:55:37,182 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:55:37,195 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-01-14 12:55:37,198 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55104, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=MasterService 2024-01-14 12:55:37,199 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39225] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-14 12:55:37,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39225] procedure2.ProcedureExecutor(1075): Stored pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin1 2024-01-14 12:55:37,203 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_PRE_OPERATION 2024-01-14 12:55:37,204 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39225] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin1" procId is: 15 2024-01-14 12:55:37,205 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-14 12:55:37,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-01-14 12:55:37,207 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/default/TestQuotaAdmin1/c9f17d6597631e19216a99517ef16380 2024-01-14 12:55:37,209 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/default/TestQuotaAdmin1/c9f17d6597631e19216a99517ef16380 empty. 2024-01-14 12:55:37,210 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/default/TestQuotaAdmin1/c9f17d6597631e19216a99517ef16380 2024-01-14 12:55:37,210 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-01-14 12:55:37,233 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/default/TestQuotaAdmin1/.tabledesc/.tableinfo.0000000001 2024-01-14 12:55:37,235 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(7675): creating {ENCODED => c9f17d6597631e19216a99517ef16380, NAME => 'TestQuotaAdmin1,,1705236937198.c9f17d6597631e19216a99517ef16380.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp 2024-01-14 12:55:37,254 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1705236937198.c9f17d6597631e19216a99517ef16380.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 12:55:37,255 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1604): Closing c9f17d6597631e19216a99517ef16380, disabling compactions & flushes 2024-01-14 12:55:37,255 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1705236937198.c9f17d6597631e19216a99517ef16380. 2024-01-14 12:55:37,255 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1705236937198.c9f17d6597631e19216a99517ef16380. 2024-01-14 12:55:37,255 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1705236937198.c9f17d6597631e19216a99517ef16380. after waiting 0 ms 2024-01-14 12:55:37,255 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1705236937198.c9f17d6597631e19216a99517ef16380. 2024-01-14 12:55:37,255 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1705236937198.c9f17d6597631e19216a99517ef16380. 2024-01-14 12:55:37,255 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1558): Region close journal for c9f17d6597631e19216a99517ef16380: 2024-01-14 12:55:37,260 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ADD_TO_META 2024-01-14 12:55:37,262 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1705236937198.c9f17d6597631e19216a99517ef16380.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705236937262"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705236937262"}]},"ts":"1705236937262"} 2024-01-14 12:55:37,264 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-14 12:55:37,265 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-14 12:55:37,266 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705236937265"}]},"ts":"1705236937265"} 2024-01-14 12:55:37,268 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLING in hbase:meta 2024-01-14 12:55:37,272 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-14 12:55:37,273 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-14 12:55:37,273 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-14 12:55:37,273 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-14 12:55:37,274 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=c9f17d6597631e19216a99517ef16380, ASSIGN}] 2024-01-14 12:55:37,275 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=c9f17d6597631e19216a99517ef16380, ASSIGN 2024-01-14 12:55:37,276 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin1, region=c9f17d6597631e19216a99517ef16380, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46767,1705236933216; forceNewPlan=false, retain=false 2024-01-14 12:55:37,426 INFO [jenkins-hbase4:39225] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-14 12:55:37,427 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=c9f17d6597631e19216a99517ef16380, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46767,1705236933216 2024-01-14 12:55:37,428 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1705236937198.c9f17d6597631e19216a99517ef16380.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705236937427"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705236937427"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705236937427"}]},"ts":"1705236937427"} 2024-01-14 12:55:37,431 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure c9f17d6597631e19216a99517ef16380, server=jenkins-hbase4.apache.org,46767,1705236933216}] 2024-01-14 12:55:37,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-01-14 12:55:37,584 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46767,1705236933216 2024-01-14 12:55:37,590 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin1,,1705236937198.c9f17d6597631e19216a99517ef16380. 2024-01-14 12:55:37,590 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c9f17d6597631e19216a99517ef16380, NAME => 'TestQuotaAdmin1,,1705236937198.c9f17d6597631e19216a99517ef16380.', STARTKEY => '', ENDKEY => ''} 2024-01-14 12:55:37,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin1 c9f17d6597631e19216a99517ef16380 2024-01-14 12:55:37,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1705236937198.c9f17d6597631e19216a99517ef16380.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 12:55:37,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c9f17d6597631e19216a99517ef16380 2024-01-14 12:55:37,591 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c9f17d6597631e19216a99517ef16380 2024-01-14 12:55:37,593 INFO [StoreOpener-c9f17d6597631e19216a99517ef16380-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c9f17d6597631e19216a99517ef16380 2024-01-14 12:55:37,595 DEBUG [StoreOpener-c9f17d6597631e19216a99517ef16380-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/default/TestQuotaAdmin1/c9f17d6597631e19216a99517ef16380/cf 2024-01-14 12:55:37,595 DEBUG [StoreOpener-c9f17d6597631e19216a99517ef16380-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/default/TestQuotaAdmin1/c9f17d6597631e19216a99517ef16380/cf 2024-01-14 12:55:37,596 INFO [StoreOpener-c9f17d6597631e19216a99517ef16380-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c9f17d6597631e19216a99517ef16380 columnFamilyName cf 2024-01-14 12:55:37,597 INFO [StoreOpener-c9f17d6597631e19216a99517ef16380-1] regionserver.HStore(310): Store=c9f17d6597631e19216a99517ef16380/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 12:55:37,598 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/default/TestQuotaAdmin1/c9f17d6597631e19216a99517ef16380 2024-01-14 12:55:37,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/default/TestQuotaAdmin1/c9f17d6597631e19216a99517ef16380 2024-01-14 12:55:37,605 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c9f17d6597631e19216a99517ef16380 2024-01-14 12:55:37,610 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/default/TestQuotaAdmin1/c9f17d6597631e19216a99517ef16380/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-14 12:55:37,611 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c9f17d6597631e19216a99517ef16380; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58791477, jitterRate=-0.12393872439861298}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-14 12:55:37,611 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c9f17d6597631e19216a99517ef16380: 2024-01-14 12:55:37,612 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestQuotaAdmin1,,1705236937198.c9f17d6597631e19216a99517ef16380., pid=17, masterSystemTime=1705236937584 2024-01-14 12:55:37,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestQuotaAdmin1,,1705236937198.c9f17d6597631e19216a99517ef16380. 2024-01-14 12:55:37,615 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin1,,1705236937198.c9f17d6597631e19216a99517ef16380. 2024-01-14 12:55:37,616 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=c9f17d6597631e19216a99517ef16380, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46767,1705236933216 2024-01-14 12:55:37,616 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin1,,1705236937198.c9f17d6597631e19216a99517ef16380.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705236937616"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1705236937616"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1705236937616"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1705236937616"}]},"ts":"1705236937616"} 2024-01-14 12:55:37,621 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=17, resume processing ppid=16 2024-01-14 12:55:37,621 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure c9f17d6597631e19216a99517ef16380, server=jenkins-hbase4.apache.org,46767,1705236933216 in 187 msec 2024-01-14 12:55:37,625 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=16, resume processing ppid=15 2024-01-14 12:55:37,626 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=c9f17d6597631e19216a99517ef16380, ASSIGN in 347 msec 2024-01-14 12:55:37,627 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-14 12:55:37,628 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705236937627"}]},"ts":"1705236937627"} 2024-01-14 12:55:37,630 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLED in hbase:meta 2024-01-14 12:55:37,633 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_POST_OPERATION 2024-01-14 12:55:37,635 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=15, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin1 in 434 msec 2024-01-14 12:55:37,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-01-14 12:55:37,960 INFO [Listener at localhost/35643] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin1, procId: 15 completed 2024-01-14 12:55:37,960 DEBUG [Listener at localhost/35643] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin1 get assigned. Timeout = 60000ms 2024-01-14 12:55:37,960 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:55:37,965 INFO [Listener at localhost/35643] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin1 assigned to meta. Checking AM states. 2024-01-14 12:55:37,965 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:55:37,965 INFO [Listener at localhost/35643] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin1 assigned. 2024-01-14 12:55:37,965 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:55:37,972 DEBUG [hconnection-0x64ecc13b-shared-pool-5] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-01-14 12:55:37,975 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45750, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-01-14 12:55:37,977 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-01-14 12:55:37,981 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:55106, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService 2024-01-14 12:55:37,983 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-14 12:55:37,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] procedure2.ProcedureExecutor(1075): Stored pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin2 2024-01-14 12:55:37,988 DEBUG [hconnection-0x74a1220e-metaLookup-shared--pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-01-14 12:55:37,988 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_PRE_OPERATION 2024-01-14 12:55:37,989 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin2" procId is: 18 2024-01-14 12:55:37,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-01-14 12:55:37,991 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:32806, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2024-01-14 12:55:37,991 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-14 12:55:37,993 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/default/TestQuotaAdmin2/a2ae266fed766c80613c912ecfd7614b 2024-01-14 12:55:37,994 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/default/TestQuotaAdmin2/a2ae266fed766c80613c912ecfd7614b empty. 2024-01-14 12:55:37,995 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/default/TestQuotaAdmin2/a2ae266fed766c80613c912ecfd7614b 2024-01-14 12:55:37,995 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-01-14 12:55:38,015 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/default/TestQuotaAdmin2/.tabledesc/.tableinfo.0000000001 2024-01-14 12:55:38,016 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(7675): creating {ENCODED => a2ae266fed766c80613c912ecfd7614b, NAME => 'TestQuotaAdmin2,,1705236937983.a2ae266fed766c80613c912ecfd7614b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp 2024-01-14 12:55:38,029 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1705236937983.a2ae266fed766c80613c912ecfd7614b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 12:55:38,029 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1604): Closing a2ae266fed766c80613c912ecfd7614b, disabling compactions & flushes 2024-01-14 12:55:38,029 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1705236937983.a2ae266fed766c80613c912ecfd7614b. 2024-01-14 12:55:38,029 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1705236937983.a2ae266fed766c80613c912ecfd7614b. 2024-01-14 12:55:38,030 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1705236937983.a2ae266fed766c80613c912ecfd7614b. after waiting 0 ms 2024-01-14 12:55:38,030 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1705236937983.a2ae266fed766c80613c912ecfd7614b. 2024-01-14 12:55:38,030 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1705236937983.a2ae266fed766c80613c912ecfd7614b. 2024-01-14 12:55:38,030 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1558): Region close journal for a2ae266fed766c80613c912ecfd7614b: 2024-01-14 12:55:38,033 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ADD_TO_META 2024-01-14 12:55:38,035 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1705236937983.a2ae266fed766c80613c912ecfd7614b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705236938035"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705236938035"}]},"ts":"1705236938035"} 2024-01-14 12:55:38,037 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-14 12:55:38,038 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-14 12:55:38,039 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705236938039"}]},"ts":"1705236938039"} 2024-01-14 12:55:38,041 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLING in hbase:meta 2024-01-14 12:55:38,047 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-14 12:55:38,048 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-14 12:55:38,048 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-14 12:55:38,048 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-14 12:55:38,049 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=a2ae266fed766c80613c912ecfd7614b, ASSIGN}] 2024-01-14 12:55:38,050 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=a2ae266fed766c80613c912ecfd7614b, ASSIGN 2024-01-14 12:55:38,051 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin2, region=a2ae266fed766c80613c912ecfd7614b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46767,1705236933216; forceNewPlan=false, retain=false 2024-01-14 12:55:38,202 INFO [jenkins-hbase4:39225] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-14 12:55:38,203 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=a2ae266fed766c80613c912ecfd7614b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46767,1705236933216 2024-01-14 12:55:38,203 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1705236937983.a2ae266fed766c80613c912ecfd7614b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705236938203"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705236938203"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705236938203"}]},"ts":"1705236938203"} 2024-01-14 12:55:38,206 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE; OpenRegionProcedure a2ae266fed766c80613c912ecfd7614b, server=jenkins-hbase4.apache.org,46767,1705236933216}] 2024-01-14 12:55:38,243 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-01-14 12:55:38,360 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46767,1705236933216 2024-01-14 12:55:38,365 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin2,,1705236937983.a2ae266fed766c80613c912ecfd7614b. 2024-01-14 12:55:38,365 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a2ae266fed766c80613c912ecfd7614b, NAME => 'TestQuotaAdmin2,,1705236937983.a2ae266fed766c80613c912ecfd7614b.', STARTKEY => '', ENDKEY => ''} 2024-01-14 12:55:38,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin2 a2ae266fed766c80613c912ecfd7614b 2024-01-14 12:55:38,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1705236937983.a2ae266fed766c80613c912ecfd7614b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 12:55:38,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a2ae266fed766c80613c912ecfd7614b 2024-01-14 12:55:38,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a2ae266fed766c80613c912ecfd7614b 2024-01-14 12:55:38,368 INFO [StoreOpener-a2ae266fed766c80613c912ecfd7614b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a2ae266fed766c80613c912ecfd7614b 2024-01-14 12:55:38,370 DEBUG [StoreOpener-a2ae266fed766c80613c912ecfd7614b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/default/TestQuotaAdmin2/a2ae266fed766c80613c912ecfd7614b/cf 2024-01-14 12:55:38,370 DEBUG [StoreOpener-a2ae266fed766c80613c912ecfd7614b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/default/TestQuotaAdmin2/a2ae266fed766c80613c912ecfd7614b/cf 2024-01-14 12:55:38,370 INFO [StoreOpener-a2ae266fed766c80613c912ecfd7614b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a2ae266fed766c80613c912ecfd7614b columnFamilyName cf 2024-01-14 12:55:38,371 INFO [StoreOpener-a2ae266fed766c80613c912ecfd7614b-1] regionserver.HStore(310): Store=a2ae266fed766c80613c912ecfd7614b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 12:55:38,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/default/TestQuotaAdmin2/a2ae266fed766c80613c912ecfd7614b 2024-01-14 12:55:38,374 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/default/TestQuotaAdmin2/a2ae266fed766c80613c912ecfd7614b 2024-01-14 12:55:38,378 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a2ae266fed766c80613c912ecfd7614b 2024-01-14 12:55:38,381 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/default/TestQuotaAdmin2/a2ae266fed766c80613c912ecfd7614b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-14 12:55:38,382 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a2ae266fed766c80613c912ecfd7614b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71593115, jitterRate=0.06682054698467255}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-14 12:55:38,382 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a2ae266fed766c80613c912ecfd7614b: 2024-01-14 12:55:38,383 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestQuotaAdmin2,,1705236937983.a2ae266fed766c80613c912ecfd7614b., pid=20, masterSystemTime=1705236938359 2024-01-14 12:55:38,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestQuotaAdmin2,,1705236937983.a2ae266fed766c80613c912ecfd7614b. 2024-01-14 12:55:38,386 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin2,,1705236937983.a2ae266fed766c80613c912ecfd7614b. 2024-01-14 12:55:38,387 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=a2ae266fed766c80613c912ecfd7614b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46767,1705236933216 2024-01-14 12:55:38,387 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin2,,1705236937983.a2ae266fed766c80613c912ecfd7614b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705236938387"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1705236938387"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1705236938387"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1705236938387"}]},"ts":"1705236938387"} 2024-01-14 12:55:38,392 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=20, resume processing ppid=19 2024-01-14 12:55:38,392 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=20, ppid=19, state=SUCCESS; OpenRegionProcedure a2ae266fed766c80613c912ecfd7614b, server=jenkins-hbase4.apache.org,46767,1705236933216 in 183 msec 2024-01-14 12:55:38,396 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=19, resume processing ppid=18 2024-01-14 12:55:38,396 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=19, ppid=18, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=a2ae266fed766c80613c912ecfd7614b, ASSIGN in 344 msec 2024-01-14 12:55:38,397 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-14 12:55:38,397 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705236938397"}]},"ts":"1705236938397"} 2024-01-14 12:55:38,399 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLED in hbase:meta 2024-01-14 12:55:38,403 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_POST_OPERATION 2024-01-14 12:55:38,405 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=18, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin2 in 419 msec 2024-01-14 12:55:38,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-01-14 12:55:38,745 INFO [Listener at localhost/35643] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin2, procId: 18 completed 2024-01-14 12:55:38,745 DEBUG [Listener at localhost/35643] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin2 get assigned. Timeout = 60000ms 2024-01-14 12:55:38,746 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:55:38,750 INFO [Listener at localhost/35643] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin2 assigned to meta. Checking AM states. 2024-01-14 12:55:38,750 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:55:38,750 INFO [Listener at localhost/35643] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin2 assigned. 2024-01-14 12:55:38,750 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:55:38,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.HMaster$15(3020): Client=jenkins//172.31.14.131 creating {NAME => 'TestNs'} 2024-01-14 12:55:38,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] procedure2.ProcedureExecutor(1075): Stored pid=21, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=TestNs 2024-01-14 12:55:38,776 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-01-14 12:55:38,784 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-01-14 12:55:38,791 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=21, state=SUCCESS; CreateNamespaceProcedure, namespace=TestNs in 22 msec 2024-01-14 12:55:39,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-01-14 12:55:39,031 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-14 12:55:39,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] procedure2.ProcedureExecutor(1075): Stored pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestNs:TestTable 2024-01-14 12:55:39,036 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_PRE_OPERATION 2024-01-14 12:55:39,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "TestNs" qualifier: "TestTable" procId is: 22 2024-01-14 12:55:39,037 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-14 12:55:39,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-01-14 12:55:39,041 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/TestNs/TestTable/1740d9a97228d4fb5442deb7cf534ec3 2024-01-14 12:55:39,041 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/TestNs/TestTable/fffbbe4d4acb310155f0fe854ef1d578 2024-01-14 12:55:39,042 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/TestNs/TestTable/fffbbe4d4acb310155f0fe854ef1d578 empty. 2024-01-14 12:55:39,042 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/TestNs/TestTable/1740d9a97228d4fb5442deb7cf534ec3 empty. 2024-01-14 12:55:39,042 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/TestNs/TestTable/fffbbe4d4acb310155f0fe854ef1d578 2024-01-14 12:55:39,043 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/TestNs/TestTable/1740d9a97228d4fb5442deb7cf534ec3 2024-01-14 12:55:39,043 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-01-14 12:55:39,061 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/TestNs/TestTable/.tabledesc/.tableinfo.0000000001 2024-01-14 12:55:39,063 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(7675): creating {ENCODED => fffbbe4d4acb310155f0fe854ef1d578, NAME => 'TestNs:TestTable,1,1705236939031.fffbbe4d4acb310155f0fe854ef1d578.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp 2024-01-14 12:55:39,063 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(7675): creating {ENCODED => 1740d9a97228d4fb5442deb7cf534ec3, NAME => 'TestNs:TestTable,,1705236939031.1740d9a97228d4fb5442deb7cf534ec3.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp 2024-01-14 12:55:39,088 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1705236939031.1740d9a97228d4fb5442deb7cf534ec3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 12:55:39,088 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1604): Closing 1740d9a97228d4fb5442deb7cf534ec3, disabling compactions & flushes 2024-01-14 12:55:39,088 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1705236939031.1740d9a97228d4fb5442deb7cf534ec3. 2024-01-14 12:55:39,088 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1705236939031.1740d9a97228d4fb5442deb7cf534ec3. 2024-01-14 12:55:39,088 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1705236939031.1740d9a97228d4fb5442deb7cf534ec3. after waiting 0 ms 2024-01-14 12:55:39,088 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1705236939031.1740d9a97228d4fb5442deb7cf534ec3. 2024-01-14 12:55:39,088 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1705236939031.1740d9a97228d4fb5442deb7cf534ec3. 2024-01-14 12:55:39,089 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1558): Region close journal for 1740d9a97228d4fb5442deb7cf534ec3: 2024-01-14 12:55:39,089 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1705236939031.fffbbe4d4acb310155f0fe854ef1d578.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 12:55:39,090 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1604): Closing fffbbe4d4acb310155f0fe854ef1d578, disabling compactions & flushes 2024-01-14 12:55:39,090 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1705236939031.fffbbe4d4acb310155f0fe854ef1d578. 2024-01-14 12:55:39,090 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1705236939031.fffbbe4d4acb310155f0fe854ef1d578. 2024-01-14 12:55:39,090 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1705236939031.fffbbe4d4acb310155f0fe854ef1d578. after waiting 0 ms 2024-01-14 12:55:39,090 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1705236939031.fffbbe4d4acb310155f0fe854ef1d578. 2024-01-14 12:55:39,090 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1705236939031.fffbbe4d4acb310155f0fe854ef1d578. 2024-01-14 12:55:39,090 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1558): Region close journal for fffbbe4d4acb310155f0fe854ef1d578: 2024-01-14 12:55:39,095 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ADD_TO_META 2024-01-14 12:55:39,096 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,,1705236939031.1740d9a97228d4fb5442deb7cf534ec3.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705236939096"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705236939096"}]},"ts":"1705236939096"} 2024-01-14 12:55:39,096 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1705236939031.fffbbe4d4acb310155f0fe854ef1d578.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705236939096"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705236939096"}]},"ts":"1705236939096"} 2024-01-14 12:55:39,100 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2024-01-14 12:55:39,101 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-14 12:55:39,102 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705236939102"}]},"ts":"1705236939102"} 2024-01-14 12:55:39,104 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLING in hbase:meta 2024-01-14 12:55:39,110 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-14 12:55:39,113 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-14 12:55:39,113 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-14 12:55:39,113 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-14 12:55:39,113 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=1740d9a97228d4fb5442deb7cf534ec3, ASSIGN}, {pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=fffbbe4d4acb310155f0fe854ef1d578, ASSIGN}] 2024-01-14 12:55:39,115 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=fffbbe4d4acb310155f0fe854ef1d578, ASSIGN 2024-01-14 12:55:39,116 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=1740d9a97228d4fb5442deb7cf534ec3, ASSIGN 2024-01-14 12:55:39,117 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=1740d9a97228d4fb5442deb7cf534ec3, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43387,1705236933265; forceNewPlan=false, retain=false 2024-01-14 12:55:39,117 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=fffbbe4d4acb310155f0fe854ef1d578, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,46767,1705236933216; forceNewPlan=false, retain=false 2024-01-14 12:55:39,267 INFO [jenkins-hbase4:39225] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2024-01-14 12:55:39,268 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=fffbbe4d4acb310155f0fe854ef1d578, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,46767,1705236933216 2024-01-14 12:55:39,268 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=1740d9a97228d4fb5442deb7cf534ec3, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43387,1705236933265 2024-01-14 12:55:39,269 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1705236939031.fffbbe4d4acb310155f0fe854ef1d578.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705236939268"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705236939268"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705236939268"}]},"ts":"1705236939268"} 2024-01-14 12:55:39,269 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1705236939031.1740d9a97228d4fb5442deb7cf534ec3.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705236939268"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705236939268"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705236939268"}]},"ts":"1705236939268"} 2024-01-14 12:55:39,271 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure fffbbe4d4acb310155f0fe854ef1d578, server=jenkins-hbase4.apache.org,46767,1705236933216}] 2024-01-14 12:55:39,273 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=26, ppid=23, state=RUNNABLE; OpenRegionProcedure 1740d9a97228d4fb5442deb7cf534ec3, server=jenkins-hbase4.apache.org,43387,1705236933265}] 2024-01-14 12:55:39,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-01-14 12:55:39,424 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46767,1705236933216 2024-01-14 12:55:39,425 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43387,1705236933265 2024-01-14 12:55:39,429 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,1,1705236939031.fffbbe4d4acb310155f0fe854ef1d578. 2024-01-14 12:55:39,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fffbbe4d4acb310155f0fe854ef1d578, NAME => 'TestNs:TestTable,1,1705236939031.fffbbe4d4acb310155f0fe854ef1d578.', STARTKEY => '1', ENDKEY => ''} 2024-01-14 12:55:39,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable fffbbe4d4acb310155f0fe854ef1d578 2024-01-14 12:55:39,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1705236939031.fffbbe4d4acb310155f0fe854ef1d578.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 12:55:39,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,,1705236939031.1740d9a97228d4fb5442deb7cf534ec3. 2024-01-14 12:55:39,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fffbbe4d4acb310155f0fe854ef1d578 2024-01-14 12:55:39,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fffbbe4d4acb310155f0fe854ef1d578 2024-01-14 12:55:39,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1740d9a97228d4fb5442deb7cf534ec3, NAME => 'TestNs:TestTable,,1705236939031.1740d9a97228d4fb5442deb7cf534ec3.', STARTKEY => '', ENDKEY => '1'} 2024-01-14 12:55:39,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable 1740d9a97228d4fb5442deb7cf534ec3 2024-01-14 12:55:39,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1705236939031.1740d9a97228d4fb5442deb7cf534ec3.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-14 12:55:39,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1740d9a97228d4fb5442deb7cf534ec3 2024-01-14 12:55:39,431 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1740d9a97228d4fb5442deb7cf534ec3 2024-01-14 12:55:39,432 INFO [StoreOpener-fffbbe4d4acb310155f0fe854ef1d578-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region fffbbe4d4acb310155f0fe854ef1d578 2024-01-14 12:55:39,432 INFO [StoreOpener-1740d9a97228d4fb5442deb7cf534ec3-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 1740d9a97228d4fb5442deb7cf534ec3 2024-01-14 12:55:39,434 DEBUG [StoreOpener-fffbbe4d4acb310155f0fe854ef1d578-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/TestNs/TestTable/fffbbe4d4acb310155f0fe854ef1d578/cf 2024-01-14 12:55:39,434 DEBUG [StoreOpener-fffbbe4d4acb310155f0fe854ef1d578-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/TestNs/TestTable/fffbbe4d4acb310155f0fe854ef1d578/cf 2024-01-14 12:55:39,434 DEBUG [StoreOpener-1740d9a97228d4fb5442deb7cf534ec3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/TestNs/TestTable/1740d9a97228d4fb5442deb7cf534ec3/cf 2024-01-14 12:55:39,434 DEBUG [StoreOpener-1740d9a97228d4fb5442deb7cf534ec3-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/TestNs/TestTable/1740d9a97228d4fb5442deb7cf534ec3/cf 2024-01-14 12:55:39,435 INFO [StoreOpener-fffbbe4d4acb310155f0fe854ef1d578-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fffbbe4d4acb310155f0fe854ef1d578 columnFamilyName cf 2024-01-14 12:55:39,435 INFO [StoreOpener-1740d9a97228d4fb5442deb7cf534ec3-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1740d9a97228d4fb5442deb7cf534ec3 columnFamilyName cf 2024-01-14 12:55:39,436 INFO [StoreOpener-fffbbe4d4acb310155f0fe854ef1d578-1] regionserver.HStore(310): Store=fffbbe4d4acb310155f0fe854ef1d578/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 12:55:39,436 INFO [StoreOpener-1740d9a97228d4fb5442deb7cf534ec3-1] regionserver.HStore(310): Store=1740d9a97228d4fb5442deb7cf534ec3/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-14 12:55:39,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/TestNs/TestTable/1740d9a97228d4fb5442deb7cf534ec3 2024-01-14 12:55:39,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/TestNs/TestTable/fffbbe4d4acb310155f0fe854ef1d578 2024-01-14 12:55:39,439 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/TestNs/TestTable/1740d9a97228d4fb5442deb7cf534ec3 2024-01-14 12:55:39,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/TestNs/TestTable/fffbbe4d4acb310155f0fe854ef1d578 2024-01-14 12:55:39,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fffbbe4d4acb310155f0fe854ef1d578 2024-01-14 12:55:39,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1740d9a97228d4fb5442deb7cf534ec3 2024-01-14 12:55:39,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/TestNs/TestTable/fffbbe4d4acb310155f0fe854ef1d578/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-14 12:55:39,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/TestNs/TestTable/1740d9a97228d4fb5442deb7cf534ec3/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-14 12:55:39,449 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fffbbe4d4acb310155f0fe854ef1d578; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70142888, jitterRate=0.04521048069000244}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-14 12:55:39,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fffbbe4d4acb310155f0fe854ef1d578: 2024-01-14 12:55:39,449 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1740d9a97228d4fb5442deb7cf534ec3; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61659216, jitterRate=-0.08120608329772949}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-14 12:55:39,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1740d9a97228d4fb5442deb7cf534ec3: 2024-01-14 12:55:39,450 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestNs:TestTable,,1705236939031.1740d9a97228d4fb5442deb7cf534ec3., pid=26, masterSystemTime=1705236939425 2024-01-14 12:55:39,450 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestNs:TestTable,1,1705236939031.fffbbe4d4acb310155f0fe854ef1d578., pid=25, masterSystemTime=1705236939424 2024-01-14 12:55:39,453 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestNs:TestTable,1,1705236939031.fffbbe4d4acb310155f0fe854ef1d578. 2024-01-14 12:55:39,453 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,1,1705236939031.fffbbe4d4acb310155f0fe854ef1d578. 2024-01-14 12:55:39,453 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=fffbbe4d4acb310155f0fe854ef1d578, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,46767,1705236933216 2024-01-14 12:55:39,454 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,1,1705236939031.fffbbe4d4acb310155f0fe854ef1d578.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705236939453"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1705236939453"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1705236939453"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1705236939453"}]},"ts":"1705236939453"} 2024-01-14 12:55:39,454 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestNs:TestTable,,1705236939031.1740d9a97228d4fb5442deb7cf534ec3. 2024-01-14 12:55:39,454 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,,1705236939031.1740d9a97228d4fb5442deb7cf534ec3. 2024-01-14 12:55:39,454 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=1740d9a97228d4fb5442deb7cf534ec3, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43387,1705236933265 2024-01-14 12:55:39,455 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,,1705236939031.1740d9a97228d4fb5442deb7cf534ec3.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705236939454"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1705236939454"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1705236939454"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1705236939454"}]},"ts":"1705236939454"} 2024-01-14 12:55:39,459 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=25, resume processing ppid=24 2024-01-14 12:55:39,459 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure fffbbe4d4acb310155f0fe854ef1d578, server=jenkins-hbase4.apache.org,46767,1705236933216 in 186 msec 2024-01-14 12:55:39,460 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=26, resume processing ppid=23 2024-01-14 12:55:39,461 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=26, ppid=23, state=SUCCESS; OpenRegionProcedure 1740d9a97228d4fb5442deb7cf534ec3, server=jenkins-hbase4.apache.org,43387,1705236933265 in 186 msec 2024-01-14 12:55:39,462 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=24, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=fffbbe4d4acb310155f0fe854ef1d578, ASSIGN in 346 msec 2024-01-14 12:55:39,464 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=23, resume processing ppid=22 2024-01-14 12:55:39,464 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=23, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=1740d9a97228d4fb5442deb7cf534ec3, ASSIGN in 348 msec 2024-01-14 12:55:39,465 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-14 12:55:39,465 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705236939465"}]},"ts":"1705236939465"} 2024-01-14 12:55:39,467 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLED in hbase:meta 2024-01-14 12:55:39,470 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_POST_OPERATION 2024-01-14 12:55:39,473 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=22, state=SUCCESS; CreateTableProcedure table=TestNs:TestTable in 439 msec 2024-01-14 12:55:39,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-01-14 12:55:39,792 INFO [Listener at localhost/35643] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: TestNs:TestTable, procId: 22 completed 2024-01-14 12:55:39,792 DEBUG [Listener at localhost/35643] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestNs:TestTable get assigned. Timeout = 60000ms 2024-01-14 12:55:39,792 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:55:39,796 INFO [Listener at localhost/35643] hbase.HBaseTestingUtility(3484): All regions for table TestNs:TestTable assigned to meta. Checking AM states. 2024-01-14 12:55:39,796 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:55:39,796 INFO [Listener at localhost/35643] hbase.HBaseTestingUtility(3504): All regions for table TestNs:TestTable assigned. 2024-01-14 12:55:39,796 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:55:39,841 INFO [Listener at localhost/35643] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=309, OpenFileDescriptor=634, MaxFileDescriptor=60000, SystemLoadAverage=399, ProcessCount=168, AvailableMemoryMB=12901 2024-01-14 12:55:40,164 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:55:40,165 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 12:55:40,165 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705240539913 bypass), TestNs=QuotaState(ts=1705240539913 bypass)} 2024-01-14 12:55:40,165 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705240539913 bypass), TestQuotaAdmin2=QuotaState(ts=1705240539913 bypass), TestQuotaAdmin1=QuotaState(ts=1705240539913 bypass)} 2024-01-14 12:55:40,165 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705240539913 [ TestNs:TestTable ])} 2024-01-14 12:55:40,165 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705240539913 bypass)} 2024-01-14 12:55:40,415 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:55:40,416 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 12:55:40,416 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705240539913 bypass), TestNs=QuotaState(ts=1705240539913 bypass)} 2024-01-14 12:55:40,416 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705240539913 bypass), TestNs:TestTable=QuotaState(ts=1705240539913 bypass)} 2024-01-14 12:55:40,416 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705240539913 [ TestNs:TestTable ])} 2024-01-14 12:55:40,416 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705240539913 bypass)} 2024-01-14 12:55:40,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:55:40,433 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] ipc.CallRunner(144): callId: 90 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:45750 deadline: 1705236950431, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:55:40,439 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2024-01-14 12:55:40,531 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2024-01-14 12:55:40,533 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestNs:TestTable' 2024-01-14 12:55:40,533 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin2' 2024-01-14 12:55:40,533 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin1' 2024-01-14 12:55:40,534 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin0' 2024-01-14 12:55:40,534 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2024-01-14 12:55:40,535 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:quota' 2024-01-14 12:55:40,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:55:40,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] ipc.CallRunner(144): callId: 92 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:45750 deadline: 1705236950431, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:55:41,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:55:41,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] ipc.CallRunner(144): callId: 94 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:45750 deadline: 1705236950431, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:55:41,377 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-01-14 12:55:41,377 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver Metrics about HBase MasterObservers 2024-01-14 12:55:41,378 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-01-14 12:55:41,378 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2024-01-14 12:55:41,953 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:55:41,954 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] ipc.CallRunner(144): callId: 96 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:45750 deadline: 1705236950431, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:55:43,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:55:43,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] ipc.CallRunner(144): callId: 98 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:45750 deadline: 1705236950432, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:55:45,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:55:45,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] ipc.CallRunner(144): callId: 100 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:45750 deadline: 1705236950431, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:55:45,737 ERROR [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10355: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1705236939031.fffbbe4d4acb310155f0fe854ef1d578., hostname=jenkins-hbase4.apache.org,46767,1705236933216, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-14 12:55:45,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:55:45,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] ipc.CallRunner(144): callId: 101 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:45750 deadline: 1705236955741, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:55:45,997 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:55:45,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] ipc.CallRunner(144): callId: 103 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:45750 deadline: 1705236955741, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:55:46,503 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:55:46,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] ipc.CallRunner(144): callId: 105 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:45750 deadline: 1705236955740, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:55:47,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:55:47,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] ipc.CallRunner(144): callId: 107 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:45750 deadline: 1705236955740, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:55:48,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:55:48,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] ipc.CallRunner(144): callId: 109 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:45750 deadline: 1705236955741, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:55:51,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:55:51,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] ipc.CallRunner(144): callId: 111 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:45750 deadline: 1705236955741, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:55:51,048 ERROR [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10323: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1705236939031.fffbbe4d4acb310155f0fe854ef1d578., hostname=jenkins-hbase4.apache.org,46767,1705236933216, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-14 12:55:51,310 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:55:51,311 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 12:55:51,311 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705244139913 bypass), TestNs=QuotaState(ts=1705244139913 bypass)} 2024-01-14 12:55:51,311 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705244139913 bypass), TestQuotaAdmin2=QuotaState(ts=1705244139913 bypass), TestQuotaAdmin1=QuotaState(ts=1705244139913 bypass)} 2024-01-14 12:55:51,311 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705244139913 bypass)} 2024-01-14 12:55:51,311 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705244139913 bypass)} 2024-01-14 12:55:51,561 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:55:51,562 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 12:55:51,562 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705244139913 bypass), TestNs=QuotaState(ts=1705244139913 bypass)} 2024-01-14 12:55:51,562 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705244139913 bypass), TestNs:TestTable=QuotaState(ts=1705244139913 bypass)} 2024-01-14 12:55:51,562 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705244139913 bypass)} 2024-01-14 12:55:51,562 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705244139913 bypass)} 2024-01-14 12:55:51,576 INFO [Listener at localhost/35643] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=291 (was 309), OpenFileDescriptor=601 (was 634), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=333 (was 399), ProcessCount=168 (was 168), AvailableMemoryMB=14394 (was 12901) - AvailableMemoryMB LEAK? - 2024-01-14 12:55:51,589 INFO [Listener at localhost/35643] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=291, OpenFileDescriptor=601, MaxFileDescriptor=60000, SystemLoadAverage=333, ProcessCount=168, AvailableMemoryMB=14393 2024-01-14 12:55:51,853 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:55:51,853 INFO [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-01-14 12:55:52,104 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 12:55:52,105 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705247740013 bypass), TestNs=QuotaState(ts=1705247740013 bypass)} 2024-01-14 12:55:52,106 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705247740013 bypass), TestQuotaAdmin2=QuotaState(ts=1705247740013 bypass), TestQuotaAdmin1=QuotaState(ts=1705247740013 bypass)} 2024-01-14 12:55:52,106 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705247740013 [ default ])} 2024-01-14 12:55:52,106 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705247740013 bypass)} 2024-01-14 12:55:52,357 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:55:52,357 INFO [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-01-14 12:55:52,607 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 12:55:52,609 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705247740113 bypass), TestNs=QuotaState(ts=1705247740113 bypass)} 2024-01-14 12:55:52,610 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705247740113 bypass), TestNs:TestTable=QuotaState(ts=1705247740113 bypass)} 2024-01-14 12:55:52,610 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705247740113 [ default ])} 2024-01-14 12:55:52,610 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705247740113 bypass)} 2024-01-14 12:55:52,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-14 12:55:52,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 123 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:32796 deadline: 1705236962622, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-14 12:55:52,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-14 12:55:52,877 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 125 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:32796 deadline: 1705236962622, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-14 12:55:53,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-14 12:55:53,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 127 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:32796 deadline: 1705236962623, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-14 12:55:54,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-14 12:55:54,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 129 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:32796 deadline: 1705236962622, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-14 12:55:55,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-14 12:55:55,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 131 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:32796 deadline: 1705236962622, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-14 12:55:57,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-14 12:55:57,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 133 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:32796 deadline: 1705236962622, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-14 12:55:57,913 ERROR [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10320: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7., hostname=jenkins-hbase4.apache.org,43387,1705236933265, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:199) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-14 12:55:57,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 12:55:57,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 140 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:32796 deadline: 1705236967935, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 12:55:58,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 12:55:58,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 142 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:32796 deadline: 1705236967935, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 12:55:58,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 12:55:58,698 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 144 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:32796 deadline: 1705236967934, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 12:55:59,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 12:55:59,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 146 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:32796 deadline: 1705236967934, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 12:56:00,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 12:56:00,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 148 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:32796 deadline: 1705236967934, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 12:56:03,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 12:56:03,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 150 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:32796 deadline: 1705236967935, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 12:56:03,232 ERROR [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10303: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7., hostname=jenkins-hbase4.apache.org,43387,1705236933265, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:200) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-14 12:56:03,489 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:56:03,489 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 12:56:03,489 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705251340113 bypass), TestNs=QuotaState(ts=1705251340113 bypass)} 2024-01-14 12:56:03,489 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705251340113 bypass), TestQuotaAdmin2=QuotaState(ts=1705251340113 bypass), TestQuotaAdmin1=QuotaState(ts=1705251340113 bypass)} 2024-01-14 12:56:03,489 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705251340113 bypass)} 2024-01-14 12:56:03,489 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705251340113 bypass)} 2024-01-14 12:56:03,739 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:56:03,740 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 12:56:03,740 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705251340113 bypass), TestNs=QuotaState(ts=1705251340113 bypass)} 2024-01-14 12:56:03,740 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705251340113 bypass), TestNs:TestTable=QuotaState(ts=1705251340113 bypass)} 2024-01-14 12:56:03,740 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705251340113 bypass)} 2024-01-14 12:56:03,740 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705251340113 bypass)} 2024-01-14 12:56:03,752 INFO [Listener at localhost/35643] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=291 (was 291), OpenFileDescriptor=597 (was 601), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=297 (was 333), ProcessCount=166 (was 168), AvailableMemoryMB=15104 (was 14393) - AvailableMemoryMB LEAK? - 2024-01-14 12:56:03,763 INFO [Listener at localhost/35643] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=291, OpenFileDescriptor=597, MaxFileDescriptor=60000, SystemLoadAverage=297, ProcessCount=166, AvailableMemoryMB=15104 2024-01-14 12:56:04,025 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:56:04,025 INFO [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-01-14 12:56:04,276 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 12:56:04,277 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705254940213 bypass), TestNs=QuotaState(ts=1705254940213 bypass)} 2024-01-14 12:56:04,277 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705254940213 bypass), TestQuotaAdmin2=QuotaState(ts=1705254940213 bypass), TestQuotaAdmin1=QuotaState(ts=1705254940213 bypass)} 2024-01-14 12:56:04,277 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705254940213 global-limiter)} 2024-01-14 12:56:04,278 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705254940213 bypass)} 2024-01-14 12:56:04,528 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:56:04,528 INFO [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-01-14 12:56:04,779 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 12:56:04,780 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705254940313 bypass), TestNs=QuotaState(ts=1705254940313 bypass)} 2024-01-14 12:56:04,780 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705254940313 bypass), TestNs:TestTable=QuotaState(ts=1705254940313 bypass)} 2024-01-14 12:56:04,780 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705254940313 global-limiter)} 2024-01-14 12:56:04,780 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705254940313 bypass)} 2024-01-14 12:56:04,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 12:56:04,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 163 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:32796 deadline: 1705236974795, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 12:56:05,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 12:56:05,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 165 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:32796 deadline: 1705236974795, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 12:56:05,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 12:56:05,557 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 167 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:32796 deadline: 1705236974795, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 12:56:06,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 12:56:06,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 169 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:32796 deadline: 1705236974795, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 12:56:07,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 12:56:07,569 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 171 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:32796 deadline: 1705236974796, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 12:56:10,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 12:56:10,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 173 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:32796 deadline: 1705236974796, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-14 12:56:10,086 ERROR [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10329: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7., hostname=jenkins-hbase4.apache.org,43387,1705236933265, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:178) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-14 12:56:10,092 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-14 12:56:10,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 177 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:32796 deadline: 1705236980092, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-14 12:56:10,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-14 12:56:10,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 179 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:32796 deadline: 1705236980092, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-14 12:56:10,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-14 12:56:10,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 181 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:32796 deadline: 1705236980093, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-14 12:56:11,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-14 12:56:11,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 183 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:32796 deadline: 1705236980093, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-14 12:56:12,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-14 12:56:12,880 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 185 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:32796 deadline: 1705236980092, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-14 12:56:15,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-14 12:56:15,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 187 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:32796 deadline: 1705236980092, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-14 12:56:15,406 ERROR [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=3 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10345: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-3' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7., hostname=jenkins-hbase4.apache.org,43387,1705236933265, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-14 12:56:15,662 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:56:15,663 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 12:56:15,663 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705258540313 bypass), TestNs=QuotaState(ts=1705258540313 bypass)} 2024-01-14 12:56:15,663 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705258540313 bypass), TestQuotaAdmin2=QuotaState(ts=1705258540313 bypass), TestQuotaAdmin1=QuotaState(ts=1705258540313 bypass)} 2024-01-14 12:56:15,663 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705258540313 bypass)} 2024-01-14 12:56:15,663 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705258540313 bypass)} 2024-01-14 12:56:15,913 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:56:15,914 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 12:56:15,914 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705258540313 bypass), TestNs=QuotaState(ts=1705258540313 bypass)} 2024-01-14 12:56:15,914 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705258540313 bypass), TestNs:TestTable=QuotaState(ts=1705258540313 bypass)} 2024-01-14 12:56:15,914 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705258540313 bypass)} 2024-01-14 12:56:15,914 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705258540313 bypass)} 2024-01-14 12:56:15,926 INFO [Listener at localhost/35643] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=282 (was 291), OpenFileDescriptor=595 (was 597), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=231 (was 297), ProcessCount=166 (was 166), AvailableMemoryMB=15100 (was 15104) 2024-01-14 12:56:15,937 INFO [Listener at localhost/35643] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=282, OpenFileDescriptor=595, MaxFileDescriptor=60000, SystemLoadAverage=231, ProcessCount=166, AvailableMemoryMB=15099 2024-01-14 12:56:16,194 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:56:16,195 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 12:56:16,196 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705262140313 bypass), TestNs=QuotaState(ts=1705262140313 bypass)} 2024-01-14 12:56:16,198 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705262140313 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin2=QuotaState(ts=1705262140313 bypass), TestQuotaAdmin1=QuotaState(ts=1705262140313 bypass)} 2024-01-14 12:56:16,198 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-14 12:56:16,199 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705262140313 bypass)} 2024-01-14 12:56:16,449 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:56:16,449 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 12:56:16,449 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705262140313 bypass), TestNs=QuotaState(ts=1705262140313 bypass)} 2024-01-14 12:56:16,450 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705262140313 bypass), TestNs:TestTable=QuotaState(ts=1705262140313 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000)))} 2024-01-14 12:56:16,450 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-14 12:56:16,450 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705262140313 bypass)} 2024-01-14 12:56:16,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:56:16,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] ipc.CallRunner(144): callId: 202 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:45750 deadline: 1705236986466, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:56:16,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:56:16,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] ipc.CallRunner(144): callId: 204 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:45750 deadline: 1705236986466, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:56:17,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:56:17,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] ipc.CallRunner(144): callId: 206 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:45750 deadline: 1705236986467, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:56:17,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:56:17,984 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] ipc.CallRunner(144): callId: 208 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:45750 deadline: 1705236986466, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:56:19,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:56:19,248 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] ipc.CallRunner(144): callId: 210 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:45750 deadline: 1705236986466, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:56:21,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:56:21,756 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] ipc.CallRunner(144): callId: 212 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:45750 deadline: 1705236986466, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:56:21,757 ERROR [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10324: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1705236939031.fffbbe4d4acb310155f0fe854ef1d578., hostname=jenkins-hbase4.apache.org,46767,1705236933216, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-14 12:56:21,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:56:21,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] ipc.CallRunner(144): callId: 213 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:45750 deadline: 1705236991758, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:56:22,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:56:22,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] ipc.CallRunner(144): callId: 215 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:45750 deadline: 1705236991759, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:56:22,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:56:22,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] ipc.CallRunner(144): callId: 217 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:45750 deadline: 1705236991758, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:56:23,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:56:23,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] ipc.CallRunner(144): callId: 219 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:45750 deadline: 1705236991758, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:56:24,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:56:24,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] ipc.CallRunner(144): callId: 221 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:45750 deadline: 1705236991758, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:56:27,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:56:27,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46767] ipc.CallRunner(144): callId: 223 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:45750 deadline: 1705236991758, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-14 12:56:27,059 ERROR [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10337: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1705236939031.fffbbe4d4acb310155f0fe854ef1d578., hostname=jenkins-hbase4.apache.org,46767,1705236933216, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-14 12:56:27,316 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:56:27,317 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 12:56:27,317 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705265740313 bypass), TestNs=QuotaState(ts=1705265740313 bypass)} 2024-01-14 12:56:27,317 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705265740313 bypass), TestQuotaAdmin2=QuotaState(ts=1705265740313 bypass), TestQuotaAdmin1=QuotaState(ts=1705265740313 bypass)} 2024-01-14 12:56:27,317 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705265740313 bypass)} 2024-01-14 12:56:27,317 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705265740313 bypass)} 2024-01-14 12:56:27,567 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:56:27,567 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 12:56:27,567 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705265740313 bypass), TestNs=QuotaState(ts=1705265740313 bypass)} 2024-01-14 12:56:27,567 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705265740313 bypass), TestNs:TestTable=QuotaState(ts=1705265740313 bypass)} 2024-01-14 12:56:27,567 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-14 12:56:27,567 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705265740313 bypass)} 2024-01-14 12:56:27,579 INFO [Listener at localhost/35643] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=281 (was 282), OpenFileDescriptor=595 (was 595), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=195 (was 231), ProcessCount=166 (was 166), AvailableMemoryMB=15100 (was 15099) - AvailableMemoryMB LEAK? - 2024-01-14 12:56:27,591 INFO [Listener at localhost/35643] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=281, OpenFileDescriptor=595, MaxFileDescriptor=60000, SystemLoadAverage=195, ProcessCount=166, AvailableMemoryMB=15099 2024-01-14 12:56:27,853 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:56:27,853 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 12:56:27,854 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705269340313 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1705269340313 bypass)} 2024-01-14 12:56:27,854 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705269340313 bypass), TestQuotaAdmin2=QuotaState(ts=1705269340313 bypass), TestQuotaAdmin1=QuotaState(ts=1705269340313 bypass)} 2024-01-14 12:56:27,854 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-14 12:56:27,854 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705269340313 bypass)} 2024-01-14 12:56:28,104 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:56:28,105 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 12:56:28,106 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705269340313 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1705269340313 bypass)} 2024-01-14 12:56:28,106 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705269340313 bypass), TestNs:TestTable=QuotaState(ts=1705269340313 bypass)} 2024-01-14 12:56:28,106 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-14 12:56:28,106 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705269340313 bypass)} 2024-01-14 12:56:28,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-14 12:56:28,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 235 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:32796 deadline: 1705236998120, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-14 12:56:28,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-14 12:56:28,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 237 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:32796 deadline: 1705236998120, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-14 12:56:28,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-14 12:56:28,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 239 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:32796 deadline: 1705236998119, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-14 12:56:29,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-14 12:56:29,641 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 241 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:32796 deadline: 1705236998120, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-14 12:56:30,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-14 12:56:30,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 243 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:32796 deadline: 1705236998119, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-14 12:56:33,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-14 12:56:33,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 245 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:32796 deadline: 1705236998119, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-14 12:56:33,422 ERROR [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10349: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7., hostname=jenkins-hbase4.apache.org,43387,1705236933265, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:128) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-14 12:56:33,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-14 12:56:33,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 252 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:32796 deadline: 1705237003431, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-14 12:56:33,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-14 12:56:33,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 254 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:32796 deadline: 1705237003432, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-14 12:56:34,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-14 12:56:34,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 256 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:32796 deadline: 1705237003431, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-14 12:56:34,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-14 12:56:34,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 258 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:32796 deadline: 1705237003431, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-14 12:56:36,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-14 12:56:36,210 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 260 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:32796 deadline: 1705237003432, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-14 12:56:38,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-14 12:56:38,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43387] ipc.CallRunner(144): callId: 262 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:32796 deadline: 1705237003432, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-14 12:56:38,738 ERROR [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10321: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7., hostname=jenkins-hbase4.apache.org,43387,1705236933265, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-14 12:56:38,996 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:56:38,996 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 12:56:38,996 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705272940313 bypass), TestNs=QuotaState(ts=1705272940313 bypass)} 2024-01-14 12:56:38,996 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1705272940313 bypass), TestQuotaAdmin2=QuotaState(ts=1705272940313 bypass), TestQuotaAdmin1=QuotaState(ts=1705272940313 bypass)} 2024-01-14 12:56:38,996 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-14 12:56:38,996 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705272940313 bypass)} 2024-01-14 12:56:39,247 INFO [Listener at localhost/35643] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-14 12:56:39,247 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-14 12:56:39,247 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1705272940313 bypass), TestNs=QuotaState(ts=1705272940313 bypass)} 2024-01-14 12:56:39,247 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1705272940313 bypass), TestNs:TestTable=QuotaState(ts=1705272940313 bypass)} 2024-01-14 12:56:39,247 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1705272940313 bypass)} 2024-01-14 12:56:39,247 DEBUG [Listener at localhost/35643] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1705272940313 bypass)} 2024-01-14 12:56:39,258 INFO [Listener at localhost/35643] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=267 (was 281), OpenFileDescriptor=586 (was 595), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=165 (was 195), ProcessCount=166 (was 166), AvailableMemoryMB=15099 (was 15099) 2024-01-14 12:56:39,261 INFO [Listener at localhost/35643] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin0 2024-01-14 12:56:39,265 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin0 2024-01-14 12:56:39,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] procedure2.ProcedureExecutor(1075): Stored pid=27, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin0 2024-01-14 12:56:39,276 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705236999276"}]},"ts":"1705236999276"} 2024-01-14 12:56:39,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-01-14 12:56:39,278 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLING in hbase:meta 2024-01-14 12:56:39,280 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set TestQuotaAdmin0 to state=DISABLING 2024-01-14 12:56:39,282 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=27fc6a9820537cf92a89f6d5429859b7, UNASSIGN}] 2024-01-14 12:56:39,283 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=27fc6a9820537cf92a89f6d5429859b7, UNASSIGN 2024-01-14 12:56:39,284 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=27fc6a9820537cf92a89f6d5429859b7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43387,1705236933265 2024-01-14 12:56:39,284 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705236999284"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705236999284"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705236999284"}]},"ts":"1705236999284"} 2024-01-14 12:56:39,286 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure 27fc6a9820537cf92a89f6d5429859b7, server=jenkins-hbase4.apache.org,43387,1705236933265}] 2024-01-14 12:56:39,426 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase4.apache.org,43387,1705236933265, timeout=1705236999441, delay=15, operations=[pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure 27fc6a9820537cf92a89f6d5429859b7, server=jenkins-hbase4.apache.org,43387,1705236933265]] 2024-01-14 12:56:39,443 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43387,1705236933265 2024-01-14 12:56:39,444 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 27fc6a9820537cf92a89f6d5429859b7 2024-01-14 12:56:39,445 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 27fc6a9820537cf92a89f6d5429859b7, disabling compactions & flushes 2024-01-14 12:56:39,445 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7. 2024-01-14 12:56:39,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7. 2024-01-14 12:56:39,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7. after waiting 0 ms 2024-01-14 12:56:39,446 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7. 2024-01-14 12:56:39,446 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 27fc6a9820537cf92a89f6d5429859b7 1/1 column families, dataSize=578 B heapSize=2.11 KB 2024-01-14 12:56:39,517 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=578 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/default/TestQuotaAdmin0/27fc6a9820537cf92a89f6d5429859b7/.tmp/cf/a91f0f2c31734e318f74ce44d8bec435 2024-01-14 12:56:39,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-01-14 12:56:39,565 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/default/TestQuotaAdmin0/27fc6a9820537cf92a89f6d5429859b7/.tmp/cf/a91f0f2c31734e318f74ce44d8bec435 as hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/default/TestQuotaAdmin0/27fc6a9820537cf92a89f6d5429859b7/cf/a91f0f2c31734e318f74ce44d8bec435 2024-01-14 12:56:39,577 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/default/TestQuotaAdmin0/27fc6a9820537cf92a89f6d5429859b7/cf/a91f0f2c31734e318f74ce44d8bec435, entries=6, sequenceid=21, filesize=4.7 K 2024-01-14 12:56:39,580 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~578 B/578, heapSize ~2.09 KB/2144, currentSize=0 B/0 for 27fc6a9820537cf92a89f6d5429859b7 in 134ms, sequenceid=21, compaction requested=false 2024-01-14 12:56:39,589 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/default/TestQuotaAdmin0/27fc6a9820537cf92a89f6d5429859b7/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2024-01-14 12:56:39,590 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7. 2024-01-14 12:56:39,590 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 27fc6a9820537cf92a89f6d5429859b7: 2024-01-14 12:56:39,592 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 27fc6a9820537cf92a89f6d5429859b7 2024-01-14 12:56:39,593 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=27fc6a9820537cf92a89f6d5429859b7, regionState=CLOSED 2024-01-14 12:56:39,593 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705236999593"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705236999593"}]},"ts":"1705236999593"} 2024-01-14 12:56:39,596 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=29, resume processing ppid=28 2024-01-14 12:56:39,596 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=29, ppid=28, state=SUCCESS; CloseRegionProcedure 27fc6a9820537cf92a89f6d5429859b7, server=jenkins-hbase4.apache.org,43387,1705236933265 in 309 msec 2024-01-14 12:56:39,598 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=28, resume processing ppid=27 2024-01-14 12:56:39,599 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=27fc6a9820537cf92a89f6d5429859b7, UNASSIGN in 314 msec 2024-01-14 12:56:39,599 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705236999599"}]},"ts":"1705236999599"} 2024-01-14 12:56:39,601 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLED in hbase:meta 2024-01-14 12:56:39,603 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set TestQuotaAdmin0 to state=DISABLED 2024-01-14 12:56:39,606 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=27, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin0 in 337 msec 2024-01-14 12:56:40,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-01-14 12:56:40,030 INFO [Listener at localhost/35643] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin0, procId: 27 completed 2024-01-14 12:56:40,036 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin0 2024-01-14 12:56:40,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] procedure2.ProcedureExecutor(1075): Stored pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-14 12:56:40,045 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-14 12:56:40,047 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=30, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-14 12:56:40,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-01-14 12:56:40,054 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/default/TestQuotaAdmin0/27fc6a9820537cf92a89f6d5429859b7 2024-01-14 12:56:40,058 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/default/TestQuotaAdmin0/27fc6a9820537cf92a89f6d5429859b7/cf, FileablePath, hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/default/TestQuotaAdmin0/27fc6a9820537cf92a89f6d5429859b7/recovered.edits] 2024-01-14 12:56:40,068 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/default/TestQuotaAdmin0/27fc6a9820537cf92a89f6d5429859b7/cf/a91f0f2c31734e318f74ce44d8bec435 to hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/archive/data/default/TestQuotaAdmin0/27fc6a9820537cf92a89f6d5429859b7/cf/a91f0f2c31734e318f74ce44d8bec435 2024-01-14 12:56:40,073 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/default/TestQuotaAdmin0/27fc6a9820537cf92a89f6d5429859b7/recovered.edits/24.seqid to hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/archive/data/default/TestQuotaAdmin0/27fc6a9820537cf92a89f6d5429859b7/recovered.edits/24.seqid 2024-01-14 12:56:40,075 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/default/TestQuotaAdmin0/27fc6a9820537cf92a89f6d5429859b7 2024-01-14 12:56:40,075 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-01-14 12:56:40,079 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=30, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-14 12:56:40,099 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin0 from hbase:meta 2024-01-14 12:56:40,102 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin0' descriptor. 2024-01-14 12:56:40,103 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=30, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-14 12:56:40,104 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin0' from region states. 2024-01-14 12:56:40,104 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1705237000104"}]},"ts":"9223372036854775807"} 2024-01-14 12:56:40,106 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-01-14 12:56:40,106 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 27fc6a9820537cf92a89f6d5429859b7, NAME => 'TestQuotaAdmin0,,1705236936397.27fc6a9820537cf92a89f6d5429859b7.', STARTKEY => '', ENDKEY => ''}] 2024-01-14 12:56:40,106 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin0' as deleted. 2024-01-14 12:56:40,106 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1705237000106"}]},"ts":"9223372036854775807"} 2024-01-14 12:56:40,108 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin0 state from META 2024-01-14 12:56:40,116 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=30, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-14 12:56:40,117 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=30, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin0 in 79 msec 2024-01-14 12:56:40,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-01-14 12:56:40,302 INFO [Listener at localhost/35643] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin0, procId: 30 completed 2024-01-14 12:56:40,303 INFO [Listener at localhost/35643] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin1 2024-01-14 12:56:40,303 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin1 2024-01-14 12:56:40,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] procedure2.ProcedureExecutor(1075): Stored pid=31, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin1 2024-01-14 12:56:40,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-01-14 12:56:40,308 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705237000308"}]},"ts":"1705237000308"} 2024-01-14 12:56:40,310 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLING in hbase:meta 2024-01-14 12:56:40,312 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set TestQuotaAdmin1 to state=DISABLING 2024-01-14 12:56:40,313 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=c9f17d6597631e19216a99517ef16380, UNASSIGN}] 2024-01-14 12:56:40,314 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=c9f17d6597631e19216a99517ef16380, UNASSIGN 2024-01-14 12:56:40,314 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=c9f17d6597631e19216a99517ef16380, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46767,1705236933216 2024-01-14 12:56:40,315 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1705236937198.c9f17d6597631e19216a99517ef16380.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705237000314"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705237000314"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705237000314"}]},"ts":"1705237000314"} 2024-01-14 12:56:40,316 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=33, ppid=32, state=RUNNABLE; CloseRegionProcedure c9f17d6597631e19216a99517ef16380, server=jenkins-hbase4.apache.org,46767,1705236933216}] 2024-01-14 12:56:40,468 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46767,1705236933216 2024-01-14 12:56:40,469 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c9f17d6597631e19216a99517ef16380 2024-01-14 12:56:40,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c9f17d6597631e19216a99517ef16380, disabling compactions & flushes 2024-01-14 12:56:40,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1705236937198.c9f17d6597631e19216a99517ef16380. 2024-01-14 12:56:40,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1705236937198.c9f17d6597631e19216a99517ef16380. 2024-01-14 12:56:40,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1705236937198.c9f17d6597631e19216a99517ef16380. after waiting 0 ms 2024-01-14 12:56:40,470 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1705236937198.c9f17d6597631e19216a99517ef16380. 2024-01-14 12:56:40,478 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/default/TestQuotaAdmin1/c9f17d6597631e19216a99517ef16380/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-01-14 12:56:40,479 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1705236937198.c9f17d6597631e19216a99517ef16380. 2024-01-14 12:56:40,479 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c9f17d6597631e19216a99517ef16380: 2024-01-14 12:56:40,481 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c9f17d6597631e19216a99517ef16380 2024-01-14 12:56:40,482 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=c9f17d6597631e19216a99517ef16380, regionState=CLOSED 2024-01-14 12:56:40,482 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1705236937198.c9f17d6597631e19216a99517ef16380.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705237000482"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705237000482"}]},"ts":"1705237000482"} 2024-01-14 12:56:40,486 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=33, resume processing ppid=32 2024-01-14 12:56:40,486 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=33, ppid=32, state=SUCCESS; CloseRegionProcedure c9f17d6597631e19216a99517ef16380, server=jenkins-hbase4.apache.org,46767,1705236933216 in 168 msec 2024-01-14 12:56:40,488 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=32, resume processing ppid=31 2024-01-14 12:56:40,489 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=32, ppid=31, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=c9f17d6597631e19216a99517ef16380, UNASSIGN in 173 msec 2024-01-14 12:56:40,489 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705237000489"}]},"ts":"1705237000489"} 2024-01-14 12:56:40,491 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLED in hbase:meta 2024-01-14 12:56:40,493 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set TestQuotaAdmin1 to state=DISABLED 2024-01-14 12:56:40,496 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=31, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin1 in 191 msec 2024-01-14 12:56:40,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-01-14 12:56:40,559 INFO [Listener at localhost/35643] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin1, procId: 31 completed 2024-01-14 12:56:40,560 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin1 2024-01-14 12:56:40,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] procedure2.ProcedureExecutor(1075): Stored pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-14 12:56:40,563 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-14 12:56:40,564 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=34, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-14 12:56:40,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-01-14 12:56:40,569 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/default/TestQuotaAdmin1/c9f17d6597631e19216a99517ef16380 2024-01-14 12:56:40,571 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/default/TestQuotaAdmin1/c9f17d6597631e19216a99517ef16380/cf, FileablePath, hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/default/TestQuotaAdmin1/c9f17d6597631e19216a99517ef16380/recovered.edits] 2024-01-14 12:56:40,579 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/default/TestQuotaAdmin1/c9f17d6597631e19216a99517ef16380/recovered.edits/4.seqid to hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/archive/data/default/TestQuotaAdmin1/c9f17d6597631e19216a99517ef16380/recovered.edits/4.seqid 2024-01-14 12:56:40,580 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/default/TestQuotaAdmin1/c9f17d6597631e19216a99517ef16380 2024-01-14 12:56:40,580 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-01-14 12:56:40,583 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=34, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-14 12:56:40,586 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin1 from hbase:meta 2024-01-14 12:56:40,588 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin1' descriptor. 2024-01-14 12:56:40,590 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=34, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-14 12:56:40,590 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin1' from region states. 2024-01-14 12:56:40,590 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1,,1705236937198.c9f17d6597631e19216a99517ef16380.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1705237000590"}]},"ts":"9223372036854775807"} 2024-01-14 12:56:40,592 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-01-14 12:56:40,592 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c9f17d6597631e19216a99517ef16380, NAME => 'TestQuotaAdmin1,,1705236937198.c9f17d6597631e19216a99517ef16380.', STARTKEY => '', ENDKEY => ''}] 2024-01-14 12:56:40,592 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin1' as deleted. 2024-01-14 12:56:40,592 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1705237000592"}]},"ts":"9223372036854775807"} 2024-01-14 12:56:40,593 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin1 state from META 2024-01-14 12:56:40,596 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=34, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-14 12:56:40,597 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=34, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin1 in 36 msec 2024-01-14 12:56:40,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-01-14 12:56:40,818 INFO [Listener at localhost/35643] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin1, procId: 34 completed 2024-01-14 12:56:40,818 INFO [Listener at localhost/35643] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin2 2024-01-14 12:56:40,819 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin2 2024-01-14 12:56:40,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] procedure2.ProcedureExecutor(1075): Stored pid=35, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin2 2024-01-14 12:56:40,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-01-14 12:56:40,823 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705237000823"}]},"ts":"1705237000823"} 2024-01-14 12:56:40,825 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLING in hbase:meta 2024-01-14 12:56:40,828 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set TestQuotaAdmin2 to state=DISABLING 2024-01-14 12:56:40,829 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=a2ae266fed766c80613c912ecfd7614b, UNASSIGN}] 2024-01-14 12:56:40,830 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=a2ae266fed766c80613c912ecfd7614b, UNASSIGN 2024-01-14 12:56:40,831 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=a2ae266fed766c80613c912ecfd7614b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46767,1705236933216 2024-01-14 12:56:40,831 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1705236937983.a2ae266fed766c80613c912ecfd7614b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705237000830"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705237000830"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705237000830"}]},"ts":"1705237000830"} 2024-01-14 12:56:40,832 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; CloseRegionProcedure a2ae266fed766c80613c912ecfd7614b, server=jenkins-hbase4.apache.org,46767,1705236933216}] 2024-01-14 12:56:40,984 DEBUG [RSProcedureDispatcher-pool-5] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46767,1705236933216 2024-01-14 12:56:40,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a2ae266fed766c80613c912ecfd7614b 2024-01-14 12:56:40,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a2ae266fed766c80613c912ecfd7614b, disabling compactions & flushes 2024-01-14 12:56:40,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1705236937983.a2ae266fed766c80613c912ecfd7614b. 2024-01-14 12:56:40,985 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1705236937983.a2ae266fed766c80613c912ecfd7614b. 2024-01-14 12:56:40,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1705236937983.a2ae266fed766c80613c912ecfd7614b. after waiting 0 ms 2024-01-14 12:56:40,986 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1705236937983.a2ae266fed766c80613c912ecfd7614b. 2024-01-14 12:56:40,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/default/TestQuotaAdmin2/a2ae266fed766c80613c912ecfd7614b/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-01-14 12:56:40,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1705236937983.a2ae266fed766c80613c912ecfd7614b. 2024-01-14 12:56:40,992 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a2ae266fed766c80613c912ecfd7614b: 2024-01-14 12:56:40,994 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a2ae266fed766c80613c912ecfd7614b 2024-01-14 12:56:40,994 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=a2ae266fed766c80613c912ecfd7614b, regionState=CLOSED 2024-01-14 12:56:40,995 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1705236937983.a2ae266fed766c80613c912ecfd7614b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1705237000994"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705237000994"}]},"ts":"1705237000994"} 2024-01-14 12:56:40,998 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=37, resume processing ppid=36 2024-01-14 12:56:40,998 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=37, ppid=36, state=SUCCESS; CloseRegionProcedure a2ae266fed766c80613c912ecfd7614b, server=jenkins-hbase4.apache.org,46767,1705236933216 in 164 msec 2024-01-14 12:56:41,000 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=36, resume processing ppid=35 2024-01-14 12:56:41,001 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=a2ae266fed766c80613c912ecfd7614b, UNASSIGN in 169 msec 2024-01-14 12:56:41,001 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705237001001"}]},"ts":"1705237001001"} 2024-01-14 12:56:41,002 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLED in hbase:meta 2024-01-14 12:56:41,004 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set TestQuotaAdmin2 to state=DISABLED 2024-01-14 12:56:41,006 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=35, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin2 in 186 msec 2024-01-14 12:56:41,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-01-14 12:56:41,074 INFO [Listener at localhost/35643] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin2, procId: 35 completed 2024-01-14 12:56:41,075 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin2 2024-01-14 12:56:41,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] procedure2.ProcedureExecutor(1075): Stored pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-14 12:56:41,078 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-14 12:56:41,079 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=38, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-14 12:56:41,081 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-01-14 12:56:41,084 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/default/TestQuotaAdmin2/a2ae266fed766c80613c912ecfd7614b 2024-01-14 12:56:41,086 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/default/TestQuotaAdmin2/a2ae266fed766c80613c912ecfd7614b/cf, FileablePath, hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/default/TestQuotaAdmin2/a2ae266fed766c80613c912ecfd7614b/recovered.edits] 2024-01-14 12:56:41,093 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/default/TestQuotaAdmin2/a2ae266fed766c80613c912ecfd7614b/recovered.edits/4.seqid to hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/archive/data/default/TestQuotaAdmin2/a2ae266fed766c80613c912ecfd7614b/recovered.edits/4.seqid 2024-01-14 12:56:41,093 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/default/TestQuotaAdmin2/a2ae266fed766c80613c912ecfd7614b 2024-01-14 12:56:41,093 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-01-14 12:56:41,096 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=38, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-14 12:56:41,098 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin2 from hbase:meta 2024-01-14 12:56:41,100 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin2' descriptor. 2024-01-14 12:56:41,101 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=38, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-14 12:56:41,101 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin2' from region states. 2024-01-14 12:56:41,102 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2,,1705236937983.a2ae266fed766c80613c912ecfd7614b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1705237001101"}]},"ts":"9223372036854775807"} 2024-01-14 12:56:41,103 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-01-14 12:56:41,103 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => a2ae266fed766c80613c912ecfd7614b, NAME => 'TestQuotaAdmin2,,1705236937983.a2ae266fed766c80613c912ecfd7614b.', STARTKEY => '', ENDKEY => ''}] 2024-01-14 12:56:41,103 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin2' as deleted. 2024-01-14 12:56:41,103 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1705237001103"}]},"ts":"9223372036854775807"} 2024-01-14 12:56:41,105 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin2 state from META 2024-01-14 12:56:41,107 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=38, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-14 12:56:41,108 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=38, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin2 in 32 msec 2024-01-14 12:56:41,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-01-14 12:56:41,333 INFO [Listener at localhost/35643] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin2, procId: 38 completed 2024-01-14 12:56:41,333 INFO [Listener at localhost/35643] client.HBaseAdmin$15(890): Started disable of TestNs:TestTable 2024-01-14 12:56:41,334 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestNs:TestTable 2024-01-14 12:56:41,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] procedure2.ProcedureExecutor(1075): Stored pid=39, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestNs:TestTable 2024-01-14 12:56:41,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-01-14 12:56:41,338 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705237001338"}]},"ts":"1705237001338"} 2024-01-14 12:56:41,340 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLING in hbase:meta 2024-01-14 12:56:41,342 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set TestNs:TestTable to state=DISABLING 2024-01-14 12:56:41,343 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=1740d9a97228d4fb5442deb7cf534ec3, UNASSIGN}, {pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=fffbbe4d4acb310155f0fe854ef1d578, UNASSIGN}] 2024-01-14 12:56:41,344 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=fffbbe4d4acb310155f0fe854ef1d578, UNASSIGN 2024-01-14 12:56:41,344 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=1740d9a97228d4fb5442deb7cf534ec3, UNASSIGN 2024-01-14 12:56:41,345 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=fffbbe4d4acb310155f0fe854ef1d578, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,46767,1705236933216 2024-01-14 12:56:41,345 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1705236939031.fffbbe4d4acb310155f0fe854ef1d578.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705237001345"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705237001345"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705237001345"}]},"ts":"1705237001345"} 2024-01-14 12:56:41,345 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=1740d9a97228d4fb5442deb7cf534ec3, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43387,1705236933265 2024-01-14 12:56:41,345 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1705236939031.1740d9a97228d4fb5442deb7cf534ec3.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705237001345"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1705237001345"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1705237001345"}]},"ts":"1705237001345"} 2024-01-14 12:56:41,346 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=42, ppid=41, state=RUNNABLE; CloseRegionProcedure fffbbe4d4acb310155f0fe854ef1d578, server=jenkins-hbase4.apache.org,46767,1705236933216}] 2024-01-14 12:56:41,347 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=43, ppid=40, state=RUNNABLE; CloseRegionProcedure 1740d9a97228d4fb5442deb7cf534ec3, server=jenkins-hbase4.apache.org,43387,1705236933265}] 2024-01-14 12:56:41,498 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,46767,1705236933216 2024-01-14 12:56:41,499 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fffbbe4d4acb310155f0fe854ef1d578 2024-01-14 12:56:41,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fffbbe4d4acb310155f0fe854ef1d578, disabling compactions & flushes 2024-01-14 12:56:41,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1705236939031.fffbbe4d4acb310155f0fe854ef1d578. 2024-01-14 12:56:41,500 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,43387,1705236933265 2024-01-14 12:56:41,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1705236939031.fffbbe4d4acb310155f0fe854ef1d578. 2024-01-14 12:56:41,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1705236939031.fffbbe4d4acb310155f0fe854ef1d578. after waiting 0 ms 2024-01-14 12:56:41,500 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1705236939031.fffbbe4d4acb310155f0fe854ef1d578. 2024-01-14 12:56:41,500 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 1740d9a97228d4fb5442deb7cf534ec3 2024-01-14 12:56:41,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1740d9a97228d4fb5442deb7cf534ec3, disabling compactions & flushes 2024-01-14 12:56:41,501 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1705236939031.1740d9a97228d4fb5442deb7cf534ec3. 2024-01-14 12:56:41,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1705236939031.1740d9a97228d4fb5442deb7cf534ec3. 2024-01-14 12:56:41,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1705236939031.1740d9a97228d4fb5442deb7cf534ec3. after waiting 0 ms 2024-01-14 12:56:41,501 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1705236939031.1740d9a97228d4fb5442deb7cf534ec3. 2024-01-14 12:56:41,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/TestNs/TestTable/fffbbe4d4acb310155f0fe854ef1d578/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-01-14 12:56:41,506 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/TestNs/TestTable/1740d9a97228d4fb5442deb7cf534ec3/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-01-14 12:56:41,507 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1705236939031.fffbbe4d4acb310155f0fe854ef1d578. 2024-01-14 12:56:41,507 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fffbbe4d4acb310155f0fe854ef1d578: 2024-01-14 12:56:41,508 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1705236939031.1740d9a97228d4fb5442deb7cf534ec3. 2024-01-14 12:56:41,508 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1740d9a97228d4fb5442deb7cf534ec3: 2024-01-14 12:56:41,509 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fffbbe4d4acb310155f0fe854ef1d578 2024-01-14 12:56:41,510 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=fffbbe4d4acb310155f0fe854ef1d578, regionState=CLOSED 2024-01-14 12:56:41,510 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1705236939031.fffbbe4d4acb310155f0fe854ef1d578.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705237001510"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705237001510"}]},"ts":"1705237001510"} 2024-01-14 12:56:41,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 1740d9a97228d4fb5442deb7cf534ec3 2024-01-14 12:56:41,511 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=1740d9a97228d4fb5442deb7cf534ec3, regionState=CLOSED 2024-01-14 12:56:41,511 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,,1705236939031.1740d9a97228d4fb5442deb7cf534ec3.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1705237001511"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1705237001511"}]},"ts":"1705237001511"} 2024-01-14 12:56:41,518 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=42, resume processing ppid=41 2024-01-14 12:56:41,518 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=42, ppid=41, state=SUCCESS; CloseRegionProcedure fffbbe4d4acb310155f0fe854ef1d578, server=jenkins-hbase4.apache.org,46767,1705236933216 in 166 msec 2024-01-14 12:56:41,519 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=43, resume processing ppid=40 2024-01-14 12:56:41,519 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=43, ppid=40, state=SUCCESS; CloseRegionProcedure 1740d9a97228d4fb5442deb7cf534ec3, server=jenkins-hbase4.apache.org,43387,1705236933265 in 166 msec 2024-01-14 12:56:41,519 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=41, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=fffbbe4d4acb310155f0fe854ef1d578, UNASSIGN in 175 msec 2024-01-14 12:56:41,520 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=40, resume processing ppid=39 2024-01-14 12:56:41,521 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=1740d9a97228d4fb5442deb7cf534ec3, UNASSIGN in 176 msec 2024-01-14 12:56:41,521 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1705237001521"}]},"ts":"1705237001521"} 2024-01-14 12:56:41,523 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLED in hbase:meta 2024-01-14 12:56:41,527 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set TestNs:TestTable to state=DISABLED 2024-01-14 12:56:41,529 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=39, state=SUCCESS; DisableTableProcedure table=TestNs:TestTable in 193 msec 2024-01-14 12:56:41,589 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-01-14 12:56:41,589 INFO [Listener at localhost/35643] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: TestNs:TestTable, procId: 39 completed 2024-01-14 12:56:41,590 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestNs:TestTable 2024-01-14 12:56:41,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] procedure2.ProcedureExecutor(1075): Stored pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestNs:TestTable 2024-01-14 12:56:41,593 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-14 12:56:41,594 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=44, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-14 12:56:41,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-01-14 12:56:41,600 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/TestNs/TestTable/1740d9a97228d4fb5442deb7cf534ec3 2024-01-14 12:56:41,600 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/TestNs/TestTable/fffbbe4d4acb310155f0fe854ef1d578 2024-01-14 12:56:41,603 DEBUG [HFileArchiver-11] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/TestNs/TestTable/1740d9a97228d4fb5442deb7cf534ec3/cf, FileablePath, hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/TestNs/TestTable/1740d9a97228d4fb5442deb7cf534ec3/recovered.edits] 2024-01-14 12:56:41,603 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/TestNs/TestTable/fffbbe4d4acb310155f0fe854ef1d578/cf, FileablePath, hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/TestNs/TestTable/fffbbe4d4acb310155f0fe854ef1d578/recovered.edits] 2024-01-14 12:56:41,610 DEBUG [HFileArchiver-11] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/TestNs/TestTable/1740d9a97228d4fb5442deb7cf534ec3/recovered.edits/4.seqid to hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/archive/data/TestNs/TestTable/1740d9a97228d4fb5442deb7cf534ec3/recovered.edits/4.seqid 2024-01-14 12:56:41,611 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/TestNs/TestTable/fffbbe4d4acb310155f0fe854ef1d578/recovered.edits/4.seqid to hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/archive/data/TestNs/TestTable/fffbbe4d4acb310155f0fe854ef1d578/recovered.edits/4.seqid 2024-01-14 12:56:41,611 DEBUG [HFileArchiver-11] backup.HFileArchiver(596): Deleted hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/TestNs/TestTable/1740d9a97228d4fb5442deb7cf534ec3 2024-01-14 12:56:41,611 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/.tmp/data/TestNs/TestTable/fffbbe4d4acb310155f0fe854ef1d578 2024-01-14 12:56:41,611 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-01-14 12:56:41,615 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=44, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-14 12:56:41,617 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of TestNs:TestTable from hbase:meta 2024-01-14 12:56:41,618 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'TestNs:TestTable' descriptor. 2024-01-14 12:56:41,620 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=44, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-14 12:56:41,620 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'TestNs:TestTable' from region states. 2024-01-14 12:56:41,620 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,,1705236939031.1740d9a97228d4fb5442deb7cf534ec3.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1705237001620"}]},"ts":"9223372036854775807"} 2024-01-14 12:56:41,620 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,1,1705236939031.fffbbe4d4acb310155f0fe854ef1d578.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1705237001620"}]},"ts":"9223372036854775807"} 2024-01-14 12:56:41,622 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2024-01-14 12:56:41,622 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 1740d9a97228d4fb5442deb7cf534ec3, NAME => 'TestNs:TestTable,,1705236939031.1740d9a97228d4fb5442deb7cf534ec3.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => fffbbe4d4acb310155f0fe854ef1d578, NAME => 'TestNs:TestTable,1,1705236939031.fffbbe4d4acb310155f0fe854ef1d578.', STARTKEY => '1', ENDKEY => ''}] 2024-01-14 12:56:41,622 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'TestNs:TestTable' as deleted. 2024-01-14 12:56:41,622 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1705237001622"}]},"ts":"9223372036854775807"} 2024-01-14 12:56:41,624 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table TestNs:TestTable state from META 2024-01-14 12:56:41,626 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=44, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-14 12:56:41,627 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=44, state=SUCCESS; DeleteTableProcedure table=TestNs:TestTable in 36 msec 2024-01-14 12:56:41,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-01-14 12:56:41,847 INFO [Listener at localhost/35643] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: TestNs:TestTable, procId: 44 completed 2024-01-14 12:56:41,851 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.HMaster$17(3092): Client=jenkins//172.31.14.131 delete TestNs 2024-01-14 12:56:41,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] procedure2.ProcedureExecutor(1075): Stored pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE; DeleteNamespaceProcedure, namespace=TestNs 2024-01-14 12:56:41,860 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-14 12:56:41,863 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_FROM_NS_TABLE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-14 12:56:41,865 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_FROM_ZK, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-14 12:56:41,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-01-14 12:56:41,866 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace/TestNs 2024-01-14 12:56:41,866 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-01-14 12:56:41,867 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_DIRECTORIES, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-14 12:56:41,870 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_NAMESPACE_QUOTA, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-14 12:56:41,871 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=45, state=SUCCESS; DeleteNamespaceProcedure, namespace=TestNs in 18 msec 2024-01-14 12:56:42,117 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39225] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-01-14 12:56:42,117 INFO [Listener at localhost/35643] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2024-01-14 12:56:42,117 INFO [Listener at localhost/35643] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-01-14 12:56:42,117 DEBUG [Listener at localhost/35643] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x26bde290 to 127.0.0.1:56570 2024-01-14 12:56:42,117 DEBUG [Listener at localhost/35643] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-14 12:56:42,118 DEBUG [Listener at localhost/35643] util.JVMClusterUtil(237): Shutting down HBase Cluster 2024-01-14 12:56:42,118 DEBUG [Listener at localhost/35643] util.JVMClusterUtil(257): Found active master hash=659591130, stopped=false 2024-01-14 12:56:42,119 DEBUG [Listener at localhost/35643] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-01-14 12:56:42,119 INFO [Listener at localhost/35643] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39225,1705236931219 2024-01-14 12:56:42,121 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): regionserver:43387-0x101261a83410002, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-01-14 12:56:42,121 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-01-14 12:56:42,121 INFO [Listener at localhost/35643] procedure2.ProcedureExecutor(675): Stopping 2024-01-14 12:56:42,121 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): regionserver:46767-0x101261a83410001, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-01-14 12:56:42,121 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-14 12:56:42,122 DEBUG [Listener at localhost/35643] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x13ce864d to 127.0.0.1:56570 2024-01-14 12:56:42,122 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:43387-0x101261a83410002, quorum=127.0.0.1:56570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-14 12:56:42,122 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:46767-0x101261a83410001, quorum=127.0.0.1:56570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-14 12:56:42,122 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-14 12:56:42,122 DEBUG [Listener at localhost/35643] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-14 12:56:42,123 INFO [Listener at localhost/35643] regionserver.HRegionServer(2300): ***** STOPPING region server 'jenkins-hbase4.apache.org,46767,1705236933216' ***** 2024-01-14 12:56:42,123 INFO [Listener at localhost/35643] regionserver.HRegionServer(2314): STOPPED: Shutdown requested 2024-01-14 12:56:42,123 INFO [Listener at localhost/35643] regionserver.HRegionServer(2300): ***** STOPPING region server 'jenkins-hbase4.apache.org,43387,1705236933265' ***** 2024-01-14 12:56:42,123 INFO [Listener at localhost/35643] regionserver.HRegionServer(2314): STOPPED: Shutdown requested 2024-01-14 12:56:42,123 INFO [RS:0;jenkins-hbase4:46767] regionserver.HeapMemoryManager(220): Stopping 2024-01-14 12:56:42,123 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-01-14 12:56:42,123 INFO [RS:1;jenkins-hbase4:43387] regionserver.HeapMemoryManager(220): Stopping 2024-01-14 12:56:42,123 INFO [RS:0;jenkins-hbase4:46767] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-01-14 12:56:42,123 INFO [RS:1;jenkins-hbase4:43387] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-01-14 12:56:42,123 INFO [RS:0;jenkins-hbase4:46767] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-01-14 12:56:42,124 INFO [RS:1;jenkins-hbase4:43387] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-01-14 12:56:42,123 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-01-14 12:56:42,124 INFO [RS:1;jenkins-hbase4:43387] regionserver.HRegionServer(3308): Received CLOSE for fb246572de1d9acdcf6c8de873cbb51f 2024-01-14 12:56:42,124 INFO [RS:0;jenkins-hbase4:46767] regionserver.HRegionServer(3308): Received CLOSE for 1087cef0e34ba5a7689c8b4bb8203c42 2024-01-14 12:56:42,124 INFO [RS:0;jenkins-hbase4:46767] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,46767,1705236933216 2024-01-14 12:56:42,124 INFO [RS:1;jenkins-hbase4:43387] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,43387,1705236933265 2024-01-14 12:56:42,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fb246572de1d9acdcf6c8de873cbb51f, disabling compactions & flushes 2024-01-14 12:56:42,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1087cef0e34ba5a7689c8b4bb8203c42, disabling compactions & flushes 2024-01-14 12:56:42,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:quota,,1705236935828.fb246572de1d9acdcf6c8de873cbb51f. 2024-01-14 12:56:42,125 INFO [RS:1;jenkins-hbase4:43387] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-01-14 12:56:42,125 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1705236935828.fb246572de1d9acdcf6c8de873cbb51f. 2024-01-14 12:56:42,126 DEBUG [RS:1;jenkins-hbase4:43387] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6aefd968 to 127.0.0.1:56570 2024-01-14 12:56:42,125 INFO [RS:0;jenkins-hbase4:46767] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-01-14 12:56:42,126 DEBUG [RS:1;jenkins-hbase4:43387] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-14 12:56:42,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1705236935828.fb246572de1d9acdcf6c8de873cbb51f. after waiting 0 ms 2024-01-14 12:56:42,125 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1705236935101.1087cef0e34ba5a7689c8b4bb8203c42. 2024-01-14 12:56:42,127 INFO [RS:1;jenkins-hbase4:43387] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-01-14 12:56:42,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1705236935101.1087cef0e34ba5a7689c8b4bb8203c42. 2024-01-14 12:56:42,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1705236935101.1087cef0e34ba5a7689c8b4bb8203c42. after waiting 0 ms 2024-01-14 12:56:42,127 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1705236935101.1087cef0e34ba5a7689c8b4bb8203c42. 2024-01-14 12:56:42,126 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1705236935828.fb246572de1d9acdcf6c8de873cbb51f. 2024-01-14 12:56:42,126 DEBUG [RS:0;jenkins-hbase4:46767] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6d34cd73 to 127.0.0.1:56570 2024-01-14 12:56:42,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1087cef0e34ba5a7689c8b4bb8203c42 1/1 column families, dataSize=147 B heapSize=704 B 2024-01-14 12:56:42,127 INFO [RS:1;jenkins-hbase4:43387] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-01-14 12:56:42,127 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing fb246572de1d9acdcf6c8de873cbb51f 2/2 column families, dataSize=726 B heapSize=2.44 KB 2024-01-14 12:56:42,127 DEBUG [RS:0;jenkins-hbase4:46767] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-14 12:56:42,127 INFO [RS:1;jenkins-hbase4:43387] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-01-14 12:56:42,127 INFO [RS:0;jenkins-hbase4:46767] regionserver.HRegionServer(1477): Waiting on 1 regions to close 2024-01-14 12:56:42,127 INFO [RS:1;jenkins-hbase4:43387] regionserver.HRegionServer(3308): Received CLOSE for 1588230740 2024-01-14 12:56:42,127 DEBUG [RS:0;jenkins-hbase4:46767] regionserver.HRegionServer(1481): Online Regions={1087cef0e34ba5a7689c8b4bb8203c42=hbase:namespace,,1705236935101.1087cef0e34ba5a7689c8b4bb8203c42.} 2024-01-14 12:56:42,128 INFO [RS:1;jenkins-hbase4:43387] regionserver.HRegionServer(1477): Waiting on 2 regions to close 2024-01-14 12:56:42,128 DEBUG [RS:1;jenkins-hbase4:43387] regionserver.HRegionServer(1481): Online Regions={1588230740=hbase:meta,,1.1588230740, fb246572de1d9acdcf6c8de873cbb51f=hbase:quota,,1705236935828.fb246572de1d9acdcf6c8de873cbb51f.} 2024-01-14 12:56:42,128 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-01-14 12:56:42,129 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-01-14 12:56:42,129 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-01-14 12:56:42,129 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-01-14 12:56:42,129 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-01-14 12:56:42,129 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=14.15 KB heapSize=25.10 KB 2024-01-14 12:56:42,130 DEBUG [RS:0;jenkins-hbase4:46767] regionserver.HRegionServer(1507): Waiting on 1087cef0e34ba5a7689c8b4bb8203c42 2024-01-14 12:56:42,130 DEBUG [RS:1;jenkins-hbase4:43387] regionserver.HRegionServer(1507): Waiting on 1588230740, fb246572de1d9acdcf6c8de873cbb51f 2024-01-14 12:56:42,153 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-01-14 12:56:42,154 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-01-14 12:56:42,170 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=12.16 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/meta/1588230740/.tmp/info/16ef0520448c4d8986ff32598c00d022 2024-01-14 12:56:42,180 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=597 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/quota/fb246572de1d9acdcf6c8de873cbb51f/.tmp/q/155a4204a7b9499daf7ccab10b3ef66d 2024-01-14 12:56:42,183 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=147 B at sequenceid=8 (bloomFilter=true), to=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/namespace/1087cef0e34ba5a7689c8b4bb8203c42/.tmp/info/d790ae424f2848d5ab1cb1efc14216cf 2024-01-14 12:56:42,186 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 16ef0520448c4d8986ff32598c00d022 2024-01-14 12:56:42,188 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 155a4204a7b9499daf7ccab10b3ef66d 2024-01-14 12:56:42,192 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d790ae424f2848d5ab1cb1efc14216cf 2024-01-14 12:56:42,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/namespace/1087cef0e34ba5a7689c8b4bb8203c42/.tmp/info/d790ae424f2848d5ab1cb1efc14216cf as hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/namespace/1087cef0e34ba5a7689c8b4bb8203c42/info/d790ae424f2848d5ab1cb1efc14216cf 2024-01-14 12:56:42,208 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=478 B at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/meta/1588230740/.tmp/rep_barrier/c8a6e5f5025b42a2b3bea352f90c6ff3 2024-01-14 12:56:42,208 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=129 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/quota/fb246572de1d9acdcf6c8de873cbb51f/.tmp/u/9b99ff11fa444c3f81f6450375ffe13f 2024-01-14 12:56:42,209 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d790ae424f2848d5ab1cb1efc14216cf 2024-01-14 12:56:42,209 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/namespace/1087cef0e34ba5a7689c8b4bb8203c42/info/d790ae424f2848d5ab1cb1efc14216cf, entries=3, sequenceid=8, filesize=5.0 K 2024-01-14 12:56:42,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~147 B/147, heapSize ~688 B/688, currentSize=0 B/0 for 1087cef0e34ba5a7689c8b4bb8203c42 in 83ms, sequenceid=8, compaction requested=false 2024-01-14 12:56:42,217 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/namespace/1087cef0e34ba5a7689c8b4bb8203c42/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=1 2024-01-14 12:56:42,218 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c8a6e5f5025b42a2b3bea352f90c6ff3 2024-01-14 12:56:42,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1705236935101.1087cef0e34ba5a7689c8b4bb8203c42. 2024-01-14 12:56:42,218 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1087cef0e34ba5a7689c8b4bb8203c42: 2024-01-14 12:56:42,219 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1705236935101.1087cef0e34ba5a7689c8b4bb8203c42. 2024-01-14 12:56:42,219 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9b99ff11fa444c3f81f6450375ffe13f 2024-01-14 12:56:42,220 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/quota/fb246572de1d9acdcf6c8de873cbb51f/.tmp/q/155a4204a7b9499daf7ccab10b3ef66d as hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/quota/fb246572de1d9acdcf6c8de873cbb51f/q/155a4204a7b9499daf7ccab10b3ef66d 2024-01-14 12:56:42,229 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 155a4204a7b9499daf7ccab10b3ef66d 2024-01-14 12:56:42,230 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/quota/fb246572de1d9acdcf6c8de873cbb51f/q/155a4204a7b9499daf7ccab10b3ef66d, entries=5, sequenceid=17, filesize=5.1 K 2024-01-14 12:56:42,232 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/quota/fb246572de1d9acdcf6c8de873cbb51f/.tmp/u/9b99ff11fa444c3f81f6450375ffe13f as hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/quota/fb246572de1d9acdcf6c8de873cbb51f/u/9b99ff11fa444c3f81f6450375ffe13f 2024-01-14 12:56:42,235 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.53 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/meta/1588230740/.tmp/table/dc15cbdc4b5b48728bdc5265ebece4ba 2024-01-14 12:56:42,241 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9b99ff11fa444c3f81f6450375ffe13f 2024-01-14 12:56:42,241 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/quota/fb246572de1d9acdcf6c8de873cbb51f/u/9b99ff11fa444c3f81f6450375ffe13f, entries=4, sequenceid=17, filesize=5.0 K 2024-01-14 12:56:42,242 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~726 B/726, heapSize ~2.41 KB/2464, currentSize=0 B/0 for fb246572de1d9acdcf6c8de873cbb51f in 115ms, sequenceid=17, compaction requested=false 2024-01-14 12:56:42,244 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dc15cbdc4b5b48728bdc5265ebece4ba 2024-01-14 12:56:42,247 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/meta/1588230740/.tmp/info/16ef0520448c4d8986ff32598c00d022 as hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/meta/1588230740/info/16ef0520448c4d8986ff32598c00d022 2024-01-14 12:56:42,250 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/quota/fb246572de1d9acdcf6c8de873cbb51f/recovered.edits/20.seqid, newMaxSeqId=20, maxSeqId=1 2024-01-14 12:56:42,251 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:quota,,1705236935828.fb246572de1d9acdcf6c8de873cbb51f. 2024-01-14 12:56:42,251 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fb246572de1d9acdcf6c8de873cbb51f: 2024-01-14 12:56:42,251 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:quota,,1705236935828.fb246572de1d9acdcf6c8de873cbb51f. 2024-01-14 12:56:42,255 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 16ef0520448c4d8986ff32598c00d022 2024-01-14 12:56:42,255 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/meta/1588230740/info/16ef0520448c4d8986ff32598c00d022, entries=30, sequenceid=66, filesize=8.0 K 2024-01-14 12:56:42,256 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/meta/1588230740/.tmp/rep_barrier/c8a6e5f5025b42a2b3bea352f90c6ff3 as hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/meta/1588230740/rep_barrier/c8a6e5f5025b42a2b3bea352f90c6ff3 2024-01-14 12:56:42,263 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c8a6e5f5025b42a2b3bea352f90c6ff3 2024-01-14 12:56:42,263 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/meta/1588230740/rep_barrier/c8a6e5f5025b42a2b3bea352f90c6ff3, entries=5, sequenceid=66, filesize=5.3 K 2024-01-14 12:56:42,264 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/meta/1588230740/.tmp/table/dc15cbdc4b5b48728bdc5265ebece4ba as hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/meta/1588230740/table/dc15cbdc4b5b48728bdc5265ebece4ba 2024-01-14 12:56:42,271 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dc15cbdc4b5b48728bdc5265ebece4ba 2024-01-14 12:56:42,271 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/meta/1588230740/table/dc15cbdc4b5b48728bdc5265ebece4ba, entries=13, sequenceid=66, filesize=5.6 K 2024-01-14 12:56:42,272 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~14.15 KB/14494, heapSize ~25.05 KB/25656, currentSize=0 B/0 for 1588230740 in 143ms, sequenceid=66, compaction requested=false 2024-01-14 12:56:42,280 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/data/hbase/meta/1588230740/recovered.edits/69.seqid, newMaxSeqId=69, maxSeqId=1 2024-01-14 12:56:42,281 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-01-14 12:56:42,281 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-01-14 12:56:42,281 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-01-14 12:56:42,281 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2024-01-14 12:56:42,330 INFO [RS:0;jenkins-hbase4:46767] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,46767,1705236933216; all regions closed. 2024-01-14 12:56:42,330 INFO [RS:1;jenkins-hbase4:43387] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,43387,1705236933265; all regions closed. 2024-01-14 12:56:42,330 DEBUG [RS:1;jenkins-hbase4:43387] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-01-14 12:56:42,330 DEBUG [RS:0;jenkins-hbase4:46767] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-01-14 12:56:42,342 DEBUG [RS:1;jenkins-hbase4:43387] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/oldWALs 2024-01-14 12:56:42,343 INFO [RS:1;jenkins-hbase4:43387] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43387%2C1705236933265.meta:.meta(num 1705236934847) 2024-01-14 12:56:42,348 DEBUG [RS:0;jenkins-hbase4:46767] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/oldWALs 2024-01-14 12:56:42,348 INFO [RS:0;jenkins-hbase4:46767] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C46767%2C1705236933216:(num 1705236934748) 2024-01-14 12:56:42,348 DEBUG [RS:0;jenkins-hbase4:46767] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-14 12:56:42,348 INFO [RS:0;jenkins-hbase4:46767] regionserver.LeaseManager(133): Closed leases 2024-01-14 12:56:42,348 INFO [RS:0;jenkins-hbase4:46767] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2024-01-14 12:56:42,349 INFO [RS:0;jenkins-hbase4:46767] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-01-14 12:56:42,349 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-01-14 12:56:42,349 INFO [RS:0;jenkins-hbase4:46767] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-01-14 12:56:42,349 INFO [RS:0;jenkins-hbase4:46767] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-01-14 12:56:42,350 INFO [RS:0;jenkins-hbase4:46767] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46767 2024-01-14 12:56:42,350 DEBUG [RS:1;jenkins-hbase4:43387] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/oldWALs 2024-01-14 12:56:42,350 INFO [RS:1;jenkins-hbase4:43387] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43387%2C1705236933265:(num 1705236934748) 2024-01-14 12:56:42,350 DEBUG [RS:1;jenkins-hbase4:43387] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-14 12:56:42,351 INFO [RS:1;jenkins-hbase4:43387] regionserver.LeaseManager(133): Closed leases 2024-01-14 12:56:42,351 INFO [RS:1;jenkins-hbase4:43387] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2024-01-14 12:56:42,351 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-01-14 12:56:42,352 INFO [RS:1;jenkins-hbase4:43387] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43387 2024-01-14 12:56:42,358 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): regionserver:43387-0x101261a83410002, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43387,1705236933265 2024-01-14 12:56:42,358 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-01-14 12:56:42,358 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): regionserver:43387-0x101261a83410002, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-01-14 12:56:42,358 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): regionserver:46767-0x101261a83410001, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43387,1705236933265 2024-01-14 12:56:42,359 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): regionserver:46767-0x101261a83410001, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-01-14 12:56:42,359 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): regionserver:46767-0x101261a83410001, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46767,1705236933216 2024-01-14 12:56:42,359 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): regionserver:43387-0x101261a83410002, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,46767,1705236933216 2024-01-14 12:56:42,360 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,46767,1705236933216] 2024-01-14 12:56:42,360 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,46767,1705236933216; numProcessing=1 2024-01-14 12:56:42,361 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,46767,1705236933216 already deleted, retry=false 2024-01-14 12:56:42,361 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,46767,1705236933216 expired; onlineServers=1 2024-01-14 12:56:42,361 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43387,1705236933265] 2024-01-14 12:56:42,361 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43387,1705236933265; numProcessing=2 2024-01-14 12:56:42,362 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43387,1705236933265 already deleted, retry=false 2024-01-14 12:56:42,362 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,43387,1705236933265 expired; onlineServers=0 2024-01-14 12:56:42,362 INFO [RegionServerTracker-0] regionserver.HRegionServer(2300): ***** STOPPING region server 'jenkins-hbase4.apache.org,39225,1705236931219' ***** 2024-01-14 12:56:42,362 INFO [RegionServerTracker-0] regionserver.HRegionServer(2314): STOPPED: Cluster shutdown set; onlineServer=0 2024-01-14 12:56:42,363 DEBUG [M:0;jenkins-hbase4:39225] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@74cc9e10, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-01-14 12:56:42,363 INFO [M:0;jenkins-hbase4:39225] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,39225,1705236931219 2024-01-14 12:56:42,363 INFO [M:0;jenkins-hbase4:39225] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,39225,1705236931219; all regions closed. 2024-01-14 12:56:42,363 DEBUG [M:0;jenkins-hbase4:39225] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-14 12:56:42,364 DEBUG [M:0;jenkins-hbase4:39225] cleaner.LogCleaner(198): Cancelling LogCleaner 2024-01-14 12:56:42,364 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2024-01-14 12:56:42,364 DEBUG [M:0;jenkins-hbase4:39225] cleaner.HFileCleaner(317): Stopping file delete threads 2024-01-14 12:56:42,364 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1705236934364] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1705236934364,5,FailOnTimeoutGroup] 2024-01-14 12:56:42,364 INFO [M:0;jenkins-hbase4:39225] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2024-01-14 12:56:42,364 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1705236934364] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1705236934364,5,FailOnTimeoutGroup] 2024-01-14 12:56:42,364 INFO [M:0;jenkins-hbase4:39225] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2024-01-14 12:56:42,364 INFO [M:0;jenkins-hbase4:39225] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS] on shutdown 2024-01-14 12:56:42,364 DEBUG [M:0;jenkins-hbase4:39225] master.HMaster(1517): Stopping service threads 2024-01-14 12:56:42,364 INFO [M:0;jenkins-hbase4:39225] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2024-01-14 12:56:42,365 ERROR [M:0;jenkins-hbase4:39225] procedure2.ProcedureExecutor(699): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-8,5,PEWorkerGroup] Thread[HFileArchiver-9,5,PEWorkerGroup] Thread[HFileArchiver-10,5,PEWorkerGroup] Thread[HFileArchiver-11,5,PEWorkerGroup] Thread[HFileArchiver-12,5,PEWorkerGroup] 2024-01-14 12:56:42,365 INFO [M:0;jenkins-hbase4:39225] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2024-01-14 12:56:42,365 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2024-01-14 12:56:42,366 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2024-01-14 12:56:42,366 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-14 12:56:42,366 DEBUG [M:0;jenkins-hbase4:39225] zookeeper.ZKUtil(399): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2024-01-14 12:56:42,366 WARN [M:0;jenkins-hbase4:39225] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2024-01-14 12:56:42,366 INFO [M:0;jenkins-hbase4:39225] assignment.AssignmentManager(315): Stopping assignment manager 2024-01-14 12:56:42,366 INFO [M:0;jenkins-hbase4:39225] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2024-01-14 12:56:42,367 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-01-14 12:56:42,367 DEBUG [M:0;jenkins-hbase4:39225] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-01-14 12:56:42,367 INFO [M:0;jenkins-hbase4:39225] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-14 12:56:42,367 DEBUG [M:0;jenkins-hbase4:39225] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-14 12:56:42,367 DEBUG [M:0;jenkins-hbase4:39225] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-01-14 12:56:42,367 DEBUG [M:0;jenkins-hbase4:39225] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-14 12:56:42,367 INFO [M:0;jenkins-hbase4:39225] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=152.91 KB heapSize=184.75 KB 2024-01-14 12:56:42,383 INFO [M:0;jenkins-hbase4:39225] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=152.91 KB at sequenceid=376 (bloomFilter=true), to=hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/77d36b9c7612453e92f4c2bdce211f4d 2024-01-14 12:56:42,389 INFO [M:0;jenkins-hbase4:39225] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 77d36b9c7612453e92f4c2bdce211f4d 2024-01-14 12:56:42,390 DEBUG [M:0;jenkins-hbase4:39225] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/77d36b9c7612453e92f4c2bdce211f4d as hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/77d36b9c7612453e92f4c2bdce211f4d 2024-01-14 12:56:42,397 INFO [M:0;jenkins-hbase4:39225] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 77d36b9c7612453e92f4c2bdce211f4d 2024-01-14 12:56:42,397 INFO [M:0;jenkins-hbase4:39225] regionserver.HStore(1080): Added hdfs://localhost:38453/user/jenkins/test-data/1e49a863-e762-8251-5dad-c5e402fdf2aa/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/77d36b9c7612453e92f4c2bdce211f4d, entries=45, sequenceid=376, filesize=12.0 K 2024-01-14 12:56:42,398 INFO [M:0;jenkins-hbase4:39225] regionserver.HRegion(2948): Finished flush of dataSize ~152.91 KB/156584, heapSize ~184.73 KB/189168, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 31ms, sequenceid=376, compaction requested=false 2024-01-14 12:56:42,399 INFO [M:0;jenkins-hbase4:39225] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-14 12:56:42,399 DEBUG [M:0;jenkins-hbase4:39225] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-01-14 12:56:42,403 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-01-14 12:56:42,403 INFO [M:0;jenkins-hbase4:39225] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2024-01-14 12:56:42,403 INFO [M:0;jenkins-hbase4:39225] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39225 2024-01-14 12:56:42,405 DEBUG [M:0;jenkins-hbase4:39225] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39225,1705236931219 already deleted, retry=false 2024-01-14 12:56:42,461 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): regionserver:43387-0x101261a83410002, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-14 12:56:42,461 INFO [RS:0;jenkins-hbase4:46767] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,46767,1705236933216; zookeeper connection closed. 2024-01-14 12:56:42,461 INFO [RS:1;jenkins-hbase4:43387] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,43387,1705236933265; zookeeper connection closed. 2024-01-14 12:56:42,461 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): regionserver:46767-0x101261a83410001, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-14 12:56:42,461 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): regionserver:46767-0x101261a83410001, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-14 12:56:42,461 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): regionserver:43387-0x101261a83410002, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-14 12:56:42,461 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@aa18d3] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@aa18d3 2024-01-14 12:56:42,461 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@318e6e4e] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@318e6e4e 2024-01-14 12:56:42,461 INFO [Listener at localhost/35643] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2024-01-14 12:56:42,506 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-14 12:56:42,506 INFO [M:0;jenkins-hbase4:39225] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,39225,1705236931219; zookeeper connection closed. 2024-01-14 12:56:42,506 DEBUG [Listener at localhost/35643-EventThread] zookeeper.ZKWatcher(600): master:39225-0x101261a83410000, quorum=127.0.0.1:56570, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-14 12:56:42,508 WARN [Listener at localhost/35643] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-01-14 12:56:42,511 INFO [Listener at localhost/35643] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-01-14 12:56:42,616 WARN [BP-295222750-172.31.14.131-1705236928116 heartbeating to localhost/127.0.0.1:38453] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-01-14 12:56:42,616 WARN [BP-295222750-172.31.14.131-1705236928116 heartbeating to localhost/127.0.0.1:38453] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-295222750-172.31.14.131-1705236928116 (Datanode Uuid 985fe5d6-a5ac-4b33-bb59-9378bf0468a7) service to localhost/127.0.0.1:38453 2024-01-14 12:56:42,618 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/cluster_7ca30cfd-5fc2-8b91-2431-1c30bd8c205f/dfs/data/data3/current/BP-295222750-172.31.14.131-1705236928116] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-01-14 12:56:42,619 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/cluster_7ca30cfd-5fc2-8b91-2431-1c30bd8c205f/dfs/data/data4/current/BP-295222750-172.31.14.131-1705236928116] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-01-14 12:56:42,619 WARN [Listener at localhost/35643] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-01-14 12:56:42,622 INFO [Listener at localhost/35643] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-01-14 12:56:42,725 WARN [BP-295222750-172.31.14.131-1705236928116 heartbeating to localhost/127.0.0.1:38453] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-01-14 12:56:42,725 WARN [BP-295222750-172.31.14.131-1705236928116 heartbeating to localhost/127.0.0.1:38453] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-295222750-172.31.14.131-1705236928116 (Datanode Uuid e12a4588-aeff-4370-b38a-ca63337296d6) service to localhost/127.0.0.1:38453 2024-01-14 12:56:42,726 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/cluster_7ca30cfd-5fc2-8b91-2431-1c30bd8c205f/dfs/data/data1/current/BP-295222750-172.31.14.131-1705236928116] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-01-14 12:56:42,726 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/186a95db-6d5d-a54b-dcaf-71acd25e90ff/cluster_7ca30cfd-5fc2-8b91-2431-1c30bd8c205f/dfs/data/data2/current/BP-295222750-172.31.14.131-1705236928116] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-01-14 12:56:42,763 INFO [Listener at localhost/35643] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-01-14 12:56:42,877 INFO [Listener at localhost/35643] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2024-01-14 12:56:42,912 INFO [Listener at localhost/35643] hbase.HBaseTestingUtility(1293): Minicluster is down