2024-01-27 22:55:35,535 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle timeout: 13 mins 2024-01-27 22:55:35,777 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385 2024-01-27 22:55:35,797 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2024-01-27 22:55:35,798 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/cluster_8fe42a6e-af8f-b55b-43a1-711a5ebae4d9, deleteOnExit=true 2024-01-27 22:55:35,798 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2024-01-27 22:55:35,799 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/test.cache.data in system properties and HBase conf 2024-01-27 22:55:35,799 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/hadoop.tmp.dir in system properties and HBase conf 2024-01-27 22:55:35,800 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/hadoop.log.dir in system properties and HBase conf 2024-01-27 22:55:35,800 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/mapreduce.cluster.local.dir in system properties and HBase conf 2024-01-27 22:55:35,801 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/mapreduce.cluster.temp.dir in system properties and HBase conf 2024-01-27 22:55:35,801 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2024-01-27 22:55:35,915 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2024-01-27 22:55:36,314 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-01-27 22:55:36,319 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2024-01-27 22:55:36,319 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2024-01-27 22:55:36,319 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/yarn.nodemanager.log-dirs in system properties and HBase conf 2024-01-27 22:55:36,320 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-01-27 22:55:36,320 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2024-01-27 22:55:36,320 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2024-01-27 22:55:36,321 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-01-27 22:55:36,321 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/dfs.journalnode.edits.dir in system properties and HBase conf 2024-01-27 22:55:36,322 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2024-01-27 22:55:36,322 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/nfs.dump.dir in system properties and HBase conf 2024-01-27 22:55:36,323 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/java.io.tmpdir in system properties and HBase conf 2024-01-27 22:55:36,323 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/dfs.journalnode.edits.dir in system properties and HBase conf 2024-01-27 22:55:36,323 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2024-01-27 22:55:36,323 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2024-01-27 22:55:36,914 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-01-27 22:55:36,919 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-01-27 22:55:37,222 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2024-01-27 22:55:37,406 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2024-01-27 22:55:37,434 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-01-27 22:55:37,474 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2024-01-27 22:55:37,510 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/java.io.tmpdir/Jetty_localhost_39365_hdfs____nliugm/webapp 2024-01-27 22:55:37,644 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:39365 2024-01-27 22:55:37,654 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-01-27 22:55:37,654 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-01-27 22:55:38,147 WARN [Listener at localhost/43607] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-01-27 22:55:38,223 WARN [Listener at localhost/43607] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-01-27 22:55:38,243 WARN [Listener at localhost/43607] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-01-27 22:55:38,249 INFO [Listener at localhost/43607] log.Slf4jLog(67): jetty-6.1.26 2024-01-27 22:55:38,253 INFO [Listener at localhost/43607] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/java.io.tmpdir/Jetty_localhost_34611_datanode____mc0kzg/webapp 2024-01-27 22:55:38,360 INFO [Listener at localhost/43607] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34611 2024-01-27 22:55:38,665 WARN [Listener at localhost/46449] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-01-27 22:55:38,675 WARN [Listener at localhost/46449] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-01-27 22:55:38,679 WARN [Listener at localhost/46449] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-01-27 22:55:38,681 INFO [Listener at localhost/46449] log.Slf4jLog(67): jetty-6.1.26 2024-01-27 22:55:38,689 INFO [Listener at localhost/46449] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/java.io.tmpdir/Jetty_localhost_41587_datanode____si3932/webapp 2024-01-27 22:55:38,794 INFO [Listener at localhost/46449] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41587 2024-01-27 22:55:38,808 WARN [Listener at localhost/33045] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-01-27 22:55:39,197 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x784443a6ea15f72b: Processing first storage report for DS-178a0768-d045-46ed-9cdb-82e994ed17ba from datanode 06a61f3b-eb92-4fe9-98d8-61d83aafa172 2024-01-27 22:55:39,199 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x784443a6ea15f72b: from storage DS-178a0768-d045-46ed-9cdb-82e994ed17ba node DatanodeRegistration(127.0.0.1:45383, datanodeUuid=06a61f3b-eb92-4fe9-98d8-61d83aafa172, infoPort=37511, infoSecurePort=0, ipcPort=46449, storageInfo=lv=-57;cid=testClusterID;nsid=143432856;c=1706396136997), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2024-01-27 22:55:39,199 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x64324f8ada8723b2: Processing first storage report for DS-ced45963-cab5-4b5e-b01e-e90611ac82cd from datanode be2925d0-c170-4730-af82-ab14c7c79cd3 2024-01-27 22:55:39,199 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x64324f8ada8723b2: from storage DS-ced45963-cab5-4b5e-b01e-e90611ac82cd node DatanodeRegistration(127.0.0.1:36659, datanodeUuid=be2925d0-c170-4730-af82-ab14c7c79cd3, infoPort=37373, infoSecurePort=0, ipcPort=33045, storageInfo=lv=-57;cid=testClusterID;nsid=143432856;c=1706396136997), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2024-01-27 22:55:39,199 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x784443a6ea15f72b: Processing first storage report for DS-2f18a4ed-0f37-4ca2-86a8-518d216bbe6f from datanode 06a61f3b-eb92-4fe9-98d8-61d83aafa172 2024-01-27 22:55:39,200 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x784443a6ea15f72b: from storage DS-2f18a4ed-0f37-4ca2-86a8-518d216bbe6f node DatanodeRegistration(127.0.0.1:45383, datanodeUuid=06a61f3b-eb92-4fe9-98d8-61d83aafa172, infoPort=37511, infoSecurePort=0, ipcPort=46449, storageInfo=lv=-57;cid=testClusterID;nsid=143432856;c=1706396136997), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-01-27 22:55:39,200 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x64324f8ada8723b2: Processing first storage report for DS-a29d4941-34a4-4c34-a355-986d6f2e7388 from datanode be2925d0-c170-4730-af82-ab14c7c79cd3 2024-01-27 22:55:39,200 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x64324f8ada8723b2: from storage DS-a29d4941-34a4-4c34-a355-986d6f2e7388 node DatanodeRegistration(127.0.0.1:36659, datanodeUuid=be2925d0-c170-4730-af82-ab14c7c79cd3, infoPort=37373, infoSecurePort=0, ipcPort=33045, storageInfo=lv=-57;cid=testClusterID;nsid=143432856;c=1706396136997), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-01-27 22:55:39,254 DEBUG [Listener at localhost/33045] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385 2024-01-27 22:55:39,362 INFO [Listener at localhost/33045] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/cluster_8fe42a6e-af8f-b55b-43a1-711a5ebae4d9/zookeeper_0, clientPort=60512, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/cluster_8fe42a6e-af8f-b55b-43a1-711a5ebae4d9/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/cluster_8fe42a6e-af8f-b55b-43a1-711a5ebae4d9/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2024-01-27 22:55:39,392 INFO [Listener at localhost/33045] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60512 2024-01-27 22:55:39,400 INFO [Listener at localhost/33045] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-27 22:55:39,402 INFO [Listener at localhost/33045] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-27 22:55:40,077 INFO [Listener at localhost/33045] util.FSUtils(471): Created version file at hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471 with version=8 2024-01-27 22:55:40,077 INFO [Listener at localhost/33045] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/hbase-staging 2024-01-27 22:55:40,396 INFO [Listener at localhost/33045] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2024-01-27 22:55:40,871 INFO [Listener at localhost/33045] client.ConnectionUtils(126): master/jenkins-hbase4:0 server-side Connection retries=45 2024-01-27 22:55:40,903 INFO [Listener at localhost/33045] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-27 22:55:40,903 INFO [Listener at localhost/33045] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-01-27 22:55:40,903 INFO [Listener at localhost/33045] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-01-27 22:55:40,903 INFO [Listener at localhost/33045] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-27 22:55:40,904 INFO [Listener at localhost/33045] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-01-27 22:55:41,060 INFO [Listener at localhost/33045] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2024-01-27 22:55:41,147 DEBUG [Listener at localhost/33045] util.ClassSize(228): Using Unsafe to estimate memory layout 2024-01-27 22:55:41,260 INFO [Listener at localhost/33045] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38947 2024-01-27 22:55:41,270 INFO [Listener at localhost/33045] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-27 22:55:41,272 INFO [Listener at localhost/33045] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-27 22:55:41,297 INFO [Listener at localhost/33045] zookeeper.RecoverableZooKeeper(93): Process identifier=master:38947 connecting to ZooKeeper ensemble=127.0.0.1:60512 2024-01-27 22:55:41,341 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:389470x0, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-01-27 22:55:41,343 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:38947-0x1016b32a36e0000 connected 2024-01-27 22:55:41,376 DEBUG [Listener at localhost/33045] zookeeper.ZKUtil(165): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-01-27 22:55:41,378 DEBUG [Listener at localhost/33045] zookeeper.ZKUtil(165): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-27 22:55:41,381 DEBUG [Listener at localhost/33045] zookeeper.ZKUtil(165): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-01-27 22:55:41,389 DEBUG [Listener at localhost/33045] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38947 2024-01-27 22:55:41,390 DEBUG [Listener at localhost/33045] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38947 2024-01-27 22:55:41,390 DEBUG [Listener at localhost/33045] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38947 2024-01-27 22:55:41,390 DEBUG [Listener at localhost/33045] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38947 2024-01-27 22:55:41,391 DEBUG [Listener at localhost/33045] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38947 2024-01-27 22:55:41,396 INFO [Listener at localhost/33045] master.HMaster(445): hbase.rootdir=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471, hbase.cluster.distributed=false 2024-01-27 22:55:41,472 INFO [Listener at localhost/33045] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-01-27 22:55:41,472 INFO [Listener at localhost/33045] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-27 22:55:41,472 INFO [Listener at localhost/33045] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-01-27 22:55:41,472 INFO [Listener at localhost/33045] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-01-27 22:55:41,472 INFO [Listener at localhost/33045] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-27 22:55:41,472 INFO [Listener at localhost/33045] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-01-27 22:55:41,477 INFO [Listener at localhost/33045] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-01-27 22:55:41,480 INFO [Listener at localhost/33045] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38023 2024-01-27 22:55:41,482 INFO [Listener at localhost/33045] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-01-27 22:55:41,489 DEBUG [Listener at localhost/33045] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-01-27 22:55:41,490 INFO [Listener at localhost/33045] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-27 22:55:41,492 INFO [Listener at localhost/33045] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-27 22:55:41,494 INFO [Listener at localhost/33045] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38023 connecting to ZooKeeper ensemble=127.0.0.1:60512 2024-01-27 22:55:41,498 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): regionserver:380230x0, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-01-27 22:55:41,499 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38023-0x1016b32a36e0001 connected 2024-01-27 22:55:41,499 DEBUG [Listener at localhost/33045] zookeeper.ZKUtil(165): regionserver:38023-0x1016b32a36e0001, quorum=127.0.0.1:60512, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-01-27 22:55:41,501 DEBUG [Listener at localhost/33045] zookeeper.ZKUtil(165): regionserver:38023-0x1016b32a36e0001, quorum=127.0.0.1:60512, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-27 22:55:41,502 DEBUG [Listener at localhost/33045] zookeeper.ZKUtil(165): regionserver:38023-0x1016b32a36e0001, quorum=127.0.0.1:60512, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-01-27 22:55:41,503 DEBUG [Listener at localhost/33045] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38023 2024-01-27 22:55:41,503 DEBUG [Listener at localhost/33045] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38023 2024-01-27 22:55:41,503 DEBUG [Listener at localhost/33045] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38023 2024-01-27 22:55:41,504 DEBUG [Listener at localhost/33045] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38023 2024-01-27 22:55:41,504 DEBUG [Listener at localhost/33045] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38023 2024-01-27 22:55:41,517 INFO [Listener at localhost/33045] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-01-27 22:55:41,517 INFO [Listener at localhost/33045] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-27 22:55:41,517 INFO [Listener at localhost/33045] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-01-27 22:55:41,517 INFO [Listener at localhost/33045] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-01-27 22:55:41,518 INFO [Listener at localhost/33045] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-27 22:55:41,518 INFO [Listener at localhost/33045] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-01-27 22:55:41,518 INFO [Listener at localhost/33045] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-01-27 22:55:41,519 INFO [Listener at localhost/33045] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44077 2024-01-27 22:55:41,520 INFO [Listener at localhost/33045] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-01-27 22:55:41,521 DEBUG [Listener at localhost/33045] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-01-27 22:55:41,522 INFO [Listener at localhost/33045] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-27 22:55:41,524 INFO [Listener at localhost/33045] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-27 22:55:41,527 INFO [Listener at localhost/33045] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:44077 connecting to ZooKeeper ensemble=127.0.0.1:60512 2024-01-27 22:55:41,532 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): regionserver:440770x0, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-01-27 22:55:41,533 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:44077-0x1016b32a36e0002 connected 2024-01-27 22:55:41,533 DEBUG [Listener at localhost/33045] zookeeper.ZKUtil(165): regionserver:44077-0x1016b32a36e0002, quorum=127.0.0.1:60512, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-01-27 22:55:41,534 DEBUG [Listener at localhost/33045] zookeeper.ZKUtil(165): regionserver:44077-0x1016b32a36e0002, quorum=127.0.0.1:60512, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-27 22:55:41,535 DEBUG [Listener at localhost/33045] zookeeper.ZKUtil(165): regionserver:44077-0x1016b32a36e0002, quorum=127.0.0.1:60512, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-01-27 22:55:41,535 DEBUG [Listener at localhost/33045] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44077 2024-01-27 22:55:41,536 DEBUG [Listener at localhost/33045] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44077 2024-01-27 22:55:41,536 DEBUG [Listener at localhost/33045] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44077 2024-01-27 22:55:41,536 DEBUG [Listener at localhost/33045] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44077 2024-01-27 22:55:41,537 DEBUG [Listener at localhost/33045] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44077 2024-01-27 22:55:41,538 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2174): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,38947,1706396140219 2024-01-27 22:55:41,547 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-01-27 22:55:41,549 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,38947,1706396140219 2024-01-27 22:55:41,568 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): regionserver:38023-0x1016b32a36e0001, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-01-27 22:55:41,568 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): regionserver:44077-0x1016b32a36e0002, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-01-27 22:55:41,568 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-01-27 22:55:41,569 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-27 22:55:41,570 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-01-27 22:55:41,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,38947,1706396140219 from backup master directory 2024-01-27 22:55:41,572 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(163): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-01-27 22:55:41,575 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,38947,1706396140219 2024-01-27 22:55:41,575 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-01-27 22:55:41,576 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-01-27 22:55:41,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,38947,1706396140219 2024-01-27 22:55:41,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2024-01-27 22:55:41,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2024-01-27 22:55:41,669 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/hbase.id with ID: 1dccb23b-b96b-4810-9fe4-ecbad0ea624f 2024-01-27 22:55:41,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-27 22:55:41,728 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-27 22:55:41,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x69bbe05b to 127.0.0.1:60512 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-01-27 22:55:41,818 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@cb1de07, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-01-27 22:55:41,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-27 22:55:41,846 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2024-01-27 22:55:41,865 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2024-01-27 22:55:41,865 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2024-01-27 22:55:41,866 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-01-27 22:55:41,870 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-01-27 22:55:41,872 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-01-27 22:55:41,905 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/MasterData/data/master/store-tmp 2024-01-27 22:55:41,939 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-27 22:55:41,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-01-27 22:55:41,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-27 22:55:41,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-27 22:55:41,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-01-27 22:55:41,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-27 22:55:41,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-27 22:55:41,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-01-27 22:55:41,942 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/MasterData/WALs/jenkins-hbase4.apache.org,38947,1706396140219 2024-01-27 22:55:41,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38947%2C1706396140219, suffix=, logDir=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/MasterData/WALs/jenkins-hbase4.apache.org,38947,1706396140219, archiveDir=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/MasterData/oldWALs, maxLogs=10 2024-01-27 22:55:42,020 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36659,DS-ced45963-cab5-4b5e-b01e-e90611ac82cd,DISK] 2024-01-27 22:55:42,020 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45383,DS-178a0768-d045-46ed-9cdb-82e994ed17ba,DISK] 2024-01-27 22:55:42,028 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2024-01-27 22:55:42,093 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/MasterData/WALs/jenkins-hbase4.apache.org,38947,1706396140219/jenkins-hbase4.apache.org%2C38947%2C1706396140219.1706396141970 2024-01-27 22:55:42,093 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:45383,DS-178a0768-d045-46ed-9cdb-82e994ed17ba,DISK], DatanodeInfoWithStorage[127.0.0.1:36659,DS-ced45963-cab5-4b5e-b01e-e90611ac82cd,DISK]] 2024-01-27 22:55:42,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2024-01-27 22:55:42,095 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-27 22:55:42,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2024-01-27 22:55:42,100 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2024-01-27 22:55:42,169 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2024-01-27 22:55:42,177 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2024-01-27 22:55:42,202 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2024-01-27 22:55:42,214 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-27 22:55:42,220 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-01-27 22:55:42,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-01-27 22:55:42,236 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2024-01-27 22:55:42,241 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-27 22:55:42,242 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62485042, jitterRate=-0.06890031695365906}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-27 22:55:42,242 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2024-01-27 22:55:42,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2024-01-27 22:55:42,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2024-01-27 22:55:42,268 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(608): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2024-01-27 22:55:42,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2024-01-27 22:55:42,273 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(628): Recovered RegionProcedureStore lease in 1 msec 2024-01-27 22:55:42,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(642): Loaded RegionProcedureStore in 42 msec 2024-01-27 22:55:42,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2024-01-27 22:55:42,342 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2024-01-27 22:55:42,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2024-01-27 22:55:42,377 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2024-01-27 22:55:42,380 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2024-01-27 22:55:42,382 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2024-01-27 22:55:42,387 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2024-01-27 22:55:42,392 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2024-01-27 22:55:42,395 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-27 22:55:42,397 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2024-01-27 22:55:42,398 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2024-01-27 22:55:42,410 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2024-01-27 22:55:42,415 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): regionserver:44077-0x1016b32a36e0002, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-01-27 22:55:42,415 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): regionserver:38023-0x1016b32a36e0001, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-01-27 22:55:42,415 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-01-27 22:55:42,415 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-27 22:55:42,418 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(745): Active/primary master=jenkins-hbase4.apache.org,38947,1706396140219, sessionid=0x1016b32a36e0000, setting cluster-up flag (Was=false) 2024-01-27 22:55:42,436 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-27 22:55:42,442 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2024-01-27 22:55:42,444 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38947,1706396140219 2024-01-27 22:55:42,454 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-27 22:55:42,460 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2024-01-27 22:55:42,462 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,38947,1706396140219 2024-01-27 22:55:42,465 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.hbase-snapshot/.tmp 2024-01-27 22:55:42,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver loaded, priority=536870911. 2024-01-27 22:55:42,542 INFO [RS:0;jenkins-hbase4:38023] regionserver.HRegionServer(954): ClusterId : 1dccb23b-b96b-4810-9fe4-ecbad0ea624f 2024-01-27 22:55:42,544 INFO [RS:1;jenkins-hbase4:44077] regionserver.HRegionServer(954): ClusterId : 1dccb23b-b96b-4810-9fe4-ecbad0ea624f 2024-01-27 22:55:42,554 DEBUG [RS:0;jenkins-hbase4:38023] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-01-27 22:55:42,556 DEBUG [RS:1;jenkins-hbase4:44077] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-01-27 22:55:42,568 DEBUG [RS:1;jenkins-hbase4:44077] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-01-27 22:55:42,569 DEBUG [RS:1;jenkins-hbase4:44077] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-01-27 22:55:42,573 DEBUG [RS:0;jenkins-hbase4:38023] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-01-27 22:55:42,573 DEBUG [RS:0;jenkins-hbase4:38023] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-01-27 22:55:42,573 DEBUG [RS:1;jenkins-hbase4:44077] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-01-27 22:55:42,579 DEBUG [RS:1;jenkins-hbase4:44077] zookeeper.ReadOnlyZKClient(139): Connect 0x3864b157 to 127.0.0.1:60512 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-01-27 22:55:42,583 DEBUG [RS:0;jenkins-hbase4:38023] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-01-27 22:55:42,595 DEBUG [RS:0;jenkins-hbase4:38023] zookeeper.ReadOnlyZKClient(139): Connect 0x1603212b to 127.0.0.1:60512 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-01-27 22:55:42,606 DEBUG [RS:1;jenkins-hbase4:44077] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36a3482b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-01-27 22:55:42,608 DEBUG [RS:1;jenkins-hbase4:44077] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@329cda27, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-01-27 22:55:42,612 DEBUG [RS:0;jenkins-hbase4:38023] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18c4dd9b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-01-27 22:55:42,612 DEBUG [RS:0;jenkins-hbase4:38023] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1cfb4a5b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-01-27 22:55:42,638 DEBUG [RS:0;jenkins-hbase4:38023] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:38023 2024-01-27 22:55:42,639 DEBUG [RS:1;jenkins-hbase4:44077] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:44077 2024-01-27 22:55:42,643 INFO [RS:1;jenkins-hbase4:44077] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-01-27 22:55:42,643 INFO [RS:0;jenkins-hbase4:38023] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-01-27 22:55:42,643 INFO [RS:1;jenkins-hbase4:44077] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-01-27 22:55:42,644 INFO [RS:0;jenkins-hbase4:38023] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-01-27 22:55:42,644 DEBUG [RS:0;jenkins-hbase4:38023] regionserver.HRegionServer(1025): About to register with Master. 2024-01-27 22:55:42,644 DEBUG [RS:1;jenkins-hbase4:44077] regionserver.HRegionServer(1025): About to register with Master. 2024-01-27 22:55:42,647 INFO [RS:1;jenkins-hbase4:44077] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase4.apache.org,38947,1706396140219 with isa=jenkins-hbase4.apache.org/172.31.14.131:44077, startcode=1706396141516 2024-01-27 22:55:42,647 INFO [RS:0;jenkins-hbase4:38023] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase4.apache.org,38947,1706396140219 with isa=jenkins-hbase4.apache.org/172.31.14.131:38023, startcode=1706396141471 2024-01-27 22:55:42,647 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2024-01-27 22:55:42,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-01-27 22:55:42,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-01-27 22:55:42,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-01-27 22:55:42,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-01-27 22:55:42,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2024-01-27 22:55:42,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-27 22:55:42,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-01-27 22:55:42,659 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-27 22:55:42,661 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1706396172661 2024-01-27 22:55:42,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2024-01-27 22:55:42,668 DEBUG [RS:0;jenkins-hbase4:38023] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-01-27 22:55:42,668 DEBUG [RS:1;jenkins-hbase4:44077] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-01-27 22:55:42,669 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2024-01-27 22:55:42,669 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2024-01-27 22:55:42,675 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-01-27 22:55:42,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2024-01-27 22:55:42,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2024-01-27 22:55:42,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2024-01-27 22:55:42,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2024-01-27 22:55:42,689 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2024-01-27 22:55:42,691 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:42,693 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2024-01-27 22:55:42,694 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2024-01-27 22:55:42,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2024-01-27 22:55:42,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2024-01-27 22:55:42,705 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2024-01-27 22:55:42,712 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1706396142710,5,FailOnTimeoutGroup] 2024-01-27 22:55:42,714 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1706396142713,5,FailOnTimeoutGroup] 2024-01-27 22:55:42,714 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:42,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1466): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2024-01-27 22:55:42,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:42,718 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:42,734 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-01-27 22:55:42,737 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-01-27 22:55:42,738 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471 2024-01-27 22:55:42,739 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52585, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2024-01-27 22:55:42,739 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51607, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2024-01-27 22:55:42,757 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38947] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,44077,1706396141516 2024-01-27 22:55:42,767 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-27 22:55:42,769 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-01-27 22:55:42,773 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/meta/1588230740/info 2024-01-27 22:55:42,774 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38947] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,38023,1706396141471 2024-01-27 22:55:42,775 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-01-27 22:55:42,777 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-27 22:55:42,777 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-01-27 22:55:42,780 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/meta/1588230740/rep_barrier 2024-01-27 22:55:42,781 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-01-27 22:55:42,782 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-27 22:55:42,782 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-01-27 22:55:42,784 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/meta/1588230740/table 2024-01-27 22:55:42,784 DEBUG [RS:0;jenkins-hbase4:38023] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471 2024-01-27 22:55:42,784 DEBUG [RS:1;jenkins-hbase4:44077] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471 2024-01-27 22:55:42,785 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-01-27 22:55:42,785 DEBUG [RS:1;jenkins-hbase4:44077] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:43607 2024-01-27 22:55:42,785 DEBUG [RS:0;jenkins-hbase4:38023] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:43607 2024-01-27 22:55:42,785 DEBUG [RS:1;jenkins-hbase4:44077] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-01-27 22:55:42,786 DEBUG [RS:0;jenkins-hbase4:38023] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-01-27 22:55:42,790 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-27 22:55:42,792 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/meta/1588230740 2024-01-27 22:55:42,792 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/meta/1588230740 2024-01-27 22:55:42,796 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-01-27 22:55:42,797 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-01-27 22:55:42,798 DEBUG [RS:0;jenkins-hbase4:38023] zookeeper.ZKUtil(163): regionserver:38023-0x1016b32a36e0001, quorum=127.0.0.1:60512, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38023,1706396141471 2024-01-27 22:55:42,798 DEBUG [RS:1;jenkins-hbase4:44077] zookeeper.ZKUtil(163): regionserver:44077-0x1016b32a36e0002, quorum=127.0.0.1:60512, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44077,1706396141516 2024-01-27 22:55:42,798 WARN [RS:0;jenkins-hbase4:38023] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-01-27 22:55:42,799 INFO [RS:0;jenkins-hbase4:38023] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-01-27 22:55:42,799 DEBUG [RS:0;jenkins-hbase4:38023] regionserver.HRegionServer(1950): logDir=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/WALs/jenkins-hbase4.apache.org,38023,1706396141471 2024-01-27 22:55:42,798 WARN [RS:1;jenkins-hbase4:44077] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-01-27 22:55:42,800 INFO [RS:1;jenkins-hbase4:44077] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-01-27 22:55:42,801 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38023,1706396141471] 2024-01-27 22:55:42,801 DEBUG [RS:1;jenkins-hbase4:44077] regionserver.HRegionServer(1950): logDir=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/WALs/jenkins-hbase4.apache.org,44077,1706396141516 2024-01-27 22:55:42,802 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,44077,1706396141516] 2024-01-27 22:55:42,804 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2024-01-27 22:55:42,812 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-27 22:55:42,813 DEBUG [RS:0;jenkins-hbase4:38023] zookeeper.ZKUtil(163): regionserver:38023-0x1016b32a36e0001, quorum=127.0.0.1:60512, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38023,1706396141471 2024-01-27 22:55:42,813 DEBUG [RS:1;jenkins-hbase4:44077] zookeeper.ZKUtil(163): regionserver:44077-0x1016b32a36e0002, quorum=127.0.0.1:60512, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38023,1706396141471 2024-01-27 22:55:42,813 DEBUG [RS:0;jenkins-hbase4:38023] zookeeper.ZKUtil(163): regionserver:38023-0x1016b32a36e0001, quorum=127.0.0.1:60512, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44077,1706396141516 2024-01-27 22:55:42,814 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75255112, jitterRate=0.12138855457305908}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-01-27 22:55:42,814 DEBUG [RS:1;jenkins-hbase4:44077] zookeeper.ZKUtil(163): regionserver:44077-0x1016b32a36e0002, quorum=127.0.0.1:60512, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,44077,1706396141516 2024-01-27 22:55:42,814 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2024-01-27 22:55:42,814 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-01-27 22:55:42,814 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-01-27 22:55:42,814 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-01-27 22:55:42,814 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-01-27 22:55:42,814 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-01-27 22:55:42,815 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-01-27 22:55:42,815 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-01-27 22:55:42,823 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2024-01-27 22:55:42,823 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2024-01-27 22:55:42,827 DEBUG [RS:1;jenkins-hbase4:44077] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-01-27 22:55:42,827 DEBUG [RS:0;jenkins-hbase4:38023] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-01-27 22:55:42,833 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2024-01-27 22:55:42,836 INFO [RS:1;jenkins-hbase4:44077] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-01-27 22:55:42,836 INFO [RS:0;jenkins-hbase4:38023] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-01-27 22:55:42,846 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2024-01-27 22:55:42,853 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2024-01-27 22:55:42,864 INFO [RS:1;jenkins-hbase4:44077] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-01-27 22:55:42,868 INFO [RS:0;jenkins-hbase4:38023] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-01-27 22:55:42,872 INFO [RS:1;jenkins-hbase4:44077] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-01-27 22:55:42,872 INFO [RS:0;jenkins-hbase4:38023] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-01-27 22:55:42,872 INFO [RS:1;jenkins-hbase4:44077] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:42,872 INFO [RS:0;jenkins-hbase4:38023] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:42,874 INFO [RS:1;jenkins-hbase4:44077] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-01-27 22:55:42,874 INFO [RS:0;jenkins-hbase4:38023] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-01-27 22:55:42,882 INFO [RS:1;jenkins-hbase4:44077] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:42,882 INFO [RS:0;jenkins-hbase4:38023] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:42,883 DEBUG [RS:1;jenkins-hbase4:44077] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-27 22:55:42,883 DEBUG [RS:0;jenkins-hbase4:38023] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-27 22:55:42,883 DEBUG [RS:1;jenkins-hbase4:44077] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-27 22:55:42,883 DEBUG [RS:0;jenkins-hbase4:38023] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-27 22:55:42,883 DEBUG [RS:1;jenkins-hbase4:44077] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-27 22:55:42,883 DEBUG [RS:0;jenkins-hbase4:38023] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-27 22:55:42,884 DEBUG [RS:1;jenkins-hbase4:44077] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-27 22:55:42,884 DEBUG [RS:0;jenkins-hbase4:38023] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-27 22:55:42,884 DEBUG [RS:1;jenkins-hbase4:44077] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-27 22:55:42,884 DEBUG [RS:0;jenkins-hbase4:38023] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-27 22:55:42,884 DEBUG [RS:1;jenkins-hbase4:44077] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-01-27 22:55:42,884 DEBUG [RS:0;jenkins-hbase4:38023] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-01-27 22:55:42,884 DEBUG [RS:1;jenkins-hbase4:44077] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-27 22:55:42,884 DEBUG [RS:0;jenkins-hbase4:38023] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-27 22:55:42,884 DEBUG [RS:1;jenkins-hbase4:44077] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-27 22:55:42,884 DEBUG [RS:0;jenkins-hbase4:38023] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-27 22:55:42,884 DEBUG [RS:1;jenkins-hbase4:44077] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-27 22:55:42,884 DEBUG [RS:0;jenkins-hbase4:38023] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-27 22:55:42,885 DEBUG [RS:1;jenkins-hbase4:44077] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-27 22:55:42,885 DEBUG [RS:0;jenkins-hbase4:38023] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-27 22:55:42,892 INFO [RS:1;jenkins-hbase4:44077] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:42,893 INFO [RS:1;jenkins-hbase4:44077] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:42,893 INFO [RS:1;jenkins-hbase4:44077] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:42,893 INFO [RS:1;jenkins-hbase4:44077] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:42,896 INFO [RS:0;jenkins-hbase4:38023] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:42,896 INFO [RS:0;jenkins-hbase4:38023] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:42,896 INFO [RS:0;jenkins-hbase4:38023] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:42,897 INFO [RS:0;jenkins-hbase4:38023] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:42,910 INFO [RS:0;jenkins-hbase4:38023] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-01-27 22:55:42,914 INFO [RS:0;jenkins-hbase4:38023] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38023,1706396141471-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:42,910 INFO [RS:1;jenkins-hbase4:44077] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-01-27 22:55:42,914 INFO [RS:1;jenkins-hbase4:44077] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44077,1706396141516-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:42,939 INFO [RS:0;jenkins-hbase4:38023] regionserver.Replication(203): jenkins-hbase4.apache.org,38023,1706396141471 started 2024-01-27 22:55:42,939 INFO [RS:0;jenkins-hbase4:38023] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,38023,1706396141471, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38023, sessionid=0x1016b32a36e0001 2024-01-27 22:55:42,940 INFO [RS:1;jenkins-hbase4:44077] regionserver.Replication(203): jenkins-hbase4.apache.org,44077,1706396141516 started 2024-01-27 22:55:42,940 DEBUG [RS:0;jenkins-hbase4:38023] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-01-27 22:55:42,940 INFO [RS:1;jenkins-hbase4:44077] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,44077,1706396141516, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:44077, sessionid=0x1016b32a36e0002 2024-01-27 22:55:42,940 DEBUG [RS:0;jenkins-hbase4:38023] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38023,1706396141471 2024-01-27 22:55:42,940 DEBUG [RS:1;jenkins-hbase4:44077] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-01-27 22:55:42,940 DEBUG [RS:0;jenkins-hbase4:38023] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38023,1706396141471' 2024-01-27 22:55:42,941 DEBUG [RS:1;jenkins-hbase4:44077] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,44077,1706396141516 2024-01-27 22:55:42,941 DEBUG [RS:0;jenkins-hbase4:38023] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-01-27 22:55:42,941 DEBUG [RS:1;jenkins-hbase4:44077] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44077,1706396141516' 2024-01-27 22:55:42,942 DEBUG [RS:1;jenkins-hbase4:44077] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-01-27 22:55:42,943 DEBUG [RS:0;jenkins-hbase4:38023] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-01-27 22:55:42,943 DEBUG [RS:1;jenkins-hbase4:44077] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-01-27 22:55:42,943 DEBUG [RS:0;jenkins-hbase4:38023] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-01-27 22:55:42,943 DEBUG [RS:1;jenkins-hbase4:44077] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-01-27 22:55:42,943 DEBUG [RS:0;jenkins-hbase4:38023] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-01-27 22:55:42,944 DEBUG [RS:1;jenkins-hbase4:44077] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-01-27 22:55:42,944 DEBUG [RS:0;jenkins-hbase4:38023] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38023,1706396141471 2024-01-27 22:55:42,944 DEBUG [RS:1;jenkins-hbase4:44077] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,44077,1706396141516 2024-01-27 22:55:42,944 DEBUG [RS:1;jenkins-hbase4:44077] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,44077,1706396141516' 2024-01-27 22:55:42,944 DEBUG [RS:1;jenkins-hbase4:44077] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-01-27 22:55:42,944 DEBUG [RS:0;jenkins-hbase4:38023] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38023,1706396141471' 2024-01-27 22:55:42,944 DEBUG [RS:0;jenkins-hbase4:38023] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-01-27 22:55:42,945 DEBUG [RS:1;jenkins-hbase4:44077] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-01-27 22:55:42,945 DEBUG [RS:0;jenkins-hbase4:38023] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-01-27 22:55:42,946 DEBUG [RS:0;jenkins-hbase4:38023] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-01-27 22:55:42,946 INFO [RS:0;jenkins-hbase4:38023] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-01-27 22:55:42,948 INFO [RS:0;jenkins-hbase4:38023] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:42,948 DEBUG [RS:1;jenkins-hbase4:44077] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-01-27 22:55:42,949 INFO [RS:1;jenkins-hbase4:44077] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-01-27 22:55:42,949 INFO [RS:1;jenkins-hbase4:44077] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:42,949 DEBUG [RS:0;jenkins-hbase4:38023] zookeeper.ZKUtil(399): regionserver:38023-0x1016b32a36e0001, quorum=127.0.0.1:60512, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-01-27 22:55:42,949 INFO [RS:0;jenkins-hbase4:38023] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-01-27 22:55:42,950 DEBUG [RS:1;jenkins-hbase4:44077] zookeeper.ZKUtil(399): regionserver:44077-0x1016b32a36e0002, quorum=127.0.0.1:60512, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-01-27 22:55:42,950 INFO [RS:1;jenkins-hbase4:44077] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-01-27 22:55:42,950 INFO [RS:1;jenkins-hbase4:44077] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:42,950 INFO [RS:0;jenkins-hbase4:38023] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:42,950 INFO [RS:1;jenkins-hbase4:44077] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:42,950 INFO [RS:0;jenkins-hbase4:38023] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:43,005 DEBUG [jenkins-hbase4:38947] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=2, allServersCount=2 2024-01-27 22:55:43,009 DEBUG [jenkins-hbase4:38947] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-27 22:55:43,017 DEBUG [jenkins-hbase4:38947] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-27 22:55:43,017 DEBUG [jenkins-hbase4:38947] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-27 22:55:43,017 DEBUG [jenkins-hbase4:38947] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-27 22:55:43,019 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44077,1706396141516, state=OPENING 2024-01-27 22:55:43,028 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2024-01-27 22:55:43,030 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-27 22:55:43,031 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-01-27 22:55:43,034 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44077,1706396141516}] 2024-01-27 22:55:43,063 INFO [RS:1;jenkins-hbase4:44077] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44077%2C1706396141516, suffix=, logDir=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/WALs/jenkins-hbase4.apache.org,44077,1706396141516, archiveDir=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/oldWALs, maxLogs=32 2024-01-27 22:55:43,063 INFO [RS:0;jenkins-hbase4:38023] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38023%2C1706396141471, suffix=, logDir=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/WALs/jenkins-hbase4.apache.org,38023,1706396141471, archiveDir=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/oldWALs, maxLogs=32 2024-01-27 22:55:43,094 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45383,DS-178a0768-d045-46ed-9cdb-82e994ed17ba,DISK] 2024-01-27 22:55:43,094 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36659,DS-ced45963-cab5-4b5e-b01e-e90611ac82cd,DISK] 2024-01-27 22:55:43,094 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36659,DS-ced45963-cab5-4b5e-b01e-e90611ac82cd,DISK] 2024-01-27 22:55:43,095 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45383,DS-178a0768-d045-46ed-9cdb-82e994ed17ba,DISK] 2024-01-27 22:55:43,119 INFO [RS:0;jenkins-hbase4:38023] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/WALs/jenkins-hbase4.apache.org,38023,1706396141471/jenkins-hbase4.apache.org%2C38023%2C1706396141471.1706396143066 2024-01-27 22:55:43,121 DEBUG [RS:0;jenkins-hbase4:38023] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36659,DS-ced45963-cab5-4b5e-b01e-e90611ac82cd,DISK], DatanodeInfoWithStorage[127.0.0.1:45383,DS-178a0768-d045-46ed-9cdb-82e994ed17ba,DISK]] 2024-01-27 22:55:43,125 INFO [RS:1;jenkins-hbase4:44077] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/WALs/jenkins-hbase4.apache.org,44077,1706396141516/jenkins-hbase4.apache.org%2C44077%2C1706396141516.1706396143066 2024-01-27 22:55:43,128 DEBUG [RS:1;jenkins-hbase4:44077] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36659,DS-ced45963-cab5-4b5e-b01e-e90611ac82cd,DISK], DatanodeInfoWithStorage[127.0.0.1:45383,DS-178a0768-d045-46ed-9cdb-82e994ed17ba,DISK]] 2024-01-27 22:55:43,218 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44077,1706396141516 2024-01-27 22:55:43,221 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-01-27 22:55:43,225 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57850, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-01-27 22:55:43,239 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2024-01-27 22:55:43,240 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-01-27 22:55:43,244 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44077%2C1706396141516.meta, suffix=.meta, logDir=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/WALs/jenkins-hbase4.apache.org,44077,1706396141516, archiveDir=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/oldWALs, maxLogs=32 2024-01-27 22:55:43,262 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36659,DS-ced45963-cab5-4b5e-b01e-e90611ac82cd,DISK] 2024-01-27 22:55:43,265 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:45383,DS-178a0768-d045-46ed-9cdb-82e994ed17ba,DISK] 2024-01-27 22:55:43,279 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/WALs/jenkins-hbase4.apache.org,44077,1706396141516/jenkins-hbase4.apache.org%2C44077%2C1706396141516.meta.1706396143245.meta 2024-01-27 22:55:43,280 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:36659,DS-ced45963-cab5-4b5e-b01e-e90611ac82cd,DISK], DatanodeInfoWithStorage[127.0.0.1:45383,DS-178a0768-d045-46ed-9cdb-82e994ed17ba,DISK]] 2024-01-27 22:55:43,281 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2024-01-27 22:55:43,283 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2024-01-27 22:55:43,301 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2024-01-27 22:55:43,306 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2024-01-27 22:55:43,311 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2024-01-27 22:55:43,311 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-27 22:55:43,311 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2024-01-27 22:55:43,311 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2024-01-27 22:55:43,315 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-01-27 22:55:43,317 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/meta/1588230740/info 2024-01-27 22:55:43,317 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/meta/1588230740/info 2024-01-27 22:55:43,318 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-01-27 22:55:43,319 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-27 22:55:43,319 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-01-27 22:55:43,321 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/meta/1588230740/rep_barrier 2024-01-27 22:55:43,321 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/meta/1588230740/rep_barrier 2024-01-27 22:55:43,321 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-01-27 22:55:43,322 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-27 22:55:43,323 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-01-27 22:55:43,324 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/meta/1588230740/table 2024-01-27 22:55:43,324 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/meta/1588230740/table 2024-01-27 22:55:43,325 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-01-27 22:55:43,326 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-27 22:55:43,328 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/meta/1588230740 2024-01-27 22:55:43,331 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/meta/1588230740 2024-01-27 22:55:43,334 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-01-27 22:55:43,337 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2024-01-27 22:55:43,339 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66172445, jitterRate=-0.013953730463981628}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-01-27 22:55:43,339 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2024-01-27 22:55:43,348 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1706396143211 2024-01-27 22:55:43,370 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:meta,,1.1588230740 2024-01-27 22:55:43,371 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2024-01-27 22:55:43,372 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,44077,1706396141516, state=OPEN 2024-01-27 22:55:43,375 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2024-01-27 22:55:43,375 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-01-27 22:55:43,381 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=3, resume processing ppid=2 2024-01-27 22:55:43,381 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,44077,1706396141516 in 342 msec 2024-01-27 22:55:43,388 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=2, resume processing ppid=1 2024-01-27 22:55:43,388 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 550 msec 2024-01-27 22:55:43,393 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 858 msec 2024-01-27 22:55:43,393 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(954): Wait for region servers to report in: status=null, state=RUNNING, startTime=1706396143393, completionTime=-1 2024-01-27 22:55:43,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2024-01-27 22:55:43,394 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2024-01-27 22:55:43,459 DEBUG [hconnection-0x3ecdad6d-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-01-27 22:55:43,462 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57852, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-01-27 22:55:43,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=2 2024-01-27 22:55:43,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1706396203479 2024-01-27 22:55:43,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1706396263479 2024-01-27 22:55:43,479 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 84 msec 2024-01-27 22:55:43,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38947,1706396140219-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:43,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38947,1706396140219-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:43,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38947,1706396140219-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:43,505 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:38947, period=300000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:43,505 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:43,512 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2024-01-27 22:55:43,519 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2024-01-27 22:55:43,521 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-01-27 22:55:43,533 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2024-01-27 22:55:43,537 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2024-01-27 22:55:43,540 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-27 22:55:43,568 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/hbase/namespace/cf62df53c60f75c0443193de3b37411c 2024-01-27 22:55:43,571 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/hbase/namespace/cf62df53c60f75c0443193de3b37411c empty. 2024-01-27 22:55:43,572 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/hbase/namespace/cf62df53c60f75c0443193de3b37411c 2024-01-27 22:55:43,572 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2024-01-27 22:55:43,608 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2024-01-27 22:55:43,610 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => cf62df53c60f75c0443193de3b37411c, NAME => 'hbase:namespace,,1706396143520.cf62df53c60f75c0443193de3b37411c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp 2024-01-27 22:55:43,632 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1706396143520.cf62df53c60f75c0443193de3b37411c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-27 22:55:43,632 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing cf62df53c60f75c0443193de3b37411c, disabling compactions & flushes 2024-01-27 22:55:43,632 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1706396143520.cf62df53c60f75c0443193de3b37411c. 2024-01-27 22:55:43,632 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1706396143520.cf62df53c60f75c0443193de3b37411c. 2024-01-27 22:55:43,632 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1706396143520.cf62df53c60f75c0443193de3b37411c. after waiting 0 ms 2024-01-27 22:55:43,632 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1706396143520.cf62df53c60f75c0443193de3b37411c. 2024-01-27 22:55:43,632 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1706396143520.cf62df53c60f75c0443193de3b37411c. 2024-01-27 22:55:43,632 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for cf62df53c60f75c0443193de3b37411c: 2024-01-27 22:55:43,638 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2024-01-27 22:55:43,657 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1706396143520.cf62df53c60f75c0443193de3b37411c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1706396143641"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1706396143641"}]},"ts":"1706396143641"} 2024-01-27 22:55:43,693 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-27 22:55:43,696 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-27 22:55:43,700 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1706396143696"}]},"ts":"1706396143696"} 2024-01-27 22:55:43,706 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2024-01-27 22:55:43,711 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-27 22:55:43,712 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-27 22:55:43,713 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-27 22:55:43,713 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-27 22:55:43,716 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=cf62df53c60f75c0443193de3b37411c, ASSIGN}] 2024-01-27 22:55:43,719 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=cf62df53c60f75c0443193de3b37411c, ASSIGN 2024-01-27 22:55:43,721 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=cf62df53c60f75c0443193de3b37411c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38023,1706396141471; forceNewPlan=false, retain=false 2024-01-27 22:55:43,875 INFO [jenkins-hbase4:38947] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-27 22:55:43,876 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=cf62df53c60f75c0443193de3b37411c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38023,1706396141471 2024-01-27 22:55:43,876 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1706396143520.cf62df53c60f75c0443193de3b37411c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1706396143875"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1706396143875"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1706396143875"}]},"ts":"1706396143875"} 2024-01-27 22:55:43,881 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure cf62df53c60f75c0443193de3b37411c, server=jenkins-hbase4.apache.org,38023,1706396141471}] 2024-01-27 22:55:44,036 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38023,1706396141471 2024-01-27 22:55:44,036 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-01-27 22:55:44,039 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47940, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-01-27 22:55:44,046 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1706396143520.cf62df53c60f75c0443193de3b37411c. 2024-01-27 22:55:44,046 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cf62df53c60f75c0443193de3b37411c, NAME => 'hbase:namespace,,1706396143520.cf62df53c60f75c0443193de3b37411c.', STARTKEY => '', ENDKEY => ''} 2024-01-27 22:55:44,047 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace cf62df53c60f75c0443193de3b37411c 2024-01-27 22:55:44,047 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1706396143520.cf62df53c60f75c0443193de3b37411c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-27 22:55:44,047 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cf62df53c60f75c0443193de3b37411c 2024-01-27 22:55:44,047 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cf62df53c60f75c0443193de3b37411c 2024-01-27 22:55:44,050 INFO [StoreOpener-cf62df53c60f75c0443193de3b37411c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region cf62df53c60f75c0443193de3b37411c 2024-01-27 22:55:44,052 DEBUG [StoreOpener-cf62df53c60f75c0443193de3b37411c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/namespace/cf62df53c60f75c0443193de3b37411c/info 2024-01-27 22:55:44,053 DEBUG [StoreOpener-cf62df53c60f75c0443193de3b37411c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/namespace/cf62df53c60f75c0443193de3b37411c/info 2024-01-27 22:55:44,053 INFO [StoreOpener-cf62df53c60f75c0443193de3b37411c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf62df53c60f75c0443193de3b37411c columnFamilyName info 2024-01-27 22:55:44,054 INFO [StoreOpener-cf62df53c60f75c0443193de3b37411c-1] regionserver.HStore(310): Store=cf62df53c60f75c0443193de3b37411c/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-27 22:55:44,056 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/namespace/cf62df53c60f75c0443193de3b37411c 2024-01-27 22:55:44,057 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/namespace/cf62df53c60f75c0443193de3b37411c 2024-01-27 22:55:44,062 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cf62df53c60f75c0443193de3b37411c 2024-01-27 22:55:44,066 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/namespace/cf62df53c60f75c0443193de3b37411c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-27 22:55:44,067 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cf62df53c60f75c0443193de3b37411c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62730839, jitterRate=-0.06523765623569489}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-27 22:55:44,067 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cf62df53c60f75c0443193de3b37411c: 2024-01-27 22:55:44,069 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:namespace,,1706396143520.cf62df53c60f75c0443193de3b37411c., pid=6, masterSystemTime=1706396144036 2024-01-27 22:55:44,074 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:namespace,,1706396143520.cf62df53c60f75c0443193de3b37411c. 2024-01-27 22:55:44,075 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1706396143520.cf62df53c60f75c0443193de3b37411c. 2024-01-27 22:55:44,077 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=cf62df53c60f75c0443193de3b37411c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38023,1706396141471 2024-01-27 22:55:44,077 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1706396143520.cf62df53c60f75c0443193de3b37411c.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1706396144076"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1706396144076"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1706396144076"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1706396144076"}]},"ts":"1706396144076"} 2024-01-27 22:55:44,086 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=6, resume processing ppid=5 2024-01-27 22:55:44,087 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure cf62df53c60f75c0443193de3b37411c, server=jenkins-hbase4.apache.org,38023,1706396141471 in 201 msec 2024-01-27 22:55:44,090 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=5, resume processing ppid=4 2024-01-27 22:55:44,090 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=cf62df53c60f75c0443193de3b37411c, ASSIGN in 370 msec 2024-01-27 22:55:44,092 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-27 22:55:44,092 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1706396144092"}]},"ts":"1706396144092"} 2024-01-27 22:55:44,095 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2024-01-27 22:55:44,099 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2024-01-27 22:55:44,102 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 577 msec 2024-01-27 22:55:44,136 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2024-01-27 22:55:44,139 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2024-01-27 22:55:44,139 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-27 22:55:44,161 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-01-27 22:55:44,164 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47948, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-01-27 22:55:44,182 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2024-01-27 22:55:44,209 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-01-27 22:55:44,216 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 44 msec 2024-01-27 22:55:44,228 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2024-01-27 22:55:44,241 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-01-27 22:55:44,247 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2024-01-27 22:55:44,255 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2024-01-27 22:55:44,258 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2024-01-27 22:55:44,258 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1084): Master has completed initialization 2.682sec 2024-01-27 22:55:44,261 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(103): Quota table not found. Creating... 2024-01-27 22:55:44,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-27 22:55:44,263 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:quota 2024-01-27 22:55:44,264 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(107): Initializing quota support 2024-01-27 22:55:44,267 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(59): Namespace State Manager started. 2024-01-27 22:55:44,268 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_PRE_OPERATION 2024-01-27 22:55:44,270 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-27 22:55:44,274 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/hbase/quota/2de4c461dc1a4b64c8b6e833158d4c10 2024-01-27 22:55:44,275 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/hbase/quota/2de4c461dc1a4b64c8b6e833158d4c10 empty. 2024-01-27 22:55:44,277 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/hbase/quota/2de4c461dc1a4b64c8b6e833158d4c10 2024-01-27 22:55:44,277 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:quota regions 2024-01-27 22:55:44,278 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(222): Finished updating state of 2 namespaces. 2024-01-27 22:55:44,278 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceAuditor(50): NamespaceAuditor started. 2024-01-27 22:55:44,280 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:44,281 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:44,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2024-01-27 22:55:44,283 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2024-01-27 22:55:44,284 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38947,1706396140219-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2024-01-27 22:55:44,285 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38947,1706396140219-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2024-01-27 22:55:44,301 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1176): Balancer post startup initialization complete, took 0 seconds 2024-01-27 22:55:44,301 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38947,1706396140219-OldWALsDirSizeChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-27 22:55:44,315 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/hbase/quota/.tabledesc/.tableinfo.0000000001 2024-01-27 22:55:44,317 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(7675): creating {ENCODED => 2de4c461dc1a4b64c8b6e833158d4c10, NAME => 'hbase:quota,,1706396144261.2de4c461dc1a4b64c8b6e833158d4c10.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp 2024-01-27 22:55:44,344 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(866): Instantiated hbase:quota,,1706396144261.2de4c461dc1a4b64c8b6e833158d4c10.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-27 22:55:44,344 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1604): Closing 2de4c461dc1a4b64c8b6e833158d4c10, disabling compactions & flushes 2024-01-27 22:55:44,344 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1626): Closing region hbase:quota,,1706396144261.2de4c461dc1a4b64c8b6e833158d4c10. 2024-01-27 22:55:44,344 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1706396144261.2de4c461dc1a4b64c8b6e833158d4c10. 2024-01-27 22:55:44,345 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1706396144261.2de4c461dc1a4b64c8b6e833158d4c10. after waiting 0 ms 2024-01-27 22:55:44,345 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1706396144261.2de4c461dc1a4b64c8b6e833158d4c10. 2024-01-27 22:55:44,345 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1838): Closed hbase:quota,,1706396144261.2de4c461dc1a4b64c8b6e833158d4c10. 2024-01-27 22:55:44,345 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1558): Region close journal for 2de4c461dc1a4b64c8b6e833158d4c10: 2024-01-27 22:55:44,350 DEBUG [Listener at localhost/33045] zookeeper.ReadOnlyZKClient(139): Connect 0x3691fd41 to 127.0.0.1:60512 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-01-27 22:55:44,351 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ADD_TO_META 2024-01-27 22:55:44,354 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:quota,,1706396144261.2de4c461dc1a4b64c8b6e833158d4c10.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1706396144354"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1706396144354"}]},"ts":"1706396144354"} 2024-01-27 22:55:44,357 DEBUG [Listener at localhost/33045] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1053c4ec, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-01-27 22:55:44,358 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-27 22:55:44,359 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-27 22:55:44,360 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1706396144360"}]},"ts":"1706396144360"} 2024-01-27 22:55:44,364 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLING in hbase:meta 2024-01-27 22:55:44,369 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-27 22:55:44,373 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-27 22:55:44,373 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-27 22:55:44,373 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-27 22:55:44,373 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=2de4c461dc1a4b64c8b6e833158d4c10, ASSIGN}] 2024-01-27 22:55:44,375 DEBUG [hconnection-0x4c91dbdf-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-01-27 22:55:44,375 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=2de4c461dc1a4b64c8b6e833158d4c10, ASSIGN 2024-01-27 22:55:44,377 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:quota, region=2de4c461dc1a4b64c8b6e833158d4c10, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38023,1706396141471; forceNewPlan=false, retain=false 2024-01-27 22:55:44,394 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57854, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-01-27 22:55:44,405 INFO [Listener at localhost/33045] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,38947,1706396140219 2024-01-27 22:55:44,407 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:55:44,410 DEBUG [Listener at localhost/33045] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-01-27 22:55:44,512 DEBUG [Listener at localhost/33045] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-01-27 22:55:44,528 INFO [jenkins-hbase4:38947] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-27 22:55:44,529 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=2de4c461dc1a4b64c8b6e833158d4c10, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38023,1706396141471 2024-01-27 22:55:44,529 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:quota,,1706396144261.2de4c461dc1a4b64c8b6e833158d4c10.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1706396144528"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1706396144528"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1706396144528"}]},"ts":"1706396144528"} 2024-01-27 22:55:44,532 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 2de4c461dc1a4b64c8b6e833158d4c10, server=jenkins-hbase4.apache.org,38023,1706396141471}] 2024-01-27 22:55:44,615 DEBUG [Listener at localhost/33045] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-01-27 22:55:44,686 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38023,1706396141471 2024-01-27 22:55:44,692 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:quota,,1706396144261.2de4c461dc1a4b64c8b6e833158d4c10. 2024-01-27 22:55:44,692 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 2de4c461dc1a4b64c8b6e833158d4c10, NAME => 'hbase:quota,,1706396144261.2de4c461dc1a4b64c8b6e833158d4c10.', STARTKEY => '', ENDKEY => ''} 2024-01-27 22:55:44,693 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table quota 2de4c461dc1a4b64c8b6e833158d4c10 2024-01-27 22:55:44,693 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:quota,,1706396144261.2de4c461dc1a4b64c8b6e833158d4c10.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-27 22:55:44,693 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 2de4c461dc1a4b64c8b6e833158d4c10 2024-01-27 22:55:44,693 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 2de4c461dc1a4b64c8b6e833158d4c10 2024-01-27 22:55:44,695 INFO [StoreOpener-2de4c461dc1a4b64c8b6e833158d4c10-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family q of region 2de4c461dc1a4b64c8b6e833158d4c10 2024-01-27 22:55:44,702 DEBUG [StoreOpener-2de4c461dc1a4b64c8b6e833158d4c10-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/quota/2de4c461dc1a4b64c8b6e833158d4c10/q 2024-01-27 22:55:44,702 DEBUG [StoreOpener-2de4c461dc1a4b64c8b6e833158d4c10-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/quota/2de4c461dc1a4b64c8b6e833158d4c10/q 2024-01-27 22:55:44,702 INFO [StoreOpener-2de4c461dc1a4b64c8b6e833158d4c10-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2de4c461dc1a4b64c8b6e833158d4c10 columnFamilyName q 2024-01-27 22:55:44,703 INFO [StoreOpener-2de4c461dc1a4b64c8b6e833158d4c10-1] regionserver.HStore(310): Store=2de4c461dc1a4b64c8b6e833158d4c10/q, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-27 22:55:44,703 INFO [StoreOpener-2de4c461dc1a4b64c8b6e833158d4c10-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family u of region 2de4c461dc1a4b64c8b6e833158d4c10 2024-01-27 22:55:44,705 DEBUG [StoreOpener-2de4c461dc1a4b64c8b6e833158d4c10-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/quota/2de4c461dc1a4b64c8b6e833158d4c10/u 2024-01-27 22:55:44,705 DEBUG [StoreOpener-2de4c461dc1a4b64c8b6e833158d4c10-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/quota/2de4c461dc1a4b64c8b6e833158d4c10/u 2024-01-27 22:55:44,706 INFO [StoreOpener-2de4c461dc1a4b64c8b6e833158d4c10-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 2de4c461dc1a4b64c8b6e833158d4c10 columnFamilyName u 2024-01-27 22:55:44,706 INFO [StoreOpener-2de4c461dc1a4b64c8b6e833158d4c10-1] regionserver.HStore(310): Store=2de4c461dc1a4b64c8b6e833158d4c10/u, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-27 22:55:44,708 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/quota/2de4c461dc1a4b64c8b6e833158d4c10 2024-01-27 22:55:44,709 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/quota/2de4c461dc1a4b64c8b6e833158d4c10 2024-01-27 22:55:44,713 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:quota descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2024-01-27 22:55:44,715 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 2de4c461dc1a4b64c8b6e833158d4c10 2024-01-27 22:55:44,717 DEBUG [Listener at localhost/33045] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-01-27 22:55:44,719 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/quota/2de4c461dc1a4b64c8b6e833158d4c10/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-27 22:55:44,720 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 2de4c461dc1a4b64c8b6e833158d4c10; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74851239, jitterRate=0.11537037789821625}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2024-01-27 22:55:44,720 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 2de4c461dc1a4b64c8b6e833158d4c10: 2024-01-27 22:55:44,722 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:quota,,1706396144261.2de4c461dc1a4b64c8b6e833158d4c10., pid=11, masterSystemTime=1706396144686 2024-01-27 22:55:44,725 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:quota,,1706396144261.2de4c461dc1a4b64c8b6e833158d4c10. 2024-01-27 22:55:44,725 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:quota,,1706396144261.2de4c461dc1a4b64c8b6e833158d4c10. 2024-01-27 22:55:44,728 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=2de4c461dc1a4b64c8b6e833158d4c10, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38023,1706396141471 2024-01-27 22:55:44,729 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:quota,,1706396144261.2de4c461dc1a4b64c8b6e833158d4c10.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1706396144728"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1706396144728"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1706396144728"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1706396144728"}]},"ts":"1706396144728"} 2024-01-27 22:55:44,736 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=11, resume processing ppid=10 2024-01-27 22:55:44,736 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 2de4c461dc1a4b64c8b6e833158d4c10, server=jenkins-hbase4.apache.org,38023,1706396141471 in 200 msec 2024-01-27 22:55:44,740 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=10, resume processing ppid=9 2024-01-27 22:55:44,740 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:quota, region=2de4c461dc1a4b64c8b6e833158d4c10, ASSIGN in 363 msec 2024-01-27 22:55:44,742 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-27 22:55:44,742 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1706396144742"}]},"ts":"1706396144742"} 2024-01-27 22:55:44,744 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLED in hbase:meta 2024-01-27 22:55:44,748 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_POST_OPERATION 2024-01-27 22:55:44,750 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:quota in 486 msec 2024-01-27 22:55:44,833 DEBUG [Listener at localhost/33045] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-01-27 22:55:44,836 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50984, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2024-01-27 22:55:44,853 DEBUG [hconnection-0x4c91dbdf-shared-pool-3] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-01-27 22:55:44,855 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47960, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-01-27 22:55:44,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-27 22:55:44,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] procedure2.ProcedureExecutor(1075): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin0 2024-01-27 22:55:44,875 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_PRE_OPERATION 2024-01-27 22:55:44,879 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-27 22:55:44,879 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin0" procId is: 12 2024-01-27 22:55:44,882 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/default/TestQuotaAdmin0/434f858ce4f2644ede1df3f955d625cc 2024-01-27 22:55:44,883 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/default/TestQuotaAdmin0/434f858ce4f2644ede1df3f955d625cc empty. 2024-01-27 22:55:44,884 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/default/TestQuotaAdmin0/434f858ce4f2644ede1df3f955d625cc 2024-01-27 22:55:44,884 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-01-27 22:55:44,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-01-27 22:55:44,905 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/default/TestQuotaAdmin0/.tabledesc/.tableinfo.0000000001 2024-01-27 22:55:44,907 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(7675): creating {ENCODED => 434f858ce4f2644ede1df3f955d625cc, NAME => 'TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp 2024-01-27 22:55:44,922 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-27 22:55:44,922 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1604): Closing 434f858ce4f2644ede1df3f955d625cc, disabling compactions & flushes 2024-01-27 22:55:44,922 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc. 2024-01-27 22:55:44,922 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc. 2024-01-27 22:55:44,922 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc. after waiting 0 ms 2024-01-27 22:55:44,922 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc. 2024-01-27 22:55:44,922 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc. 2024-01-27 22:55:44,922 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1558): Region close journal for 434f858ce4f2644ede1df3f955d625cc: 2024-01-27 22:55:44,926 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ADD_TO_META 2024-01-27 22:55:44,928 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1706396144928"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1706396144928"}]},"ts":"1706396144928"} 2024-01-27 22:55:44,931 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-27 22:55:44,933 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-27 22:55:44,933 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1706396144933"}]},"ts":"1706396144933"} 2024-01-27 22:55:44,935 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLING in hbase:meta 2024-01-27 22:55:44,940 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-27 22:55:44,941 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-27 22:55:44,941 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-27 22:55:44,941 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-27 22:55:44,942 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=434f858ce4f2644ede1df3f955d625cc, ASSIGN}] 2024-01-27 22:55:44,943 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=434f858ce4f2644ede1df3f955d625cc, ASSIGN 2024-01-27 22:55:44,944 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin0, region=434f858ce4f2644ede1df3f955d625cc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44077,1706396141516; forceNewPlan=false, retain=false 2024-01-27 22:55:45,095 INFO [jenkins-hbase4:38947] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-27 22:55:45,096 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=434f858ce4f2644ede1df3f955d625cc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44077,1706396141516 2024-01-27 22:55:45,096 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1706396145096"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1706396145096"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1706396145096"}]},"ts":"1706396145096"} 2024-01-27 22:55:45,100 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; OpenRegionProcedure 434f858ce4f2644ede1df3f955d625cc, server=jenkins-hbase4.apache.org,44077,1706396141516}] 2024-01-27 22:55:45,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-01-27 22:55:45,254 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44077,1706396141516 2024-01-27 22:55:45,261 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc. 2024-01-27 22:55:45,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 434f858ce4f2644ede1df3f955d625cc, NAME => 'TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc.', STARTKEY => '', ENDKEY => ''} 2024-01-27 22:55:45,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin0 434f858ce4f2644ede1df3f955d625cc 2024-01-27 22:55:45,262 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-27 22:55:45,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 434f858ce4f2644ede1df3f955d625cc 2024-01-27 22:55:45,263 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 434f858ce4f2644ede1df3f955d625cc 2024-01-27 22:55:45,265 INFO [StoreOpener-434f858ce4f2644ede1df3f955d625cc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 434f858ce4f2644ede1df3f955d625cc 2024-01-27 22:55:45,267 DEBUG [StoreOpener-434f858ce4f2644ede1df3f955d625cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/default/TestQuotaAdmin0/434f858ce4f2644ede1df3f955d625cc/cf 2024-01-27 22:55:45,267 DEBUG [StoreOpener-434f858ce4f2644ede1df3f955d625cc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/default/TestQuotaAdmin0/434f858ce4f2644ede1df3f955d625cc/cf 2024-01-27 22:55:45,268 INFO [StoreOpener-434f858ce4f2644ede1df3f955d625cc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 434f858ce4f2644ede1df3f955d625cc columnFamilyName cf 2024-01-27 22:55:45,269 INFO [StoreOpener-434f858ce4f2644ede1df3f955d625cc-1] regionserver.HStore(310): Store=434f858ce4f2644ede1df3f955d625cc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-27 22:55:45,271 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/default/TestQuotaAdmin0/434f858ce4f2644ede1df3f955d625cc 2024-01-27 22:55:45,273 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/default/TestQuotaAdmin0/434f858ce4f2644ede1df3f955d625cc 2024-01-27 22:55:45,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 434f858ce4f2644ede1df3f955d625cc 2024-01-27 22:55:45,285 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/default/TestQuotaAdmin0/434f858ce4f2644ede1df3f955d625cc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-27 22:55:45,286 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 434f858ce4f2644ede1df3f955d625cc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68364455, jitterRate=0.018709763884544373}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-27 22:55:45,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 434f858ce4f2644ede1df3f955d625cc: 2024-01-27 22:55:45,288 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc., pid=14, masterSystemTime=1706396145254 2024-01-27 22:55:45,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc. 2024-01-27 22:55:45,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc. 2024-01-27 22:55:45,292 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=434f858ce4f2644ede1df3f955d625cc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44077,1706396141516 2024-01-27 22:55:45,292 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1706396145292"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1706396145292"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1706396145292"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1706396145292"}]},"ts":"1706396145292"} 2024-01-27 22:55:45,299 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=14, resume processing ppid=13 2024-01-27 22:55:45,299 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=14, ppid=13, state=SUCCESS; OpenRegionProcedure 434f858ce4f2644ede1df3f955d625cc, server=jenkins-hbase4.apache.org,44077,1706396141516 in 195 msec 2024-01-27 22:55:45,303 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=13, resume processing ppid=12 2024-01-27 22:55:45,304 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=434f858ce4f2644ede1df3f955d625cc, ASSIGN in 357 msec 2024-01-27 22:55:45,305 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-27 22:55:45,305 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1706396145305"}]},"ts":"1706396145305"} 2024-01-27 22:55:45,307 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLED in hbase:meta 2024-01-27 22:55:45,312 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_POST_OPERATION 2024-01-27 22:55:45,314 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=12, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin0 in 443 msec 2024-01-27 22:55:45,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-01-27 22:55:45,647 INFO [Listener at localhost/33045] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin0, procId: 12 completed 2024-01-27 22:55:45,647 DEBUG [Listener at localhost/33045] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin0 get assigned. Timeout = 60000ms 2024-01-27 22:55:45,648 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:55:45,658 INFO [Listener at localhost/33045] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin0 assigned to meta. Checking AM states. 2024-01-27 22:55:45,659 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:55:45,659 INFO [Listener at localhost/33045] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin0 assigned. 2024-01-27 22:55:45,659 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:55:45,674 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-01-27 22:55:45,678 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50986, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=MasterService 2024-01-27 22:55:45,679 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-27 22:55:45,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] procedure2.ProcedureExecutor(1075): Stored pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin1 2024-01-27 22:55:45,684 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_PRE_OPERATION 2024-01-27 22:55:45,685 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin1" procId is: 15 2024-01-27 22:55:45,687 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-27 22:55:45,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-01-27 22:55:45,698 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/default/TestQuotaAdmin1/989953c315a2c9318d5a003d0f7ce8cf 2024-01-27 22:55:45,699 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/default/TestQuotaAdmin1/989953c315a2c9318d5a003d0f7ce8cf empty. 2024-01-27 22:55:45,701 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/default/TestQuotaAdmin1/989953c315a2c9318d5a003d0f7ce8cf 2024-01-27 22:55:45,707 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-01-27 22:55:45,754 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/default/TestQuotaAdmin1/.tabledesc/.tableinfo.0000000001 2024-01-27 22:55:45,756 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 989953c315a2c9318d5a003d0f7ce8cf, NAME => 'TestQuotaAdmin1,,1706396145679.989953c315a2c9318d5a003d0f7ce8cf.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp 2024-01-27 22:55:45,757 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-01-27 22:55:45,762 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47962, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2024-01-27 22:55:45,787 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1706396145679.989953c315a2c9318d5a003d0f7ce8cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-27 22:55:45,787 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1604): Closing 989953c315a2c9318d5a003d0f7ce8cf, disabling compactions & flushes 2024-01-27 22:55:45,788 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1706396145679.989953c315a2c9318d5a003d0f7ce8cf. 2024-01-27 22:55:45,788 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1706396145679.989953c315a2c9318d5a003d0f7ce8cf. 2024-01-27 22:55:45,788 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1706396145679.989953c315a2c9318d5a003d0f7ce8cf. after waiting 0 ms 2024-01-27 22:55:45,788 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1706396145679.989953c315a2c9318d5a003d0f7ce8cf. 2024-01-27 22:55:45,788 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1706396145679.989953c315a2c9318d5a003d0f7ce8cf. 2024-01-27 22:55:45,788 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1558): Region close journal for 989953c315a2c9318d5a003d0f7ce8cf: 2024-01-27 22:55:45,792 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ADD_TO_META 2024-01-27 22:55:45,794 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1706396145679.989953c315a2c9318d5a003d0f7ce8cf.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1706396145794"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1706396145794"}]},"ts":"1706396145794"} 2024-01-27 22:55:45,797 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-27 22:55:45,798 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-27 22:55:45,799 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1706396145798"}]},"ts":"1706396145798"} 2024-01-27 22:55:45,801 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLING in hbase:meta 2024-01-27 22:55:45,806 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-27 22:55:45,807 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-27 22:55:45,807 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-27 22:55:45,807 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-27 22:55:45,808 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=989953c315a2c9318d5a003d0f7ce8cf, ASSIGN}] 2024-01-27 22:55:45,809 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=989953c315a2c9318d5a003d0f7ce8cf, ASSIGN 2024-01-27 22:55:45,811 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin1, region=989953c315a2c9318d5a003d0f7ce8cf, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44077,1706396141516; forceNewPlan=false, retain=false 2024-01-27 22:55:45,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-01-27 22:55:45,961 INFO [jenkins-hbase4:38947] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-27 22:55:45,962 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=989953c315a2c9318d5a003d0f7ce8cf, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44077,1706396141516 2024-01-27 22:55:45,962 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1706396145679.989953c315a2c9318d5a003d0f7ce8cf.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1706396145962"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1706396145962"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1706396145962"}]},"ts":"1706396145962"} 2024-01-27 22:55:45,966 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure 989953c315a2c9318d5a003d0f7ce8cf, server=jenkins-hbase4.apache.org,44077,1706396141516}] 2024-01-27 22:55:46,118 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44077,1706396141516 2024-01-27 22:55:46,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin1,,1706396145679.989953c315a2c9318d5a003d0f7ce8cf. 2024-01-27 22:55:46,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 989953c315a2c9318d5a003d0f7ce8cf, NAME => 'TestQuotaAdmin1,,1706396145679.989953c315a2c9318d5a003d0f7ce8cf.', STARTKEY => '', ENDKEY => ''} 2024-01-27 22:55:46,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin1 989953c315a2c9318d5a003d0f7ce8cf 2024-01-27 22:55:46,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1706396145679.989953c315a2c9318d5a003d0f7ce8cf.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-27 22:55:46,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 989953c315a2c9318d5a003d0f7ce8cf 2024-01-27 22:55:46,129 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 989953c315a2c9318d5a003d0f7ce8cf 2024-01-27 22:55:46,131 INFO [StoreOpener-989953c315a2c9318d5a003d0f7ce8cf-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 989953c315a2c9318d5a003d0f7ce8cf 2024-01-27 22:55:46,134 DEBUG [StoreOpener-989953c315a2c9318d5a003d0f7ce8cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/default/TestQuotaAdmin1/989953c315a2c9318d5a003d0f7ce8cf/cf 2024-01-27 22:55:46,134 DEBUG [StoreOpener-989953c315a2c9318d5a003d0f7ce8cf-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/default/TestQuotaAdmin1/989953c315a2c9318d5a003d0f7ce8cf/cf 2024-01-27 22:55:46,135 INFO [StoreOpener-989953c315a2c9318d5a003d0f7ce8cf-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 989953c315a2c9318d5a003d0f7ce8cf columnFamilyName cf 2024-01-27 22:55:46,136 INFO [StoreOpener-989953c315a2c9318d5a003d0f7ce8cf-1] regionserver.HStore(310): Store=989953c315a2c9318d5a003d0f7ce8cf/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-27 22:55:46,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/default/TestQuotaAdmin1/989953c315a2c9318d5a003d0f7ce8cf 2024-01-27 22:55:46,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/default/TestQuotaAdmin1/989953c315a2c9318d5a003d0f7ce8cf 2024-01-27 22:55:46,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 989953c315a2c9318d5a003d0f7ce8cf 2024-01-27 22:55:46,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/default/TestQuotaAdmin1/989953c315a2c9318d5a003d0f7ce8cf/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-27 22:55:46,156 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 989953c315a2c9318d5a003d0f7ce8cf; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60593441, jitterRate=-0.09708736836910248}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-27 22:55:46,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 989953c315a2c9318d5a003d0f7ce8cf: 2024-01-27 22:55:46,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin1,,1706396145679.989953c315a2c9318d5a003d0f7ce8cf., pid=17, masterSystemTime=1706396146118 2024-01-27 22:55:46,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin1,,1706396145679.989953c315a2c9318d5a003d0f7ce8cf. 2024-01-27 22:55:46,161 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin1,,1706396145679.989953c315a2c9318d5a003d0f7ce8cf. 2024-01-27 22:55:46,162 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=989953c315a2c9318d5a003d0f7ce8cf, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44077,1706396141516 2024-01-27 22:55:46,163 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin1,,1706396145679.989953c315a2c9318d5a003d0f7ce8cf.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1706396146162"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1706396146162"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1706396146162"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1706396146162"}]},"ts":"1706396146162"} 2024-01-27 22:55:46,177 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=17, resume processing ppid=16 2024-01-27 22:55:46,179 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure 989953c315a2c9318d5a003d0f7ce8cf, server=jenkins-hbase4.apache.org,44077,1706396141516 in 204 msec 2024-01-27 22:55:46,182 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=16, resume processing ppid=15 2024-01-27 22:55:46,182 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=989953c315a2c9318d5a003d0f7ce8cf, ASSIGN in 369 msec 2024-01-27 22:55:46,183 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-27 22:55:46,183 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1706396146183"}]},"ts":"1706396146183"} 2024-01-27 22:55:46,186 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLED in hbase:meta 2024-01-27 22:55:46,190 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_POST_OPERATION 2024-01-27 22:55:46,192 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=15, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin1 in 511 msec 2024-01-27 22:55:46,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-01-27 22:55:46,449 INFO [Listener at localhost/33045] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin1, procId: 15 completed 2024-01-27 22:55:46,449 DEBUG [Listener at localhost/33045] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin1 get assigned. Timeout = 60000ms 2024-01-27 22:55:46,450 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:55:46,453 INFO [Listener at localhost/33045] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin1 assigned to meta. Checking AM states. 2024-01-27 22:55:46,453 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:55:46,454 INFO [Listener at localhost/33045] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin1 assigned. 2024-01-27 22:55:46,454 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:55:46,468 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-27 22:55:46,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] procedure2.ProcedureExecutor(1075): Stored pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin2 2024-01-27 22:55:46,480 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_PRE_OPERATION 2024-01-27 22:55:46,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin2" procId is: 18 2024-01-27 22:55:46,482 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-27 22:55:46,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-01-27 22:55:46,485 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/default/TestQuotaAdmin2/aaa5855dd44f17e0da3ff29e25ba830f 2024-01-27 22:55:46,486 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/default/TestQuotaAdmin2/aaa5855dd44f17e0da3ff29e25ba830f empty. 2024-01-27 22:55:46,487 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/default/TestQuotaAdmin2/aaa5855dd44f17e0da3ff29e25ba830f 2024-01-27 22:55:46,487 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-01-27 22:55:46,519 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/default/TestQuotaAdmin2/.tabledesc/.tableinfo.0000000001 2024-01-27 22:55:46,523 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(7675): creating {ENCODED => aaa5855dd44f17e0da3ff29e25ba830f, NAME => 'TestQuotaAdmin2,,1706396146467.aaa5855dd44f17e0da3ff29e25ba830f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp 2024-01-27 22:55:46,539 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1706396146467.aaa5855dd44f17e0da3ff29e25ba830f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-27 22:55:46,539 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1604): Closing aaa5855dd44f17e0da3ff29e25ba830f, disabling compactions & flushes 2024-01-27 22:55:46,539 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1706396146467.aaa5855dd44f17e0da3ff29e25ba830f. 2024-01-27 22:55:46,540 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1706396146467.aaa5855dd44f17e0da3ff29e25ba830f. 2024-01-27 22:55:46,540 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1706396146467.aaa5855dd44f17e0da3ff29e25ba830f. after waiting 0 ms 2024-01-27 22:55:46,540 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1706396146467.aaa5855dd44f17e0da3ff29e25ba830f. 2024-01-27 22:55:46,540 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1706396146467.aaa5855dd44f17e0da3ff29e25ba830f. 2024-01-27 22:55:46,540 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1558): Region close journal for aaa5855dd44f17e0da3ff29e25ba830f: 2024-01-27 22:55:46,544 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ADD_TO_META 2024-01-27 22:55:46,545 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1706396146467.aaa5855dd44f17e0da3ff29e25ba830f.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1706396146545"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1706396146545"}]},"ts":"1706396146545"} 2024-01-27 22:55:46,548 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-27 22:55:46,549 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-27 22:55:46,549 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1706396146549"}]},"ts":"1706396146549"} 2024-01-27 22:55:46,551 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLING in hbase:meta 2024-01-27 22:55:46,556 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-27 22:55:46,557 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-27 22:55:46,558 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-27 22:55:46,558 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-27 22:55:46,558 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=aaa5855dd44f17e0da3ff29e25ba830f, ASSIGN}] 2024-01-27 22:55:46,560 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=aaa5855dd44f17e0da3ff29e25ba830f, ASSIGN 2024-01-27 22:55:46,561 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin2, region=aaa5855dd44f17e0da3ff29e25ba830f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38023,1706396141471; forceNewPlan=false, retain=false 2024-01-27 22:55:46,711 INFO [jenkins-hbase4:38947] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-27 22:55:46,712 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=aaa5855dd44f17e0da3ff29e25ba830f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38023,1706396141471 2024-01-27 22:55:46,713 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1706396146467.aaa5855dd44f17e0da3ff29e25ba830f.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1706396146712"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1706396146712"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1706396146712"}]},"ts":"1706396146712"} 2024-01-27 22:55:46,716 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE; OpenRegionProcedure aaa5855dd44f17e0da3ff29e25ba830f, server=jenkins-hbase4.apache.org,38023,1706396141471}] 2024-01-27 22:55:46,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-01-27 22:55:46,868 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38023,1706396141471 2024-01-27 22:55:46,875 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin2,,1706396146467.aaa5855dd44f17e0da3ff29e25ba830f. 2024-01-27 22:55:46,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => aaa5855dd44f17e0da3ff29e25ba830f, NAME => 'TestQuotaAdmin2,,1706396146467.aaa5855dd44f17e0da3ff29e25ba830f.', STARTKEY => '', ENDKEY => ''} 2024-01-27 22:55:46,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin2 aaa5855dd44f17e0da3ff29e25ba830f 2024-01-27 22:55:46,875 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1706396146467.aaa5855dd44f17e0da3ff29e25ba830f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-27 22:55:46,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for aaa5855dd44f17e0da3ff29e25ba830f 2024-01-27 22:55:46,876 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for aaa5855dd44f17e0da3ff29e25ba830f 2024-01-27 22:55:46,878 INFO [StoreOpener-aaa5855dd44f17e0da3ff29e25ba830f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region aaa5855dd44f17e0da3ff29e25ba830f 2024-01-27 22:55:46,880 DEBUG [StoreOpener-aaa5855dd44f17e0da3ff29e25ba830f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/default/TestQuotaAdmin2/aaa5855dd44f17e0da3ff29e25ba830f/cf 2024-01-27 22:55:46,880 DEBUG [StoreOpener-aaa5855dd44f17e0da3ff29e25ba830f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/default/TestQuotaAdmin2/aaa5855dd44f17e0da3ff29e25ba830f/cf 2024-01-27 22:55:46,881 INFO [StoreOpener-aaa5855dd44f17e0da3ff29e25ba830f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aaa5855dd44f17e0da3ff29e25ba830f columnFamilyName cf 2024-01-27 22:55:46,881 INFO [StoreOpener-aaa5855dd44f17e0da3ff29e25ba830f-1] regionserver.HStore(310): Store=aaa5855dd44f17e0da3ff29e25ba830f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-27 22:55:46,884 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/default/TestQuotaAdmin2/aaa5855dd44f17e0da3ff29e25ba830f 2024-01-27 22:55:46,885 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/default/TestQuotaAdmin2/aaa5855dd44f17e0da3ff29e25ba830f 2024-01-27 22:55:46,890 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for aaa5855dd44f17e0da3ff29e25ba830f 2024-01-27 22:55:46,893 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/default/TestQuotaAdmin2/aaa5855dd44f17e0da3ff29e25ba830f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-27 22:55:46,894 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened aaa5855dd44f17e0da3ff29e25ba830f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73419415, jitterRate=0.09403453767299652}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-27 22:55:46,894 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for aaa5855dd44f17e0da3ff29e25ba830f: 2024-01-27 22:55:46,895 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin2,,1706396146467.aaa5855dd44f17e0da3ff29e25ba830f., pid=20, masterSystemTime=1706396146868 2024-01-27 22:55:46,898 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin2,,1706396146467.aaa5855dd44f17e0da3ff29e25ba830f. 2024-01-27 22:55:46,898 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin2,,1706396146467.aaa5855dd44f17e0da3ff29e25ba830f. 2024-01-27 22:55:46,898 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=aaa5855dd44f17e0da3ff29e25ba830f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38023,1706396141471 2024-01-27 22:55:46,899 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin2,,1706396146467.aaa5855dd44f17e0da3ff29e25ba830f.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1706396146898"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1706396146898"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1706396146898"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1706396146898"}]},"ts":"1706396146898"} 2024-01-27 22:55:46,904 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=20, resume processing ppid=19 2024-01-27 22:55:46,905 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=20, ppid=19, state=SUCCESS; OpenRegionProcedure aaa5855dd44f17e0da3ff29e25ba830f, server=jenkins-hbase4.apache.org,38023,1706396141471 in 186 msec 2024-01-27 22:55:46,908 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=19, resume processing ppid=18 2024-01-27 22:55:46,909 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=19, ppid=18, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=aaa5855dd44f17e0da3ff29e25ba830f, ASSIGN in 346 msec 2024-01-27 22:55:46,910 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-27 22:55:46,910 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1706396146910"}]},"ts":"1706396146910"} 2024-01-27 22:55:46,912 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLED in hbase:meta 2024-01-27 22:55:46,917 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_POST_OPERATION 2024-01-27 22:55:46,919 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=18, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin2 in 448 msec 2024-01-27 22:55:47,237 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-01-27 22:55:47,237 INFO [Listener at localhost/33045] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin2, procId: 18 completed 2024-01-27 22:55:47,238 DEBUG [Listener at localhost/33045] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin2 get assigned. Timeout = 60000ms 2024-01-27 22:55:47,238 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:55:47,242 INFO [Listener at localhost/33045] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin2 assigned to meta. Checking AM states. 2024-01-27 22:55:47,242 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:55:47,242 INFO [Listener at localhost/33045] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin2 assigned. 2024-01-27 22:55:47,242 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:55:47,251 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-01-27 22:55:47,254 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50998, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService 2024-01-27 22:55:47,258 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.HMaster$15(3020): Client=jenkins//172.31.14.131 creating {NAME => 'TestNs'} 2024-01-27 22:55:47,260 DEBUG [hconnection-0x67f2a4dd-metaLookup-shared--pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-01-27 22:55:47,261 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] procedure2.ProcedureExecutor(1075): Stored pid=21, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=TestNs 2024-01-27 22:55:47,261 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57856, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2024-01-27 22:55:47,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-01-27 22:55:47,276 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-01-27 22:55:47,281 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=21, state=SUCCESS; CreateNamespaceProcedure, namespace=TestNs in 20 msec 2024-01-27 22:55:47,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-01-27 22:55:47,523 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-27 22:55:47,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] procedure2.ProcedureExecutor(1075): Stored pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestNs:TestTable 2024-01-27 22:55:47,527 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_PRE_OPERATION 2024-01-27 22:55:47,527 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "TestNs" qualifier: "TestTable" procId is: 22 2024-01-27 22:55:47,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-01-27 22:55:47,529 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-27 22:55:47,532 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/TestNs/TestTable/ade235f0d2cbac9feb7436723282dbcc 2024-01-27 22:55:47,532 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/TestNs/TestTable/a59826358e944031c7fb444f9785f2c9 2024-01-27 22:55:47,533 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/TestNs/TestTable/ade235f0d2cbac9feb7436723282dbcc empty. 2024-01-27 22:55:47,533 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/TestNs/TestTable/a59826358e944031c7fb444f9785f2c9 empty. 2024-01-27 22:55:47,534 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/TestNs/TestTable/ade235f0d2cbac9feb7436723282dbcc 2024-01-27 22:55:47,534 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/TestNs/TestTable/a59826358e944031c7fb444f9785f2c9 2024-01-27 22:55:47,534 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-01-27 22:55:47,553 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/TestNs/TestTable/.tabledesc/.tableinfo.0000000001 2024-01-27 22:55:47,555 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(7675): creating {ENCODED => a59826358e944031c7fb444f9785f2c9, NAME => 'TestNs:TestTable,1,1706396147522.a59826358e944031c7fb444f9785f2c9.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp 2024-01-27 22:55:47,555 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(7675): creating {ENCODED => ade235f0d2cbac9feb7436723282dbcc, NAME => 'TestNs:TestTable,,1706396147522.ade235f0d2cbac9feb7436723282dbcc.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp 2024-01-27 22:55:47,582 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1706396147522.a59826358e944031c7fb444f9785f2c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-27 22:55:47,583 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1604): Closing a59826358e944031c7fb444f9785f2c9, disabling compactions & flushes 2024-01-27 22:55:47,583 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1706396147522.a59826358e944031c7fb444f9785f2c9. 2024-01-27 22:55:47,583 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1706396147522.a59826358e944031c7fb444f9785f2c9. 2024-01-27 22:55:47,583 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1706396147522.a59826358e944031c7fb444f9785f2c9. after waiting 0 ms 2024-01-27 22:55:47,583 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1706396147522.a59826358e944031c7fb444f9785f2c9. 2024-01-27 22:55:47,583 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1706396147522.a59826358e944031c7fb444f9785f2c9. 2024-01-27 22:55:47,583 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1706396147522.ade235f0d2cbac9feb7436723282dbcc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-27 22:55:47,583 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1604): Closing ade235f0d2cbac9feb7436723282dbcc, disabling compactions & flushes 2024-01-27 22:55:47,583 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1558): Region close journal for a59826358e944031c7fb444f9785f2c9: 2024-01-27 22:55:47,583 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1706396147522.ade235f0d2cbac9feb7436723282dbcc. 2024-01-27 22:55:47,584 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1706396147522.ade235f0d2cbac9feb7436723282dbcc. 2024-01-27 22:55:47,584 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1706396147522.ade235f0d2cbac9feb7436723282dbcc. after waiting 0 ms 2024-01-27 22:55:47,584 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1706396147522.ade235f0d2cbac9feb7436723282dbcc. 2024-01-27 22:55:47,584 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1706396147522.ade235f0d2cbac9feb7436723282dbcc. 2024-01-27 22:55:47,584 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1558): Region close journal for ade235f0d2cbac9feb7436723282dbcc: 2024-01-27 22:55:47,588 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ADD_TO_META 2024-01-27 22:55:47,589 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1706396147522.a59826358e944031c7fb444f9785f2c9.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1706396147589"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1706396147589"}]},"ts":"1706396147589"} 2024-01-27 22:55:47,590 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,,1706396147522.ade235f0d2cbac9feb7436723282dbcc.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1706396147589"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1706396147589"}]},"ts":"1706396147589"} 2024-01-27 22:55:47,594 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2024-01-27 22:55:47,595 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-27 22:55:47,595 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1706396147595"}]},"ts":"1706396147595"} 2024-01-27 22:55:47,597 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLING in hbase:meta 2024-01-27 22:55:47,602 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-27 22:55:47,603 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-27 22:55:47,604 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-27 22:55:47,604 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-27 22:55:47,604 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=ade235f0d2cbac9feb7436723282dbcc, ASSIGN}, {pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=a59826358e944031c7fb444f9785f2c9, ASSIGN}] 2024-01-27 22:55:47,605 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=a59826358e944031c7fb444f9785f2c9, ASSIGN 2024-01-27 22:55:47,606 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=ade235f0d2cbac9feb7436723282dbcc, ASSIGN 2024-01-27 22:55:47,607 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=a59826358e944031c7fb444f9785f2c9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,44077,1706396141516; forceNewPlan=false, retain=false 2024-01-27 22:55:47,607 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=ade235f0d2cbac9feb7436723282dbcc, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38023,1706396141471; forceNewPlan=false, retain=false 2024-01-27 22:55:47,757 INFO [jenkins-hbase4:38947] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2024-01-27 22:55:47,758 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=a59826358e944031c7fb444f9785f2c9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,44077,1706396141516 2024-01-27 22:55:47,758 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=ade235f0d2cbac9feb7436723282dbcc, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38023,1706396141471 2024-01-27 22:55:47,759 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1706396147522.a59826358e944031c7fb444f9785f2c9.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1706396147758"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1706396147758"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1706396147758"}]},"ts":"1706396147758"} 2024-01-27 22:55:47,759 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1706396147522.ade235f0d2cbac9feb7436723282dbcc.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1706396147758"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1706396147758"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1706396147758"}]},"ts":"1706396147758"} 2024-01-27 22:55:47,762 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure a59826358e944031c7fb444f9785f2c9, server=jenkins-hbase4.apache.org,44077,1706396141516}] 2024-01-27 22:55:47,764 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=26, ppid=23, state=RUNNABLE; OpenRegionProcedure ade235f0d2cbac9feb7436723282dbcc, server=jenkins-hbase4.apache.org,38023,1706396141471}] 2024-01-27 22:55:47,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-01-27 22:55:47,915 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44077,1706396141516 2024-01-27 22:55:47,917 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38023,1706396141471 2024-01-27 22:55:47,921 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,1,1706396147522.a59826358e944031c7fb444f9785f2c9. 2024-01-27 22:55:47,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a59826358e944031c7fb444f9785f2c9, NAME => 'TestNs:TestTable,1,1706396147522.a59826358e944031c7fb444f9785f2c9.', STARTKEY => '1', ENDKEY => ''} 2024-01-27 22:55:47,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable a59826358e944031c7fb444f9785f2c9 2024-01-27 22:55:47,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1706396147522.a59826358e944031c7fb444f9785f2c9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-27 22:55:47,922 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,,1706396147522.ade235f0d2cbac9feb7436723282dbcc. 2024-01-27 22:55:47,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a59826358e944031c7fb444f9785f2c9 2024-01-27 22:55:47,922 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a59826358e944031c7fb444f9785f2c9 2024-01-27 22:55:47,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ade235f0d2cbac9feb7436723282dbcc, NAME => 'TestNs:TestTable,,1706396147522.ade235f0d2cbac9feb7436723282dbcc.', STARTKEY => '', ENDKEY => '1'} 2024-01-27 22:55:47,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable ade235f0d2cbac9feb7436723282dbcc 2024-01-27 22:55:47,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1706396147522.ade235f0d2cbac9feb7436723282dbcc.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-27 22:55:47,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ade235f0d2cbac9feb7436723282dbcc 2024-01-27 22:55:47,923 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ade235f0d2cbac9feb7436723282dbcc 2024-01-27 22:55:47,924 INFO [StoreOpener-a59826358e944031c7fb444f9785f2c9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region a59826358e944031c7fb444f9785f2c9 2024-01-27 22:55:47,925 INFO [StoreOpener-ade235f0d2cbac9feb7436723282dbcc-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region ade235f0d2cbac9feb7436723282dbcc 2024-01-27 22:55:47,927 DEBUG [StoreOpener-ade235f0d2cbac9feb7436723282dbcc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/TestNs/TestTable/ade235f0d2cbac9feb7436723282dbcc/cf 2024-01-27 22:55:47,927 DEBUG [StoreOpener-ade235f0d2cbac9feb7436723282dbcc-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/TestNs/TestTable/ade235f0d2cbac9feb7436723282dbcc/cf 2024-01-27 22:55:47,928 INFO [StoreOpener-ade235f0d2cbac9feb7436723282dbcc-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ade235f0d2cbac9feb7436723282dbcc columnFamilyName cf 2024-01-27 22:55:47,928 INFO [StoreOpener-ade235f0d2cbac9feb7436723282dbcc-1] regionserver.HStore(310): Store=ade235f0d2cbac9feb7436723282dbcc/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-27 22:55:47,931 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/TestNs/TestTable/ade235f0d2cbac9feb7436723282dbcc 2024-01-27 22:55:47,932 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/TestNs/TestTable/ade235f0d2cbac9feb7436723282dbcc 2024-01-27 22:55:47,937 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ade235f0d2cbac9feb7436723282dbcc 2024-01-27 22:55:47,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/TestNs/TestTable/ade235f0d2cbac9feb7436723282dbcc/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-27 22:55:47,942 DEBUG [StoreOpener-a59826358e944031c7fb444f9785f2c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/TestNs/TestTable/a59826358e944031c7fb444f9785f2c9/cf 2024-01-27 22:55:47,942 DEBUG [StoreOpener-a59826358e944031c7fb444f9785f2c9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/TestNs/TestTable/a59826358e944031c7fb444f9785f2c9/cf 2024-01-27 22:55:47,943 INFO [StoreOpener-a59826358e944031c7fb444f9785f2c9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a59826358e944031c7fb444f9785f2c9 columnFamilyName cf 2024-01-27 22:55:47,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ade235f0d2cbac9feb7436723282dbcc; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59620510, jitterRate=-0.11158517003059387}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-27 22:55:47,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ade235f0d2cbac9feb7436723282dbcc: 2024-01-27 22:55:47,943 INFO [StoreOpener-a59826358e944031c7fb444f9785f2c9-1] regionserver.HStore(310): Store=a59826358e944031c7fb444f9785f2c9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-27 22:55:47,947 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestNs:TestTable,,1706396147522.ade235f0d2cbac9feb7436723282dbcc., pid=26, masterSystemTime=1706396147917 2024-01-27 22:55:47,947 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/TestNs/TestTable/a59826358e944031c7fb444f9785f2c9 2024-01-27 22:55:47,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/TestNs/TestTable/a59826358e944031c7fb444f9785f2c9 2024-01-27 22:55:47,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestNs:TestTable,,1706396147522.ade235f0d2cbac9feb7436723282dbcc. 2024-01-27 22:55:47,950 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,,1706396147522.ade235f0d2cbac9feb7436723282dbcc. 2024-01-27 22:55:47,951 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=ade235f0d2cbac9feb7436723282dbcc, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38023,1706396141471 2024-01-27 22:55:47,951 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,,1706396147522.ade235f0d2cbac9feb7436723282dbcc.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1706396147951"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1706396147951"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1706396147951"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1706396147951"}]},"ts":"1706396147951"} 2024-01-27 22:55:47,953 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a59826358e944031c7fb444f9785f2c9 2024-01-27 22:55:47,956 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=26, resume processing ppid=23 2024-01-27 22:55:47,957 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=26, ppid=23, state=SUCCESS; OpenRegionProcedure ade235f0d2cbac9feb7436723282dbcc, server=jenkins-hbase4.apache.org,38023,1706396141471 in 190 msec 2024-01-27 22:55:47,965 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=23, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=ade235f0d2cbac9feb7436723282dbcc, ASSIGN in 353 msec 2024-01-27 22:55:47,969 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/TestNs/TestTable/a59826358e944031c7fb444f9785f2c9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-27 22:55:47,970 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a59826358e944031c7fb444f9785f2c9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69482748, jitterRate=0.03537362813949585}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-27 22:55:47,970 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a59826358e944031c7fb444f9785f2c9: 2024-01-27 22:55:47,971 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestNs:TestTable,1,1706396147522.a59826358e944031c7fb444f9785f2c9., pid=25, masterSystemTime=1706396147915 2024-01-27 22:55:47,974 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestNs:TestTable,1,1706396147522.a59826358e944031c7fb444f9785f2c9. 2024-01-27 22:55:47,974 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,1,1706396147522.a59826358e944031c7fb444f9785f2c9. 2024-01-27 22:55:47,974 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=a59826358e944031c7fb444f9785f2c9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,44077,1706396141516 2024-01-27 22:55:47,975 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,1,1706396147522.a59826358e944031c7fb444f9785f2c9.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1706396147974"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1706396147974"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1706396147974"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1706396147974"}]},"ts":"1706396147974"} 2024-01-27 22:55:47,980 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=25, resume processing ppid=24 2024-01-27 22:55:47,980 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure a59826358e944031c7fb444f9785f2c9, server=jenkins-hbase4.apache.org,44077,1706396141516 in 215 msec 2024-01-27 22:55:47,983 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=24, resume processing ppid=22 2024-01-27 22:55:47,985 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=24, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=a59826358e944031c7fb444f9785f2c9, ASSIGN in 376 msec 2024-01-27 22:55:47,985 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-27 22:55:47,985 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1706396147985"}]},"ts":"1706396147985"} 2024-01-27 22:55:47,988 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLED in hbase:meta 2024-01-27 22:55:47,991 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_POST_OPERATION 2024-01-27 22:55:47,994 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=22, state=SUCCESS; CreateTableProcedure table=TestNs:TestTable in 468 msec 2024-01-27 22:55:48,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-01-27 22:55:48,283 INFO [Listener at localhost/33045] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: TestNs:TestTable, procId: 22 completed 2024-01-27 22:55:48,283 DEBUG [Listener at localhost/33045] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestNs:TestTable get assigned. Timeout = 60000ms 2024-01-27 22:55:48,284 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:55:48,288 INFO [Listener at localhost/33045] hbase.HBaseTestingUtility(3484): All regions for table TestNs:TestTable assigned to meta. Checking AM states. 2024-01-27 22:55:48,288 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:55:48,288 INFO [Listener at localhost/33045] hbase.HBaseTestingUtility(3504): All regions for table TestNs:TestTable assigned. 2024-01-27 22:55:48,289 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:55:48,385 INFO [Listener at localhost/33045] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=305, OpenFileDescriptor=636, MaxFileDescriptor=60000, SystemLoadAverage=267, ProcessCount=170, AvailableMemoryMB=2684 2024-01-27 22:55:48,679 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:55:48,679 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-27 22:55:48,680 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1706399748427 bypass), TestNs=QuotaState(ts=1706399748427 bypass)} 2024-01-27 22:55:48,680 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1706399748427 bypass), TestQuotaAdmin2=QuotaState(ts=1706399748427 bypass)} 2024-01-27 22:55:48,680 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1706399748427 [ TestNs:TestTable ])} 2024-01-27 22:55:48,680 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1706399748427 bypass)} 2024-01-27 22:55:48,889 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2024-01-27 22:55:48,930 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:55:48,931 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-27 22:55:48,931 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1706399748427 bypass), TestNs=QuotaState(ts=1706399748427 bypass)} 2024-01-27 22:55:48,931 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1706399748427 bypass), TestNs:TestTable=QuotaState(ts=1706399748427 bypass), TestQuotaAdmin1=QuotaState(ts=1706399748427 bypass)} 2024-01-27 22:55:48,931 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1706399748427 [ TestNs:TestTable ])} 2024-01-27 22:55:48,931 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1706399748427 bypass)} 2024-01-27 22:55:48,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:55:48,952 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 90 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:57854 deadline: 1706396158951, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:55:48,954 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin0' 2024-01-27 22:55:48,955 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2024-01-27 22:55:48,955 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestNs:TestTable' 2024-01-27 22:55:48,956 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin1' 2024-01-27 22:55:48,956 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2024-01-27 22:55:48,957 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin2' 2024-01-27 22:55:48,957 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:quota' 2024-01-27 22:55:49,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:55:49,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 92 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:57854 deadline: 1706396158951, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:55:49,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:55:49,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 94 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:57854 deadline: 1706396158951, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:55:50,391 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-01-27 22:55:50,392 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver Metrics about HBase MasterObservers 2024-01-27 22:55:50,392 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-01-27 22:55:50,392 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2024-01-27 22:55:50,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:55:50,495 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 96 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:57854 deadline: 1706396158950, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:55:51,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:55:51,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 98 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:57854 deadline: 1706396158951, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:55:54,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:55:54,276 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 100 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:57854 deadline: 1706396158951, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:55:54,277 ERROR [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10334: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1706396147522.a59826358e944031c7fb444f9785f2c9., hostname=jenkins-hbase4.apache.org,44077,1706396141516, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-27 22:55:54,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:55:54,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 101 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:57854 deadline: 1706396164280, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:55:54,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:55:54,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 103 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:57854 deadline: 1706396164280, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:55:55,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:55:55,041 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 105 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:57854 deadline: 1706396164281, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:55:55,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:55:55,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 107 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:57854 deadline: 1706396164280, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:55:57,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:55:57,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 109 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:57854 deadline: 1706396164281, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:55:59,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:55:59,578 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 111 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:57854 deadline: 1706396164281, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:55:59,579 ERROR [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10305: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1706396147522.a59826358e944031c7fb444f9785f2c9., hostname=jenkins-hbase4.apache.org,44077,1706396141516, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-27 22:55:59,840 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:55:59,840 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-27 22:55:59,840 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1706403348427 bypass), TestNs=QuotaState(ts=1706403348427 bypass)} 2024-01-27 22:55:59,840 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1706403348427 bypass), TestQuotaAdmin2=QuotaState(ts=1706403348427 bypass)} 2024-01-27 22:55:59,840 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1706403348427 bypass)} 2024-01-27 22:55:59,840 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1706403348427 bypass)} 2024-01-27 22:56:00,091 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:56:00,091 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-27 22:56:00,091 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1706403348427 bypass), TestNs=QuotaState(ts=1706403348427 bypass)} 2024-01-27 22:56:00,091 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1706403348427 bypass), TestNs:TestTable=QuotaState(ts=1706403348427 bypass), TestQuotaAdmin1=QuotaState(ts=1706403348427 bypass)} 2024-01-27 22:56:00,091 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1706403348427 bypass)} 2024-01-27 22:56:00,091 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1706403348427 bypass)} 2024-01-27 22:56:00,105 INFO [Listener at localhost/33045] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=290 (was 305), OpenFileDescriptor=603 (was 636), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=234 (was 267), ProcessCount=168 (was 170), AvailableMemoryMB=3299 (was 2684) - AvailableMemoryMB LEAK? - 2024-01-27 22:56:00,117 INFO [Listener at localhost/33045] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=290, OpenFileDescriptor=603, MaxFileDescriptor=60000, SystemLoadAverage=234, ProcessCount=168, AvailableMemoryMB=3298 2024-01-27 22:56:00,381 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:56:00,381 INFO [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-01-27 22:56:00,631 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-27 22:56:00,632 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1706406948527 bypass), TestNs=QuotaState(ts=1706406948527 bypass)} 2024-01-27 22:56:00,633 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1706406948527 bypass), TestQuotaAdmin2=QuotaState(ts=1706406948527 bypass)} 2024-01-27 22:56:00,633 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1706406948527 [ default ])} 2024-01-27 22:56:00,633 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1706406948527 bypass)} 2024-01-27 22:56:00,884 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:56:00,884 INFO [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-01-27 22:56:01,134 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-27 22:56:01,135 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1706406948627 bypass), TestNs=QuotaState(ts=1706406948627 bypass)} 2024-01-27 22:56:01,137 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1706406948627 bypass), TestNs:TestTable=QuotaState(ts=1706406948627 bypass), TestQuotaAdmin1=QuotaState(ts=1706406948627 bypass)} 2024-01-27 22:56:01,137 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1706406948627 [ default ])} 2024-01-27 22:56:01,137 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1706406948627 bypass)} 2024-01-27 22:56:01,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-27 22:56:01,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 123 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:57854 deadline: 1706396171146, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-27 22:56:01,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-27 22:56:01,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 125 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:57854 deadline: 1706396171146, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-27 22:56:01,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-27 22:56:01,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 127 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:57854 deadline: 1706396171147, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-27 22:56:02,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-27 22:56:02,670 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 129 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57854 deadline: 1706396171147, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-27 22:56:03,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-27 22:56:03,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 131 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57854 deadline: 1706396171147, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-27 22:56:06,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-27 22:56:06,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 133 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57854 deadline: 1706396171146, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-27 22:56:06,439 ERROR [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10309: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc., hostname=jenkins-hbase4.apache.org,44077,1706396141516, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:199) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-27 22:56:06,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:06,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 140 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57854 deadline: 1706396176455, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:06,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:06,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 142 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57854 deadline: 1706396176455, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:07,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:07,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 144 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57854 deadline: 1706396176455, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:07,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:07,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 146 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57854 deadline: 1706396176456, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:09,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:09,226 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 148 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57854 deadline: 1706396176455, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:11,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:11,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 150 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57854 deadline: 1706396176455, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:11,738 ERROR [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10287: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc., hostname=jenkins-hbase4.apache.org,44077,1706396141516, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:200) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-27 22:56:11,995 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:56:11,996 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-27 22:56:11,996 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1706410548627 bypass), TestNs=QuotaState(ts=1706410548627 bypass)} 2024-01-27 22:56:11,996 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1706410548627 bypass), TestQuotaAdmin2=QuotaState(ts=1706410548627 bypass)} 2024-01-27 22:56:11,996 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1706410548627 bypass)} 2024-01-27 22:56:11,996 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1706410548627 bypass)} 2024-01-27 22:56:12,246 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:56:12,246 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-27 22:56:12,246 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1706410548627 bypass), TestNs=QuotaState(ts=1706410548627 bypass)} 2024-01-27 22:56:12,246 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1706410548627 bypass), TestNs:TestTable=QuotaState(ts=1706410548627 bypass), TestQuotaAdmin1=QuotaState(ts=1706410548627 bypass)} 2024-01-27 22:56:12,246 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1706410548627 bypass)} 2024-01-27 22:56:12,247 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1706410548627 bypass)} 2024-01-27 22:56:12,258 INFO [Listener at localhost/33045] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=290 (was 290), OpenFileDescriptor=599 (was 603), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=198 (was 234), ProcessCount=168 (was 168), AvailableMemoryMB=3299 (was 3298) - AvailableMemoryMB LEAK? - 2024-01-27 22:56:12,270 INFO [Listener at localhost/33045] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=290, OpenFileDescriptor=599, MaxFileDescriptor=60000, SystemLoadAverage=198, ProcessCount=168, AvailableMemoryMB=3298 2024-01-27 22:56:12,531 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:56:12,532 INFO [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-01-27 22:56:12,782 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-27 22:56:12,783 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1706414148727 bypass), TestNs=QuotaState(ts=1706414148727 bypass)} 2024-01-27 22:56:12,783 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1706414148727 bypass), TestQuotaAdmin2=QuotaState(ts=1706414148727 bypass)} 2024-01-27 22:56:12,783 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1706414148727 global-limiter)} 2024-01-27 22:56:12,784 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1706414148727 bypass)} 2024-01-27 22:56:13,034 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:56:13,034 INFO [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-01-27 22:56:13,285 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-27 22:56:13,286 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1706414148827 bypass), TestNs=QuotaState(ts=1706414148827 bypass)} 2024-01-27 22:56:13,286 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1706414148827 bypass), TestNs:TestTable=QuotaState(ts=1706414148827 bypass), TestQuotaAdmin1=QuotaState(ts=1706414148827 bypass)} 2024-01-27 22:56:13,286 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1706414148827 global-limiter)} 2024-01-27 22:56:13,287 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1706414148827 bypass)} 2024-01-27 22:56:13,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:13,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 163 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57854 deadline: 1706396183302, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:13,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:13,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 165 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57854 deadline: 1706396183302, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:14,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:14,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 167 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57854 deadline: 1706396183301, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:14,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:14,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 169 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57854 deadline: 1706396183301, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:16,085 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:16,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 171 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57854 deadline: 1706396183301, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:18,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:18,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 173 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57854 deadline: 1706396183302, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:18,612 ERROR [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10357: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc., hostname=jenkins-hbase4.apache.org,44077,1706396141516, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:178) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-27 22:56:18,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-27 22:56:18,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 177 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57854 deadline: 1706396188618, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-27 22:56:18,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-27 22:56:18,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 179 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57854 deadline: 1706396188619, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-27 22:56:19,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-27 22:56:19,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 181 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57854 deadline: 1706396188619, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-27 22:56:20,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-27 22:56:20,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 183 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57854 deadline: 1706396188619, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-27 22:56:21,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-27 22:56:21,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 185 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57854 deadline: 1706396188619, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-27 22:56:23,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-27 22:56:23,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 187 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57854 deadline: 1706396188618, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-27 22:56:23,922 ERROR [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=3 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10345: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-3' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc., hostname=jenkins-hbase4.apache.org,44077,1706396141516, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-27 22:56:24,179 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:56:24,179 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-27 22:56:24,179 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1706417748827 bypass), TestNs=QuotaState(ts=1706417748827 bypass)} 2024-01-27 22:56:24,179 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1706417748827 bypass), TestQuotaAdmin2=QuotaState(ts=1706417748827 bypass)} 2024-01-27 22:56:24,179 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1706417748827 bypass)} 2024-01-27 22:56:24,179 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1706417748827 bypass)} 2024-01-27 22:56:24,429 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:56:24,430 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-27 22:56:24,430 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1706417748827 bypass), TestNs=QuotaState(ts=1706417748827 bypass)} 2024-01-27 22:56:24,430 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1706417748827 bypass), TestNs:TestTable=QuotaState(ts=1706417748827 bypass), TestQuotaAdmin1=QuotaState(ts=1706417748827 bypass)} 2024-01-27 22:56:24,430 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1706417748827 bypass)} 2024-01-27 22:56:24,430 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1706417748827 bypass)} 2024-01-27 22:56:24,441 INFO [Listener at localhost/33045] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=281 (was 290), OpenFileDescriptor=597 (was 599), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=154 (was 198), ProcessCount=166 (was 168), AvailableMemoryMB=3292 (was 3298) 2024-01-27 22:56:24,452 INFO [Listener at localhost/33045] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=281, OpenFileDescriptor=597, MaxFileDescriptor=60000, SystemLoadAverage=154, ProcessCount=166, AvailableMemoryMB=3292 2024-01-27 22:56:24,709 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:56:24,710 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-27 22:56:24,711 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1706421348827 bypass), TestNs=QuotaState(ts=1706421348827 bypass)} 2024-01-27 22:56:24,712 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1706421348827 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin2=QuotaState(ts=1706421348827 bypass)} 2024-01-27 22:56:24,712 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-27 22:56:24,712 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1706421348827 bypass)} 2024-01-27 22:56:24,963 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:56:24,964 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-27 22:56:24,965 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1706421348827 bypass), TestNs=QuotaState(ts=1706421348827 bypass)} 2024-01-27 22:56:24,965 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1706421348827 bypass), TestNs:TestTable=QuotaState(ts=1706421348827 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin1=QuotaState(ts=1706421348827 bypass)} 2024-01-27 22:56:24,965 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-27 22:56:24,965 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1706421348827 bypass)} 2024-01-27 22:56:24,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:56:24,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 202 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:57854 deadline: 1706396194980, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:56:25,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:56:25,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 204 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:57854 deadline: 1706396194981, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:56:25,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:56:25,739 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 206 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:57854 deadline: 1706396194980, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:56:26,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:56:26,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 208 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:57854 deadline: 1706396194980, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:56:27,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:56:27,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 210 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:57854 deadline: 1706396194980, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:56:30,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:56:30,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 212 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:57854 deadline: 1706396194980, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:56:30,269 ERROR [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10316: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1706396147522.a59826358e944031c7fb444f9785f2c9., hostname=jenkins-hbase4.apache.org,44077,1706396141516, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-27 22:56:30,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:56:30,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 213 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:57854 deadline: 1706396200271, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:56:30,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:56:30,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 215 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:57854 deadline: 1706396200270, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:56:31,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:56:31,031 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 217 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:57854 deadline: 1706396200270, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:56:31,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:56:31,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 219 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:57854 deadline: 1706396200270, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:56:33,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:56:33,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 221 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:57854 deadline: 1706396200271, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:56:35,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:56:35,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 223 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:57854 deadline: 1706396200270, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-27 22:56:35,560 ERROR [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10308: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1706396147522.a59826358e944031c7fb444f9785f2c9., hostname=jenkins-hbase4.apache.org,44077,1706396141516, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-27 22:56:35,818 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:56:35,818 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-27 22:56:35,818 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1706424948827 bypass), TestNs=QuotaState(ts=1706424948827 bypass)} 2024-01-27 22:56:35,818 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1706424948827 bypass), TestQuotaAdmin2=QuotaState(ts=1706424948827 bypass)} 2024-01-27 22:56:35,818 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-27 22:56:35,818 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1706424948827 bypass)} 2024-01-27 22:56:36,068 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:56:36,068 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-27 22:56:36,069 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1706424948827 bypass), TestNs=QuotaState(ts=1706424948827 bypass)} 2024-01-27 22:56:36,069 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1706424948827 bypass), TestNs:TestTable=QuotaState(ts=1706424948827 bypass), TestQuotaAdmin1=QuotaState(ts=1706424948827 bypass)} 2024-01-27 22:56:36,069 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1706424948827 bypass)} 2024-01-27 22:56:36,069 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1706424948827 bypass)} 2024-01-27 22:56:36,080 INFO [Listener at localhost/33045] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=281 (was 281), OpenFileDescriptor=597 (was 597), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=130 (was 154), ProcessCount=166 (was 166), AvailableMemoryMB=3292 (was 3292) 2024-01-27 22:56:36,091 INFO [Listener at localhost/33045] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=281, OpenFileDescriptor=597, MaxFileDescriptor=60000, SystemLoadAverage=130, ProcessCount=166, AvailableMemoryMB=3292 2024-01-27 22:56:36,353 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:56:36,354 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-27 22:56:36,354 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1706428548827 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1706428548827 bypass)} 2024-01-27 22:56:36,355 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1706428548827 bypass), TestQuotaAdmin2=QuotaState(ts=1706428548827 bypass)} 2024-01-27 22:56:36,355 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-27 22:56:36,355 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1706428548827 bypass)} 2024-01-27 22:56:36,605 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:56:36,605 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-27 22:56:36,606 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1706428548827 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1706428548827 bypass)} 2024-01-27 22:56:36,606 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1706428548827 bypass), TestNs:TestTable=QuotaState(ts=1706428548827 bypass), TestQuotaAdmin1=QuotaState(ts=1706428548827 bypass)} 2024-01-27 22:56:36,606 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-27 22:56:36,606 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1706428548827 bypass)} 2024-01-27 22:56:36,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-27 22:56:36,622 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 235 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57854 deadline: 1706396206622, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-27 22:56:36,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-27 22:56:36,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 237 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57854 deadline: 1706396206622, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-27 22:56:37,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-27 22:56:37,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 239 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57854 deadline: 1706396206621, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-27 22:56:38,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-27 22:56:38,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 241 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57854 deadline: 1706396206622, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-27 22:56:39,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-27 22:56:39,397 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 243 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57854 deadline: 1706396206621, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-27 22:56:41,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-27 22:56:41,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 245 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57854 deadline: 1706396206622, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-27 22:56:41,912 ERROR [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10309: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc., hostname=jenkins-hbase4.apache.org,44077,1706396141516, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:128) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-27 22:56:41,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:41,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 252 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57854 deadline: 1706396211920, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:42,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:42,176 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 254 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57854 deadline: 1706396211920, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:42,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:42,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 256 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57854 deadline: 1706396211921, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:43,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:43,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 258 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57854 deadline: 1706396211920, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:44,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:44,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 260 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57854 deadline: 1706396211921, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:47,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:47,218 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44077] ipc.CallRunner(144): callId: 262 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57854 deadline: 1706396211920, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-27 22:56:47,218 ERROR [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10315: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc., hostname=jenkins-hbase4.apache.org,44077,1706396141516, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-27 22:56:47,476 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:56:47,476 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-27 22:56:47,476 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1706432148827 bypass), TestNs=QuotaState(ts=1706432148827 bypass)} 2024-01-27 22:56:47,476 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1706432148827 bypass), TestQuotaAdmin2=QuotaState(ts=1706432148827 bypass)} 2024-01-27 22:56:47,476 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-27 22:56:47,476 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1706432148827 bypass)} 2024-01-27 22:56:47,727 INFO [Listener at localhost/33045] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-27 22:56:47,727 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-27 22:56:47,727 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1706432148827 bypass), TestNs=QuotaState(ts=1706432148827 bypass)} 2024-01-27 22:56:47,727 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1706432148827 bypass), TestNs:TestTable=QuotaState(ts=1706432148827 bypass), TestQuotaAdmin1=QuotaState(ts=1706432148827 bypass)} 2024-01-27 22:56:47,727 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1706432148827 bypass)} 2024-01-27 22:56:47,727 DEBUG [Listener at localhost/33045] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1706432148827 bypass)} 2024-01-27 22:56:47,738 INFO [Listener at localhost/33045] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=265 (was 281), OpenFileDescriptor=588 (was 597), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=108 (was 130), ProcessCount=166 (was 166), AvailableMemoryMB=3293 (was 3292) - AvailableMemoryMB LEAK? - 2024-01-27 22:56:47,741 INFO [Listener at localhost/33045] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin0 2024-01-27 22:56:47,746 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin0 2024-01-27 22:56:47,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] procedure2.ProcedureExecutor(1075): Stored pid=27, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin0 2024-01-27 22:56:47,756 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1706396207756"}]},"ts":"1706396207756"} 2024-01-27 22:56:47,757 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-01-27 22:56:47,758 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLING in hbase:meta 2024-01-27 22:56:47,760 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set TestQuotaAdmin0 to state=DISABLING 2024-01-27 22:56:47,762 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=434f858ce4f2644ede1df3f955d625cc, UNASSIGN}] 2024-01-27 22:56:47,763 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=434f858ce4f2644ede1df3f955d625cc, UNASSIGN 2024-01-27 22:56:47,764 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=434f858ce4f2644ede1df3f955d625cc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44077,1706396141516 2024-01-27 22:56:47,764 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1706396207764"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1706396207764"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1706396207764"}]},"ts":"1706396207764"} 2024-01-27 22:56:47,766 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure 434f858ce4f2644ede1df3f955d625cc, server=jenkins-hbase4.apache.org,44077,1706396141516}] 2024-01-27 22:56:47,918 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase4.apache.org,44077,1706396141516, timeout=1706396207921, delay=3, operations=[pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure 434f858ce4f2644ede1df3f955d625cc, server=jenkins-hbase4.apache.org,44077,1706396141516]] 2024-01-27 22:56:47,923 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44077,1706396141516 2024-01-27 22:56:47,925 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 434f858ce4f2644ede1df3f955d625cc 2024-01-27 22:56:47,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 434f858ce4f2644ede1df3f955d625cc, disabling compactions & flushes 2024-01-27 22:56:47,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc. 2024-01-27 22:56:47,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc. 2024-01-27 22:56:47,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc. after waiting 0 ms 2024-01-27 22:56:47,926 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc. 2024-01-27 22:56:47,927 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 434f858ce4f2644ede1df3f955d625cc 1/1 column families, dataSize=578 B heapSize=2.11 KB 2024-01-27 22:56:47,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=578 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/default/TestQuotaAdmin0/434f858ce4f2644ede1df3f955d625cc/.tmp/cf/6f6484d3cadb4640951fe4c9ea033dd3 2024-01-27 22:56:48,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-01-27 22:56:48,039 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/default/TestQuotaAdmin0/434f858ce4f2644ede1df3f955d625cc/.tmp/cf/6f6484d3cadb4640951fe4c9ea033dd3 as hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/default/TestQuotaAdmin0/434f858ce4f2644ede1df3f955d625cc/cf/6f6484d3cadb4640951fe4c9ea033dd3 2024-01-27 22:56:48,049 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/default/TestQuotaAdmin0/434f858ce4f2644ede1df3f955d625cc/cf/6f6484d3cadb4640951fe4c9ea033dd3, entries=6, sequenceid=21, filesize=4.7 K 2024-01-27 22:56:48,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~578 B/578, heapSize ~2.09 KB/2144, currentSize=0 B/0 for 434f858ce4f2644ede1df3f955d625cc in 125ms, sequenceid=21, compaction requested=false 2024-01-27 22:56:48,060 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/default/TestQuotaAdmin0/434f858ce4f2644ede1df3f955d625cc/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2024-01-27 22:56:48,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc. 2024-01-27 22:56:48,061 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 434f858ce4f2644ede1df3f955d625cc: 2024-01-27 22:56:48,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 434f858ce4f2644ede1df3f955d625cc 2024-01-27 22:56:48,063 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=434f858ce4f2644ede1df3f955d625cc, regionState=CLOSED 2024-01-27 22:56:48,064 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1706396208063"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1706396208063"}]},"ts":"1706396208063"} 2024-01-27 22:56:48,067 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=29, resume processing ppid=28 2024-01-27 22:56:48,067 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=29, ppid=28, state=SUCCESS; CloseRegionProcedure 434f858ce4f2644ede1df3f955d625cc, server=jenkins-hbase4.apache.org,44077,1706396141516 in 299 msec 2024-01-27 22:56:48,069 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=28, resume processing ppid=27 2024-01-27 22:56:48,069 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=434f858ce4f2644ede1df3f955d625cc, UNASSIGN in 305 msec 2024-01-27 22:56:48,070 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1706396208070"}]},"ts":"1706396208070"} 2024-01-27 22:56:48,072 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLED in hbase:meta 2024-01-27 22:56:48,074 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set TestQuotaAdmin0 to state=DISABLED 2024-01-27 22:56:48,076 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=27, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin0 in 328 msec 2024-01-27 22:56:48,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-01-27 22:56:48,510 INFO [Listener at localhost/33045] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin0, procId: 27 completed 2024-01-27 22:56:48,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin0 2024-01-27 22:56:48,521 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] procedure2.ProcedureExecutor(1075): Stored pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-27 22:56:48,524 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-27 22:56:48,525 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=30, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-27 22:56:48,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-01-27 22:56:48,532 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/default/TestQuotaAdmin0/434f858ce4f2644ede1df3f955d625cc 2024-01-27 22:56:48,536 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/default/TestQuotaAdmin0/434f858ce4f2644ede1df3f955d625cc/cf, FileablePath, hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/default/TestQuotaAdmin0/434f858ce4f2644ede1df3f955d625cc/recovered.edits] 2024-01-27 22:56:48,545 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/default/TestQuotaAdmin0/434f858ce4f2644ede1df3f955d625cc/cf/6f6484d3cadb4640951fe4c9ea033dd3 to hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/archive/data/default/TestQuotaAdmin0/434f858ce4f2644ede1df3f955d625cc/cf/6f6484d3cadb4640951fe4c9ea033dd3 2024-01-27 22:56:48,549 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/default/TestQuotaAdmin0/434f858ce4f2644ede1df3f955d625cc/recovered.edits/24.seqid to hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/archive/data/default/TestQuotaAdmin0/434f858ce4f2644ede1df3f955d625cc/recovered.edits/24.seqid 2024-01-27 22:56:48,551 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/default/TestQuotaAdmin0/434f858ce4f2644ede1df3f955d625cc 2024-01-27 22:56:48,551 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-01-27 22:56:48,554 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=30, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-27 22:56:48,574 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin0 from hbase:meta 2024-01-27 22:56:48,576 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin0' descriptor. 2024-01-27 22:56:48,578 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=30, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-27 22:56:48,578 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin0' from region states. 2024-01-27 22:56:48,579 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1706396208578"}]},"ts":"9223372036854775807"} 2024-01-27 22:56:48,581 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-01-27 22:56:48,581 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 434f858ce4f2644ede1df3f955d625cc, NAME => 'TestQuotaAdmin0,,1706396144864.434f858ce4f2644ede1df3f955d625cc.', STARTKEY => '', ENDKEY => ''}] 2024-01-27 22:56:48,581 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin0' as deleted. 2024-01-27 22:56:48,581 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1706396208581"}]},"ts":"9223372036854775807"} 2024-01-27 22:56:48,583 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin0 state from META 2024-01-27 22:56:48,585 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=30, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-27 22:56:48,587 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=30, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin0 in 69 msec 2024-01-27 22:56:48,780 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-01-27 22:56:48,781 INFO [Listener at localhost/33045] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin0, procId: 30 completed 2024-01-27 22:56:48,781 INFO [Listener at localhost/33045] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin1 2024-01-27 22:56:48,782 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin1 2024-01-27 22:56:48,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] procedure2.ProcedureExecutor(1075): Stored pid=31, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin1 2024-01-27 22:56:48,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-01-27 22:56:48,787 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1706396208787"}]},"ts":"1706396208787"} 2024-01-27 22:56:48,789 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLING in hbase:meta 2024-01-27 22:56:48,791 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set TestQuotaAdmin1 to state=DISABLING 2024-01-27 22:56:48,792 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=989953c315a2c9318d5a003d0f7ce8cf, UNASSIGN}] 2024-01-27 22:56:48,793 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=989953c315a2c9318d5a003d0f7ce8cf, UNASSIGN 2024-01-27 22:56:48,794 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=989953c315a2c9318d5a003d0f7ce8cf, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44077,1706396141516 2024-01-27 22:56:48,795 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1706396145679.989953c315a2c9318d5a003d0f7ce8cf.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1706396208794"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1706396208794"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1706396208794"}]},"ts":"1706396208794"} 2024-01-27 22:56:48,796 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=33, ppid=32, state=RUNNABLE; CloseRegionProcedure 989953c315a2c9318d5a003d0f7ce8cf, server=jenkins-hbase4.apache.org,44077,1706396141516}] 2024-01-27 22:56:48,948 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44077,1706396141516 2024-01-27 22:56:48,949 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 989953c315a2c9318d5a003d0f7ce8cf 2024-01-27 22:56:48,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 989953c315a2c9318d5a003d0f7ce8cf, disabling compactions & flushes 2024-01-27 22:56:48,950 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1706396145679.989953c315a2c9318d5a003d0f7ce8cf. 2024-01-27 22:56:48,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1706396145679.989953c315a2c9318d5a003d0f7ce8cf. 2024-01-27 22:56:48,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1706396145679.989953c315a2c9318d5a003d0f7ce8cf. after waiting 0 ms 2024-01-27 22:56:48,950 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1706396145679.989953c315a2c9318d5a003d0f7ce8cf. 2024-01-27 22:56:48,955 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/default/TestQuotaAdmin1/989953c315a2c9318d5a003d0f7ce8cf/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-01-27 22:56:48,956 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1706396145679.989953c315a2c9318d5a003d0f7ce8cf. 2024-01-27 22:56:48,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 989953c315a2c9318d5a003d0f7ce8cf: 2024-01-27 22:56:48,958 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 989953c315a2c9318d5a003d0f7ce8cf 2024-01-27 22:56:48,959 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=989953c315a2c9318d5a003d0f7ce8cf, regionState=CLOSED 2024-01-27 22:56:48,959 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1706396145679.989953c315a2c9318d5a003d0f7ce8cf.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1706396208959"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1706396208959"}]},"ts":"1706396208959"} 2024-01-27 22:56:48,963 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=33, resume processing ppid=32 2024-01-27 22:56:48,963 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=33, ppid=32, state=SUCCESS; CloseRegionProcedure 989953c315a2c9318d5a003d0f7ce8cf, server=jenkins-hbase4.apache.org,44077,1706396141516 in 165 msec 2024-01-27 22:56:48,965 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=32, resume processing ppid=31 2024-01-27 22:56:48,965 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=32, ppid=31, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=989953c315a2c9318d5a003d0f7ce8cf, UNASSIGN in 171 msec 2024-01-27 22:56:48,965 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1706396208965"}]},"ts":"1706396208965"} 2024-01-27 22:56:48,967 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLED in hbase:meta 2024-01-27 22:56:48,969 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set TestQuotaAdmin1 to state=DISABLED 2024-01-27 22:56:48,971 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=31, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin1 in 188 msec 2024-01-27 22:56:49,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-01-27 22:56:49,038 INFO [Listener at localhost/33045] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin1, procId: 31 completed 2024-01-27 22:56:49,039 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin1 2024-01-27 22:56:49,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] procedure2.ProcedureExecutor(1075): Stored pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-27 22:56:49,042 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-27 22:56:49,043 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=34, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-27 22:56:49,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-01-27 22:56:49,048 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/default/TestQuotaAdmin1/989953c315a2c9318d5a003d0f7ce8cf 2024-01-27 22:56:49,050 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/default/TestQuotaAdmin1/989953c315a2c9318d5a003d0f7ce8cf/cf, FileablePath, hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/default/TestQuotaAdmin1/989953c315a2c9318d5a003d0f7ce8cf/recovered.edits] 2024-01-27 22:56:49,058 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/default/TestQuotaAdmin1/989953c315a2c9318d5a003d0f7ce8cf/recovered.edits/4.seqid to hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/archive/data/default/TestQuotaAdmin1/989953c315a2c9318d5a003d0f7ce8cf/recovered.edits/4.seqid 2024-01-27 22:56:49,059 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/default/TestQuotaAdmin1/989953c315a2c9318d5a003d0f7ce8cf 2024-01-27 22:56:49,059 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-01-27 22:56:49,062 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=34, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-27 22:56:49,064 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin1 from hbase:meta 2024-01-27 22:56:49,067 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin1' descriptor. 2024-01-27 22:56:49,068 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=34, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-27 22:56:49,068 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin1' from region states. 2024-01-27 22:56:49,068 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1,,1706396145679.989953c315a2c9318d5a003d0f7ce8cf.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1706396209068"}]},"ts":"9223372036854775807"} 2024-01-27 22:56:49,070 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-01-27 22:56:49,070 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 989953c315a2c9318d5a003d0f7ce8cf, NAME => 'TestQuotaAdmin1,,1706396145679.989953c315a2c9318d5a003d0f7ce8cf.', STARTKEY => '', ENDKEY => ''}] 2024-01-27 22:56:49,070 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin1' as deleted. 2024-01-27 22:56:49,070 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1706396209070"}]},"ts":"9223372036854775807"} 2024-01-27 22:56:49,071 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin1 state from META 2024-01-27 22:56:49,073 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=34, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-27 22:56:49,075 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=34, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin1 in 35 msec 2024-01-27 22:56:49,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-01-27 22:56:49,297 INFO [Listener at localhost/33045] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin1, procId: 34 completed 2024-01-27 22:56:49,298 INFO [Listener at localhost/33045] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin2 2024-01-27 22:56:49,298 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin2 2024-01-27 22:56:49,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] procedure2.ProcedureExecutor(1075): Stored pid=35, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin2 2024-01-27 22:56:49,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-01-27 22:56:49,303 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1706396209303"}]},"ts":"1706396209303"} 2024-01-27 22:56:49,304 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLING in hbase:meta 2024-01-27 22:56:49,306 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set TestQuotaAdmin2 to state=DISABLING 2024-01-27 22:56:49,307 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=aaa5855dd44f17e0da3ff29e25ba830f, UNASSIGN}] 2024-01-27 22:56:49,308 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=aaa5855dd44f17e0da3ff29e25ba830f, UNASSIGN 2024-01-27 22:56:49,309 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=aaa5855dd44f17e0da3ff29e25ba830f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38023,1706396141471 2024-01-27 22:56:49,309 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1706396146467.aaa5855dd44f17e0da3ff29e25ba830f.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1706396209309"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1706396209309"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1706396209309"}]},"ts":"1706396209309"} 2024-01-27 22:56:49,311 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; CloseRegionProcedure aaa5855dd44f17e0da3ff29e25ba830f, server=jenkins-hbase4.apache.org,38023,1706396141471}] 2024-01-27 22:56:49,463 DEBUG [RSProcedureDispatcher-pool-5] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38023,1706396141471 2024-01-27 22:56:49,464 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close aaa5855dd44f17e0da3ff29e25ba830f 2024-01-27 22:56:49,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing aaa5855dd44f17e0da3ff29e25ba830f, disabling compactions & flushes 2024-01-27 22:56:49,465 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1706396146467.aaa5855dd44f17e0da3ff29e25ba830f. 2024-01-27 22:56:49,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1706396146467.aaa5855dd44f17e0da3ff29e25ba830f. 2024-01-27 22:56:49,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1706396146467.aaa5855dd44f17e0da3ff29e25ba830f. after waiting 0 ms 2024-01-27 22:56:49,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1706396146467.aaa5855dd44f17e0da3ff29e25ba830f. 2024-01-27 22:56:49,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/default/TestQuotaAdmin2/aaa5855dd44f17e0da3ff29e25ba830f/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-01-27 22:56:49,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1706396146467.aaa5855dd44f17e0da3ff29e25ba830f. 2024-01-27 22:56:49,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for aaa5855dd44f17e0da3ff29e25ba830f: 2024-01-27 22:56:49,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed aaa5855dd44f17e0da3ff29e25ba830f 2024-01-27 22:56:49,475 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=aaa5855dd44f17e0da3ff29e25ba830f, regionState=CLOSED 2024-01-27 22:56:49,475 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1706396146467.aaa5855dd44f17e0da3ff29e25ba830f.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1706396209475"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1706396209475"}]},"ts":"1706396209475"} 2024-01-27 22:56:49,479 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=37, resume processing ppid=36 2024-01-27 22:56:49,479 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=37, ppid=36, state=SUCCESS; CloseRegionProcedure aaa5855dd44f17e0da3ff29e25ba830f, server=jenkins-hbase4.apache.org,38023,1706396141471 in 166 msec 2024-01-27 22:56:49,481 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=36, resume processing ppid=35 2024-01-27 22:56:49,481 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=aaa5855dd44f17e0da3ff29e25ba830f, UNASSIGN in 172 msec 2024-01-27 22:56:49,482 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1706396209482"}]},"ts":"1706396209482"} 2024-01-27 22:56:49,483 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLED in hbase:meta 2024-01-27 22:56:49,487 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set TestQuotaAdmin2 to state=DISABLED 2024-01-27 22:56:49,489 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=35, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin2 in 190 msec 2024-01-27 22:56:49,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-01-27 22:56:49,554 INFO [Listener at localhost/33045] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin2, procId: 35 completed 2024-01-27 22:56:49,554 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin2 2024-01-27 22:56:49,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] procedure2.ProcedureExecutor(1075): Stored pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-27 22:56:49,558 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-27 22:56:49,559 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=38, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-27 22:56:49,561 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-01-27 22:56:49,563 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/default/TestQuotaAdmin2/aaa5855dd44f17e0da3ff29e25ba830f 2024-01-27 22:56:49,566 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/default/TestQuotaAdmin2/aaa5855dd44f17e0da3ff29e25ba830f/cf, FileablePath, hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/default/TestQuotaAdmin2/aaa5855dd44f17e0da3ff29e25ba830f/recovered.edits] 2024-01-27 22:56:49,574 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/default/TestQuotaAdmin2/aaa5855dd44f17e0da3ff29e25ba830f/recovered.edits/4.seqid to hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/archive/data/default/TestQuotaAdmin2/aaa5855dd44f17e0da3ff29e25ba830f/recovered.edits/4.seqid 2024-01-27 22:56:49,574 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/default/TestQuotaAdmin2/aaa5855dd44f17e0da3ff29e25ba830f 2024-01-27 22:56:49,574 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-01-27 22:56:49,577 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=38, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-27 22:56:49,579 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin2 from hbase:meta 2024-01-27 22:56:49,581 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin2' descriptor. 2024-01-27 22:56:49,583 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=38, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-27 22:56:49,583 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin2' from region states. 2024-01-27 22:56:49,583 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2,,1706396146467.aaa5855dd44f17e0da3ff29e25ba830f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1706396209583"}]},"ts":"9223372036854775807"} 2024-01-27 22:56:49,585 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-01-27 22:56:49,585 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => aaa5855dd44f17e0da3ff29e25ba830f, NAME => 'TestQuotaAdmin2,,1706396146467.aaa5855dd44f17e0da3ff29e25ba830f.', STARTKEY => '', ENDKEY => ''}] 2024-01-27 22:56:49,585 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin2' as deleted. 2024-01-27 22:56:49,585 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1706396209585"}]},"ts":"9223372036854775807"} 2024-01-27 22:56:49,587 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin2 state from META 2024-01-27 22:56:49,589 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=38, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-27 22:56:49,590 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=38, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin2 in 35 msec 2024-01-27 22:56:49,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-01-27 22:56:49,813 INFO [Listener at localhost/33045] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin2, procId: 38 completed 2024-01-27 22:56:49,813 INFO [Listener at localhost/33045] client.HBaseAdmin$15(890): Started disable of TestNs:TestTable 2024-01-27 22:56:49,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestNs:TestTable 2024-01-27 22:56:49,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] procedure2.ProcedureExecutor(1075): Stored pid=39, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestNs:TestTable 2024-01-27 22:56:49,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-01-27 22:56:49,818 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1706396209818"}]},"ts":"1706396209818"} 2024-01-27 22:56:49,820 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLING in hbase:meta 2024-01-27 22:56:49,822 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set TestNs:TestTable to state=DISABLING 2024-01-27 22:56:49,823 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=ade235f0d2cbac9feb7436723282dbcc, UNASSIGN}, {pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=a59826358e944031c7fb444f9785f2c9, UNASSIGN}] 2024-01-27 22:56:49,824 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=a59826358e944031c7fb444f9785f2c9, UNASSIGN 2024-01-27 22:56:49,824 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=ade235f0d2cbac9feb7436723282dbcc, UNASSIGN 2024-01-27 22:56:49,825 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=a59826358e944031c7fb444f9785f2c9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,44077,1706396141516 2024-01-27 22:56:49,825 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=ade235f0d2cbac9feb7436723282dbcc, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38023,1706396141471 2024-01-27 22:56:49,826 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1706396147522.a59826358e944031c7fb444f9785f2c9.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1706396209825"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1706396209825"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1706396209825"}]},"ts":"1706396209825"} 2024-01-27 22:56:49,826 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1706396147522.ade235f0d2cbac9feb7436723282dbcc.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1706396209825"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1706396209825"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1706396209825"}]},"ts":"1706396209825"} 2024-01-27 22:56:49,827 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=42, ppid=40, state=RUNNABLE; CloseRegionProcedure ade235f0d2cbac9feb7436723282dbcc, server=jenkins-hbase4.apache.org,38023,1706396141471}] 2024-01-27 22:56:49,828 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=43, ppid=41, state=RUNNABLE; CloseRegionProcedure a59826358e944031c7fb444f9785f2c9, server=jenkins-hbase4.apache.org,44077,1706396141516}] 2024-01-27 22:56:49,829 WARN [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=38947] assignment.AssignmentManager(1312): Unable to acquire lock for regionNode state=CLOSING, location=jenkins-hbase4.apache.org,38023,1706396141471, table=TestNs:TestTable, region=ade235f0d2cbac9feb7436723282dbcc. It is likely that another thread is currently holding the lock. To avoid deadlock, skip execution for now. 2024-01-27 22:56:49,979 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38023,1706396141471 2024-01-27 22:56:49,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close ade235f0d2cbac9feb7436723282dbcc 2024-01-27 22:56:49,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ade235f0d2cbac9feb7436723282dbcc, disabling compactions & flushes 2024-01-27 22:56:49,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1706396147522.ade235f0d2cbac9feb7436723282dbcc. 2024-01-27 22:56:49,981 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,44077,1706396141516 2024-01-27 22:56:49,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1706396147522.ade235f0d2cbac9feb7436723282dbcc. 2024-01-27 22:56:49,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1706396147522.ade235f0d2cbac9feb7436723282dbcc. after waiting 0 ms 2024-01-27 22:56:49,981 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1706396147522.ade235f0d2cbac9feb7436723282dbcc. 2024-01-27 22:56:49,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close a59826358e944031c7fb444f9785f2c9 2024-01-27 22:56:49,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a59826358e944031c7fb444f9785f2c9, disabling compactions & flushes 2024-01-27 22:56:49,982 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1706396147522.a59826358e944031c7fb444f9785f2c9. 2024-01-27 22:56:49,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1706396147522.a59826358e944031c7fb444f9785f2c9. 2024-01-27 22:56:49,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1706396147522.a59826358e944031c7fb444f9785f2c9. after waiting 0 ms 2024-01-27 22:56:49,982 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1706396147522.a59826358e944031c7fb444f9785f2c9. 2024-01-27 22:56:49,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/TestNs/TestTable/ade235f0d2cbac9feb7436723282dbcc/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-01-27 22:56:49,988 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/TestNs/TestTable/a59826358e944031c7fb444f9785f2c9/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-01-27 22:56:49,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1706396147522.ade235f0d2cbac9feb7436723282dbcc. 2024-01-27 22:56:49,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ade235f0d2cbac9feb7436723282dbcc: 2024-01-27 22:56:49,990 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1706396147522.a59826358e944031c7fb444f9785f2c9. 2024-01-27 22:56:49,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a59826358e944031c7fb444f9785f2c9: 2024-01-27 22:56:49,991 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed ade235f0d2cbac9feb7436723282dbcc 2024-01-27 22:56:49,992 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=ade235f0d2cbac9feb7436723282dbcc, regionState=CLOSED 2024-01-27 22:56:49,992 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,,1706396147522.ade235f0d2cbac9feb7436723282dbcc.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1706396209992"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1706396209992"}]},"ts":"1706396209992"} 2024-01-27 22:56:49,992 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed a59826358e944031c7fb444f9785f2c9 2024-01-27 22:56:49,993 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=a59826358e944031c7fb444f9785f2c9, regionState=CLOSED 2024-01-27 22:56:49,993 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1706396147522.a59826358e944031c7fb444f9785f2c9.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1706396209993"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1706396209993"}]},"ts":"1706396209993"} 2024-01-27 22:56:49,995 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=42, resume processing ppid=40 2024-01-27 22:56:49,995 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=42, ppid=40, state=SUCCESS; CloseRegionProcedure ade235f0d2cbac9feb7436723282dbcc, server=jenkins-hbase4.apache.org,38023,1706396141471 in 166 msec 2024-01-27 22:56:49,996 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=43, resume processing ppid=41 2024-01-27 22:56:49,996 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=43, ppid=41, state=SUCCESS; CloseRegionProcedure a59826358e944031c7fb444f9785f2c9, server=jenkins-hbase4.apache.org,44077,1706396141516 in 166 msec 2024-01-27 22:56:49,997 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=ade235f0d2cbac9feb7436723282dbcc, UNASSIGN in 172 msec 2024-01-27 22:56:49,998 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=41, resume processing ppid=39 2024-01-27 22:56:49,998 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=41, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=a59826358e944031c7fb444f9785f2c9, UNASSIGN in 173 msec 2024-01-27 22:56:49,999 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1706396209999"}]},"ts":"1706396209999"} 2024-01-27 22:56:50,000 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLED in hbase:meta 2024-01-27 22:56:50,002 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set TestNs:TestTable to state=DISABLED 2024-01-27 22:56:50,004 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=39, state=SUCCESS; DisableTableProcedure table=TestNs:TestTable in 189 msec 2024-01-27 22:56:50,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-01-27 22:56:50,070 INFO [Listener at localhost/33045] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: TestNs:TestTable, procId: 39 completed 2024-01-27 22:56:50,070 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestNs:TestTable 2024-01-27 22:56:50,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] procedure2.ProcedureExecutor(1075): Stored pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestNs:TestTable 2024-01-27 22:56:50,073 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-27 22:56:50,074 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=44, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-27 22:56:50,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-01-27 22:56:50,080 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/TestNs/TestTable/ade235f0d2cbac9feb7436723282dbcc 2024-01-27 22:56:50,080 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/TestNs/TestTable/a59826358e944031c7fb444f9785f2c9 2024-01-27 22:56:50,082 DEBUG [HFileArchiver-11] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/TestNs/TestTable/ade235f0d2cbac9feb7436723282dbcc/cf, FileablePath, hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/TestNs/TestTable/ade235f0d2cbac9feb7436723282dbcc/recovered.edits] 2024-01-27 22:56:50,083 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/TestNs/TestTable/a59826358e944031c7fb444f9785f2c9/cf, FileablePath, hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/TestNs/TestTable/a59826358e944031c7fb444f9785f2c9/recovered.edits] 2024-01-27 22:56:50,090 DEBUG [HFileArchiver-11] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/TestNs/TestTable/ade235f0d2cbac9feb7436723282dbcc/recovered.edits/4.seqid to hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/archive/data/TestNs/TestTable/ade235f0d2cbac9feb7436723282dbcc/recovered.edits/4.seqid 2024-01-27 22:56:50,090 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/TestNs/TestTable/a59826358e944031c7fb444f9785f2c9/recovered.edits/4.seqid to hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/archive/data/TestNs/TestTable/a59826358e944031c7fb444f9785f2c9/recovered.edits/4.seqid 2024-01-27 22:56:50,091 DEBUG [HFileArchiver-11] backup.HFileArchiver(596): Deleted hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/TestNs/TestTable/ade235f0d2cbac9feb7436723282dbcc 2024-01-27 22:56:50,091 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/.tmp/data/TestNs/TestTable/a59826358e944031c7fb444f9785f2c9 2024-01-27 22:56:50,091 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-01-27 22:56:50,094 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=44, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-27 22:56:50,096 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of TestNs:TestTable from hbase:meta 2024-01-27 22:56:50,098 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'TestNs:TestTable' descriptor. 2024-01-27 22:56:50,099 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=44, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-27 22:56:50,099 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'TestNs:TestTable' from region states. 2024-01-27 22:56:50,099 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,,1706396147522.ade235f0d2cbac9feb7436723282dbcc.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1706396210099"}]},"ts":"9223372036854775807"} 2024-01-27 22:56:50,099 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,1,1706396147522.a59826358e944031c7fb444f9785f2c9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1706396210099"}]},"ts":"9223372036854775807"} 2024-01-27 22:56:50,101 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2024-01-27 22:56:50,101 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => ade235f0d2cbac9feb7436723282dbcc, NAME => 'TestNs:TestTable,,1706396147522.ade235f0d2cbac9feb7436723282dbcc.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => a59826358e944031c7fb444f9785f2c9, NAME => 'TestNs:TestTable,1,1706396147522.a59826358e944031c7fb444f9785f2c9.', STARTKEY => '1', ENDKEY => ''}] 2024-01-27 22:56:50,101 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'TestNs:TestTable' as deleted. 2024-01-27 22:56:50,101 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1706396210101"}]},"ts":"9223372036854775807"} 2024-01-27 22:56:50,103 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table TestNs:TestTable state from META 2024-01-27 22:56:50,106 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=44, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-27 22:56:50,108 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=44, state=SUCCESS; DeleteTableProcedure table=TestNs:TestTable in 35 msec 2024-01-27 22:56:50,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-01-27 22:56:50,328 INFO [Listener at localhost/33045] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: TestNs:TestTable, procId: 44 completed 2024-01-27 22:56:50,332 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.HMaster$17(3092): Client=jenkins//172.31.14.131 delete TestNs 2024-01-27 22:56:50,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] procedure2.ProcedureExecutor(1075): Stored pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE; DeleteNamespaceProcedure, namespace=TestNs 2024-01-27 22:56:50,340 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-27 22:56:50,343 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_FROM_NS_TABLE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-27 22:56:50,345 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_FROM_ZK, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-27 22:56:50,345 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-01-27 22:56:50,346 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace/TestNs 2024-01-27 22:56:50,346 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-01-27 22:56:50,347 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_DIRECTORIES, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-27 22:56:50,349 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_NAMESPACE_QUOTA, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-27 22:56:50,351 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=45, state=SUCCESS; DeleteNamespaceProcedure, namespace=TestNs in 17 msec 2024-01-27 22:56:50,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-01-27 22:56:50,597 INFO [Listener at localhost/33045] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2024-01-27 22:56:50,597 INFO [Listener at localhost/33045] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-01-27 22:56:50,597 DEBUG [Listener at localhost/33045] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3691fd41 to 127.0.0.1:60512 2024-01-27 22:56:50,597 DEBUG [Listener at localhost/33045] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-27 22:56:50,598 DEBUG [Listener at localhost/33045] util.JVMClusterUtil(237): Shutting down HBase Cluster 2024-01-27 22:56:50,598 DEBUG [Listener at localhost/33045] util.JVMClusterUtil(257): Found active master hash=969310897, stopped=false 2024-01-27 22:56:50,598 DEBUG [Listener at localhost/33045] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-01-27 22:56:50,599 INFO [Listener at localhost/33045] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,38947,1706396140219 2024-01-27 22:56:50,601 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): regionserver:38023-0x1016b32a36e0001, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-01-27 22:56:50,601 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): regionserver:44077-0x1016b32a36e0002, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-01-27 22:56:50,601 INFO [Listener at localhost/33045] procedure2.ProcedureExecutor(675): Stopping 2024-01-27 22:56:50,601 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-01-27 22:56:50,601 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-27 22:56:50,602 DEBUG [Listener at localhost/33045] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69bbe05b to 127.0.0.1:60512 2024-01-27 22:56:50,602 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:44077-0x1016b32a36e0002, quorum=127.0.0.1:60512, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-27 22:56:50,602 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:38023-0x1016b32a36e0001, quorum=127.0.0.1:60512, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-27 22:56:50,602 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-27 22:56:50,602 DEBUG [Listener at localhost/33045] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-27 22:56:50,602 INFO [Listener at localhost/33045] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,38023,1706396141471' ***** 2024-01-27 22:56:50,602 INFO [Listener at localhost/33045] regionserver.HRegionServer(2313): STOPPED: Shutdown requested 2024-01-27 22:56:50,602 INFO [Listener at localhost/33045] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,44077,1706396141516' ***** 2024-01-27 22:56:50,602 INFO [Listener at localhost/33045] regionserver.HRegionServer(2313): STOPPED: Shutdown requested 2024-01-27 22:56:50,602 INFO [RS:1;jenkins-hbase4:44077] regionserver.HeapMemoryManager(220): Stopping 2024-01-27 22:56:50,602 INFO [RS:0;jenkins-hbase4:38023] regionserver.HeapMemoryManager(220): Stopping 2024-01-27 22:56:50,603 INFO [RS:1;jenkins-hbase4:44077] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-01-27 22:56:50,603 INFO [RS:0;jenkins-hbase4:38023] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-01-27 22:56:50,603 INFO [RS:1;jenkins-hbase4:44077] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-01-27 22:56:50,603 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-01-27 22:56:50,603 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-01-27 22:56:50,603 INFO [RS:1;jenkins-hbase4:44077] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,44077,1706396141516 2024-01-27 22:56:50,603 INFO [RS:0;jenkins-hbase4:38023] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-01-27 22:56:50,603 INFO [RS:1;jenkins-hbase4:44077] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-01-27 22:56:50,603 INFO [RS:0;jenkins-hbase4:38023] regionserver.HRegionServer(3307): Received CLOSE for cf62df53c60f75c0443193de3b37411c 2024-01-27 22:56:50,603 DEBUG [RS:1;jenkins-hbase4:44077] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3864b157 to 127.0.0.1:60512 2024-01-27 22:56:50,603 DEBUG [RS:1;jenkins-hbase4:44077] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-27 22:56:50,603 INFO [RS:1;jenkins-hbase4:44077] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-01-27 22:56:50,603 INFO [RS:1;jenkins-hbase4:44077] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-01-27 22:56:50,603 INFO [RS:1;jenkins-hbase4:44077] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-01-27 22:56:50,604 INFO [RS:1;jenkins-hbase4:44077] regionserver.HRegionServer(3307): Received CLOSE for 1588230740 2024-01-27 22:56:50,603 INFO [RS:0;jenkins-hbase4:38023] regionserver.HRegionServer(3307): Received CLOSE for 2de4c461dc1a4b64c8b6e833158d4c10 2024-01-27 22:56:50,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cf62df53c60f75c0443193de3b37411c, disabling compactions & flushes 2024-01-27 22:56:50,604 INFO [RS:0;jenkins-hbase4:38023] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,38023,1706396141471 2024-01-27 22:56:50,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1706396143520.cf62df53c60f75c0443193de3b37411c. 2024-01-27 22:56:50,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1706396143520.cf62df53c60f75c0443193de3b37411c. 2024-01-27 22:56:50,604 INFO [RS:0;jenkins-hbase4:38023] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-01-27 22:56:50,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1706396143520.cf62df53c60f75c0443193de3b37411c. after waiting 0 ms 2024-01-27 22:56:50,605 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-01-27 22:56:50,604 INFO [RS:1;jenkins-hbase4:44077] regionserver.HRegionServer(1477): Waiting on 1 regions to close 2024-01-27 22:56:50,605 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-01-27 22:56:50,605 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1706396143520.cf62df53c60f75c0443193de3b37411c. 2024-01-27 22:56:50,605 DEBUG [RS:0;jenkins-hbase4:38023] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1603212b to 127.0.0.1:60512 2024-01-27 22:56:50,605 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing cf62df53c60f75c0443193de3b37411c 1/1 column families, dataSize=147 B heapSize=704 B 2024-01-27 22:56:50,605 DEBUG [RS:0;jenkins-hbase4:38023] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-27 22:56:50,605 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-01-27 22:56:50,605 INFO [RS:0;jenkins-hbase4:38023] regionserver.HRegionServer(1477): Waiting on 2 regions to close 2024-01-27 22:56:50,605 DEBUG [RS:1;jenkins-hbase4:44077] regionserver.HRegionServer(1481): Online Regions={1588230740=hbase:meta,,1.1588230740} 2024-01-27 22:56:50,606 DEBUG [RS:0;jenkins-hbase4:38023] regionserver.HRegionServer(1481): Online Regions={cf62df53c60f75c0443193de3b37411c=hbase:namespace,,1706396143520.cf62df53c60f75c0443193de3b37411c., 2de4c461dc1a4b64c8b6e833158d4c10=hbase:quota,,1706396144261.2de4c461dc1a4b64c8b6e833158d4c10.} 2024-01-27 22:56:50,605 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-01-27 22:56:50,606 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-01-27 22:56:50,606 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=14.15 KB heapSize=25.10 KB 2024-01-27 22:56:50,607 DEBUG [RS:0;jenkins-hbase4:38023] regionserver.HRegionServer(1507): Waiting on 2de4c461dc1a4b64c8b6e833158d4c10, cf62df53c60f75c0443193de3b37411c 2024-01-27 22:56:50,607 DEBUG [RS:1;jenkins-hbase4:44077] regionserver.HRegionServer(1507): Waiting on 1588230740 2024-01-27 22:56:50,641 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=12.16 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/meta/1588230740/.tmp/info/6de813fecf274091bcfc0bcb83cd6203 2024-01-27 22:56:50,643 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=147 B at sequenceid=8 (bloomFilter=true), to=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/namespace/cf62df53c60f75c0443193de3b37411c/.tmp/info/3f3c12dbde6d40d980746c2be61c31f9 2024-01-27 22:56:50,646 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-01-27 22:56:50,651 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6de813fecf274091bcfc0bcb83cd6203 2024-01-27 22:56:50,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3f3c12dbde6d40d980746c2be61c31f9 2024-01-27 22:56:50,654 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/namespace/cf62df53c60f75c0443193de3b37411c/.tmp/info/3f3c12dbde6d40d980746c2be61c31f9 as hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/namespace/cf62df53c60f75c0443193de3b37411c/info/3f3c12dbde6d40d980746c2be61c31f9 2024-01-27 22:56:50,661 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3f3c12dbde6d40d980746c2be61c31f9 2024-01-27 22:56:50,662 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/namespace/cf62df53c60f75c0443193de3b37411c/info/3f3c12dbde6d40d980746c2be61c31f9, entries=3, sequenceid=8, filesize=5.0 K 2024-01-27 22:56:50,663 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~147 B/147, heapSize ~688 B/688, currentSize=0 B/0 for cf62df53c60f75c0443193de3b37411c in 58ms, sequenceid=8, compaction requested=false 2024-01-27 22:56:50,667 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=478 B at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/meta/1588230740/.tmp/rep_barrier/8844a90ca0ed44e69e7601d682331b00 2024-01-27 22:56:50,670 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/namespace/cf62df53c60f75c0443193de3b37411c/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=1 2024-01-27 22:56:50,671 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1706396143520.cf62df53c60f75c0443193de3b37411c. 2024-01-27 22:56:50,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cf62df53c60f75c0443193de3b37411c: 2024-01-27 22:56:50,671 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1706396143520.cf62df53c60f75c0443193de3b37411c. 2024-01-27 22:56:50,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 2de4c461dc1a4b64c8b6e833158d4c10, disabling compactions & flushes 2024-01-27 22:56:50,672 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:quota,,1706396144261.2de4c461dc1a4b64c8b6e833158d4c10. 2024-01-27 22:56:50,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1706396144261.2de4c461dc1a4b64c8b6e833158d4c10. 2024-01-27 22:56:50,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1706396144261.2de4c461dc1a4b64c8b6e833158d4c10. after waiting 0 ms 2024-01-27 22:56:50,672 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1706396144261.2de4c461dc1a4b64c8b6e833158d4c10. 2024-01-27 22:56:50,672 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 2de4c461dc1a4b64c8b6e833158d4c10 2/2 column families, dataSize=726 B heapSize=2.44 KB 2024-01-27 22:56:50,675 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8844a90ca0ed44e69e7601d682331b00 2024-01-27 22:56:50,688 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-01-27 22:56:50,698 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=597 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/quota/2de4c461dc1a4b64c8b6e833158d4c10/.tmp/q/1fba9dd344744bf9aa7f00bd244808ee 2024-01-27 22:56:50,698 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.53 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/meta/1588230740/.tmp/table/901e82e96cc146a6beb9a3793f442c16 2024-01-27 22:56:50,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1fba9dd344744bf9aa7f00bd244808ee 2024-01-27 22:56:50,707 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 901e82e96cc146a6beb9a3793f442c16 2024-01-27 22:56:50,708 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/meta/1588230740/.tmp/info/6de813fecf274091bcfc0bcb83cd6203 as hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/meta/1588230740/info/6de813fecf274091bcfc0bcb83cd6203 2024-01-27 22:56:50,724 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6de813fecf274091bcfc0bcb83cd6203 2024-01-27 22:56:50,725 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/meta/1588230740/info/6de813fecf274091bcfc0bcb83cd6203, entries=30, sequenceid=66, filesize=8.0 K 2024-01-27 22:56:50,726 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=129 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/quota/2de4c461dc1a4b64c8b6e833158d4c10/.tmp/u/7fee86ecc80b4792b28dc4b0aeb6b420 2024-01-27 22:56:50,726 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/meta/1588230740/.tmp/rep_barrier/8844a90ca0ed44e69e7601d682331b00 as hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/meta/1588230740/rep_barrier/8844a90ca0ed44e69e7601d682331b00 2024-01-27 22:56:50,733 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7fee86ecc80b4792b28dc4b0aeb6b420 2024-01-27 22:56:50,734 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/quota/2de4c461dc1a4b64c8b6e833158d4c10/.tmp/q/1fba9dd344744bf9aa7f00bd244808ee as hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/quota/2de4c461dc1a4b64c8b6e833158d4c10/q/1fba9dd344744bf9aa7f00bd244808ee 2024-01-27 22:56:50,734 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8844a90ca0ed44e69e7601d682331b00 2024-01-27 22:56:50,735 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/meta/1588230740/rep_barrier/8844a90ca0ed44e69e7601d682331b00, entries=5, sequenceid=66, filesize=5.3 K 2024-01-27 22:56:50,737 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/meta/1588230740/.tmp/table/901e82e96cc146a6beb9a3793f442c16 as hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/meta/1588230740/table/901e82e96cc146a6beb9a3793f442c16 2024-01-27 22:56:50,744 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 901e82e96cc146a6beb9a3793f442c16 2024-01-27 22:56:50,745 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/meta/1588230740/table/901e82e96cc146a6beb9a3793f442c16, entries=13, sequenceid=66, filesize=5.6 K 2024-01-27 22:56:50,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1fba9dd344744bf9aa7f00bd244808ee 2024-01-27 22:56:50,745 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/quota/2de4c461dc1a4b64c8b6e833158d4c10/q/1fba9dd344744bf9aa7f00bd244808ee, entries=5, sequenceid=17, filesize=5.1 K 2024-01-27 22:56:50,746 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~14.15 KB/14494, heapSize ~25.05 KB/25656, currentSize=0 B/0 for 1588230740 in 140ms, sequenceid=66, compaction requested=false 2024-01-27 22:56:50,748 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/quota/2de4c461dc1a4b64c8b6e833158d4c10/.tmp/u/7fee86ecc80b4792b28dc4b0aeb6b420 as hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/quota/2de4c461dc1a4b64c8b6e833158d4c10/u/7fee86ecc80b4792b28dc4b0aeb6b420 2024-01-27 22:56:50,755 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/meta/1588230740/recovered.edits/69.seqid, newMaxSeqId=69, maxSeqId=1 2024-01-27 22:56:50,755 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-01-27 22:56:50,756 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-01-27 22:56:50,756 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-01-27 22:56:50,756 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2024-01-27 22:56:50,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7fee86ecc80b4792b28dc4b0aeb6b420 2024-01-27 22:56:50,758 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/quota/2de4c461dc1a4b64c8b6e833158d4c10/u/7fee86ecc80b4792b28dc4b0aeb6b420, entries=4, sequenceid=17, filesize=5.0 K 2024-01-27 22:56:50,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~726 B/726, heapSize ~2.41 KB/2464, currentSize=0 B/0 for 2de4c461dc1a4b64c8b6e833158d4c10 in 87ms, sequenceid=17, compaction requested=false 2024-01-27 22:56:50,765 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/data/hbase/quota/2de4c461dc1a4b64c8b6e833158d4c10/recovered.edits/20.seqid, newMaxSeqId=20, maxSeqId=1 2024-01-27 22:56:50,766 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:quota,,1706396144261.2de4c461dc1a4b64c8b6e833158d4c10. 2024-01-27 22:56:50,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 2de4c461dc1a4b64c8b6e833158d4c10: 2024-01-27 22:56:50,767 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:quota,,1706396144261.2de4c461dc1a4b64c8b6e833158d4c10. 2024-01-27 22:56:50,807 INFO [RS:0;jenkins-hbase4:38023] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,38023,1706396141471; all regions closed. 2024-01-27 22:56:50,807 INFO [RS:1;jenkins-hbase4:44077] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,44077,1706396141516; all regions closed. 2024-01-27 22:56:50,808 DEBUG [RS:0;jenkins-hbase4:38023] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-01-27 22:56:50,808 DEBUG [RS:1;jenkins-hbase4:44077] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-01-27 22:56:50,820 DEBUG [RS:1;jenkins-hbase4:44077] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/oldWALs 2024-01-27 22:56:50,820 INFO [RS:1;jenkins-hbase4:44077] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44077%2C1706396141516.meta:.meta(num 1706396143245) 2024-01-27 22:56:50,820 DEBUG [RS:0;jenkins-hbase4:38023] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/oldWALs 2024-01-27 22:56:50,820 INFO [RS:0;jenkins-hbase4:38023] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38023%2C1706396141471:(num 1706396143066) 2024-01-27 22:56:50,820 DEBUG [RS:0;jenkins-hbase4:38023] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-27 22:56:50,820 INFO [RS:0;jenkins-hbase4:38023] regionserver.LeaseManager(133): Closed leases 2024-01-27 22:56:50,821 INFO [RS:0;jenkins-hbase4:38023] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2024-01-27 22:56:50,821 INFO [RS:0;jenkins-hbase4:38023] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-01-27 22:56:50,821 INFO [RS:0;jenkins-hbase4:38023] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-01-27 22:56:50,821 INFO [RS:0;jenkins-hbase4:38023] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-01-27 22:56:50,821 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-01-27 22:56:50,822 INFO [RS:0;jenkins-hbase4:38023] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38023 2024-01-27 22:56:50,830 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): regionserver:38023-0x1016b32a36e0001, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38023,1706396141471 2024-01-27 22:56:50,831 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-01-27 22:56:50,831 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): regionserver:44077-0x1016b32a36e0002, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38023,1706396141471 2024-01-27 22:56:50,831 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): regionserver:38023-0x1016b32a36e0001, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-01-27 22:56:50,831 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): regionserver:44077-0x1016b32a36e0002, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-01-27 22:56:50,832 DEBUG [RS:1;jenkins-hbase4:44077] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/oldWALs 2024-01-27 22:56:50,832 INFO [RS:1;jenkins-hbase4:44077] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C44077%2C1706396141516:(num 1706396143066) 2024-01-27 22:56:50,832 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38023,1706396141471] 2024-01-27 22:56:50,832 DEBUG [RS:1;jenkins-hbase4:44077] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-27 22:56:50,832 INFO [RS:1;jenkins-hbase4:44077] regionserver.LeaseManager(133): Closed leases 2024-01-27 22:56:50,832 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38023,1706396141471; numProcessing=1 2024-01-27 22:56:50,832 INFO [RS:1;jenkins-hbase4:44077] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2024-01-27 22:56:50,833 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-01-27 22:56:50,833 INFO [RS:1;jenkins-hbase4:44077] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44077 2024-01-27 22:56:50,834 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38023,1706396141471 already deleted, retry=false 2024-01-27 22:56:50,834 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,38023,1706396141471 expired; onlineServers=1 2024-01-27 22:56:50,835 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-01-27 22:56:50,835 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): regionserver:44077-0x1016b32a36e0002, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,44077,1706396141516 2024-01-27 22:56:50,836 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,44077,1706396141516] 2024-01-27 22:56:50,836 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,44077,1706396141516; numProcessing=2 2024-01-27 22:56:50,838 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,44077,1706396141516 already deleted, retry=false 2024-01-27 22:56:50,838 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,44077,1706396141516 expired; onlineServers=0 2024-01-27 22:56:50,838 INFO [RegionServerTracker-0] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,38947,1706396140219' ***** 2024-01-27 22:56:50,838 INFO [RegionServerTracker-0] regionserver.HRegionServer(2313): STOPPED: Cluster shutdown set; onlineServer=0 2024-01-27 22:56:50,839 DEBUG [M:0;jenkins-hbase4:38947] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@441735c6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-01-27 22:56:50,839 INFO [M:0;jenkins-hbase4:38947] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,38947,1706396140219 2024-01-27 22:56:50,839 INFO [M:0;jenkins-hbase4:38947] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,38947,1706396140219; all regions closed. 2024-01-27 22:56:50,839 DEBUG [M:0;jenkins-hbase4:38947] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-27 22:56:50,839 DEBUG [M:0;jenkins-hbase4:38947] cleaner.LogCleaner(198): Cancelling LogCleaner 2024-01-27 22:56:50,840 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2024-01-27 22:56:50,840 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1706396142713] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1706396142713,5,FailOnTimeoutGroup] 2024-01-27 22:56:50,840 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1706396142710] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1706396142710,5,FailOnTimeoutGroup] 2024-01-27 22:56:50,840 DEBUG [M:0;jenkins-hbase4:38947] cleaner.HFileCleaner(317): Stopping file delete threads 2024-01-27 22:56:50,840 INFO [M:0;jenkins-hbase4:38947] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2024-01-27 22:56:50,840 INFO [M:0;jenkins-hbase4:38947] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2024-01-27 22:56:50,840 INFO [M:0;jenkins-hbase4:38947] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS] on shutdown 2024-01-27 22:56:50,840 DEBUG [M:0;jenkins-hbase4:38947] master.HMaster(1517): Stopping service threads 2024-01-27 22:56:50,840 INFO [M:0;jenkins-hbase4:38947] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2024-01-27 22:56:50,841 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2024-01-27 22:56:50,841 ERROR [M:0;jenkins-hbase4:38947] procedure2.ProcedureExecutor(699): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2024-01-27 22:56:50,841 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase Thread[HFileArchiver-8,5,PEWorkerGroup] Thread[HFileArchiver-9,5,PEWorkerGroup] Thread[HFileArchiver-10,5,PEWorkerGroup] Thread[HFileArchiver-11,5,PEWorkerGroup] Thread[HFileArchiver-12,5,PEWorkerGroup] 2024-01-27 22:56:50,841 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-01-27 22:56:50,842 INFO [M:0;jenkins-hbase4:38947] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2024-01-27 22:56:50,842 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2024-01-27 22:56:50,842 DEBUG [M:0;jenkins-hbase4:38947] zookeeper.ZKUtil(399): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2024-01-27 22:56:50,842 WARN [M:0;jenkins-hbase4:38947] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2024-01-27 22:56:50,842 INFO [M:0;jenkins-hbase4:38947] assignment.AssignmentManager(315): Stopping assignment manager 2024-01-27 22:56:50,842 INFO [M:0;jenkins-hbase4:38947] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2024-01-27 22:56:50,843 DEBUG [M:0;jenkins-hbase4:38947] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-01-27 22:56:50,843 INFO [M:0;jenkins-hbase4:38947] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-27 22:56:50,843 DEBUG [M:0;jenkins-hbase4:38947] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-27 22:56:50,843 DEBUG [M:0;jenkins-hbase4:38947] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-01-27 22:56:50,843 DEBUG [M:0;jenkins-hbase4:38947] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-27 22:56:50,843 INFO [M:0;jenkins-hbase4:38947] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=152.91 KB heapSize=184.74 KB 2024-01-27 22:56:50,859 INFO [M:0;jenkins-hbase4:38947] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=152.91 KB at sequenceid=376 (bloomFilter=true), to=hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/345c7ad617f9414298b98e1b11cd416a 2024-01-27 22:56:50,865 INFO [M:0;jenkins-hbase4:38947] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 345c7ad617f9414298b98e1b11cd416a 2024-01-27 22:56:50,866 DEBUG [M:0;jenkins-hbase4:38947] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/345c7ad617f9414298b98e1b11cd416a as hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/345c7ad617f9414298b98e1b11cd416a 2024-01-27 22:56:50,872 INFO [M:0;jenkins-hbase4:38947] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 345c7ad617f9414298b98e1b11cd416a 2024-01-27 22:56:50,873 INFO [M:0;jenkins-hbase4:38947] regionserver.HStore(1080): Added hdfs://localhost:43607/user/jenkins/test-data/52ad5722-2e26-b94d-17e0-d8f258da8471/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/345c7ad617f9414298b98e1b11cd416a, entries=45, sequenceid=376, filesize=12.0 K 2024-01-27 22:56:50,873 INFO [M:0;jenkins-hbase4:38947] regionserver.HRegion(2948): Finished flush of dataSize ~152.91 KB/156579, heapSize ~184.73 KB/189160, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 30ms, sequenceid=376, compaction requested=false 2024-01-27 22:56:50,875 INFO [M:0;jenkins-hbase4:38947] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-27 22:56:50,875 DEBUG [M:0;jenkins-hbase4:38947] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-01-27 22:56:50,878 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-01-27 22:56:50,878 INFO [M:0;jenkins-hbase4:38947] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2024-01-27 22:56:50,879 INFO [M:0;jenkins-hbase4:38947] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38947 2024-01-27 22:56:50,880 DEBUG [M:0;jenkins-hbase4:38947] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,38947,1706396140219 already deleted, retry=false 2024-01-27 22:56:50,934 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): regionserver:38023-0x1016b32a36e0001, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-27 22:56:50,934 INFO [RS:0;jenkins-hbase4:38023] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,38023,1706396141471; zookeeper connection closed. 2024-01-27 22:56:50,934 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): regionserver:38023-0x1016b32a36e0001, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-27 22:56:50,935 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@384818bc] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@384818bc 2024-01-27 22:56:50,937 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): regionserver:44077-0x1016b32a36e0002, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-27 22:56:50,937 INFO [RS:1;jenkins-hbase4:44077] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,44077,1706396141516; zookeeper connection closed. 2024-01-27 22:56:50,937 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): regionserver:44077-0x1016b32a36e0002, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-27 22:56:50,938 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@462fedbe] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@462fedbe 2024-01-27 22:56:50,938 INFO [Listener at localhost/33045] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2024-01-27 22:56:50,982 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-27 22:56:50,982 INFO [M:0;jenkins-hbase4:38947] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,38947,1706396140219; zookeeper connection closed. 2024-01-27 22:56:50,982 DEBUG [Listener at localhost/33045-EventThread] zookeeper.ZKWatcher(600): master:38947-0x1016b32a36e0000, quorum=127.0.0.1:60512, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-27 22:56:50,984 WARN [Listener at localhost/33045] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-01-27 22:56:50,986 INFO [Listener at localhost/33045] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-01-27 22:56:51,091 WARN [BP-1162478997-172.31.14.131-1706396136997 heartbeating to localhost/127.0.0.1:43607] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-01-27 22:56:51,091 WARN [BP-1162478997-172.31.14.131-1706396136997 heartbeating to localhost/127.0.0.1:43607] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1162478997-172.31.14.131-1706396136997 (Datanode Uuid be2925d0-c170-4730-af82-ab14c7c79cd3) service to localhost/127.0.0.1:43607 2024-01-27 22:56:51,093 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/cluster_8fe42a6e-af8f-b55b-43a1-711a5ebae4d9/dfs/data/data3/current/BP-1162478997-172.31.14.131-1706396136997] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-01-27 22:56:51,093 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/cluster_8fe42a6e-af8f-b55b-43a1-711a5ebae4d9/dfs/data/data4/current/BP-1162478997-172.31.14.131-1706396136997] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-01-27 22:56:51,094 WARN [Listener at localhost/33045] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-01-27 22:56:51,096 INFO [Listener at localhost/33045] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-01-27 22:56:51,142 WARN [BP-1162478997-172.31.14.131-1706396136997 heartbeating to localhost/127.0.0.1:43607] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1162478997-172.31.14.131-1706396136997 (Datanode Uuid 06a61f3b-eb92-4fe9-98d8-61d83aafa172) service to localhost/127.0.0.1:43607 2024-01-27 22:56:51,142 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/cluster_8fe42a6e-af8f-b55b-43a1-711a5ebae4d9/dfs/data/data1/current/BP-1162478997-172.31.14.131-1706396136997] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-01-27 22:56:51,143 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/f3b5b46a-eab6-34a3-fbe7-5b5211408385/cluster_8fe42a6e-af8f-b55b-43a1-711a5ebae4d9/dfs/data/data2/current/BP-1162478997-172.31.14.131-1706396136997] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-01-27 22:56:51,239 INFO [Listener at localhost/33045] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-01-27 22:56:51,354 INFO [Listener at localhost/33045] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2024-01-27 22:56:51,395 INFO [Listener at localhost/33045] hbase.HBaseTestingUtility(1293): Minicluster is down