2024-04-22 06:57:16,587 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle timeout: 13 mins 2024-04-22 06:57:16,807 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c 2024-04-22 06:57:16,822 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2024-04-22 06:57:16,822 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/cluster_6184197d-533f-d0b3-d2d4-ec91c7d097d1, deleteOnExit=true 2024-04-22 06:57:16,823 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2024-04-22 06:57:16,823 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/test.cache.data in system properties and HBase conf 2024-04-22 06:57:16,824 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/hadoop.tmp.dir in system properties and HBase conf 2024-04-22 06:57:16,825 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/hadoop.log.dir in system properties and HBase conf 2024-04-22 06:57:16,825 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/mapreduce.cluster.local.dir in system properties and HBase conf 2024-04-22 06:57:16,826 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/mapreduce.cluster.temp.dir in system properties and HBase conf 2024-04-22 06:57:16,826 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2024-04-22 06:57:16,950 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2024-04-22 06:57:17,414 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-04-22 06:57:17,419 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2024-04-22 06:57:17,420 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2024-04-22 06:57:17,420 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/yarn.nodemanager.log-dirs in system properties and HBase conf 2024-04-22 06:57:17,420 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-04-22 06:57:17,421 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2024-04-22 06:57:17,421 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2024-04-22 06:57:17,421 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-04-22 06:57:17,422 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/dfs.journalnode.edits.dir in system properties and HBase conf 2024-04-22 06:57:17,422 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2024-04-22 06:57:17,423 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/nfs.dump.dir in system properties and HBase conf 2024-04-22 06:57:17,423 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/java.io.tmpdir in system properties and HBase conf 2024-04-22 06:57:17,424 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/dfs.journalnode.edits.dir in system properties and HBase conf 2024-04-22 06:57:17,424 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2024-04-22 06:57:17,425 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2024-04-22 06:57:18,058 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-04-22 06:57:18,063 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-04-22 06:57:18,351 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2024-04-22 06:57:18,554 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2024-04-22 06:57:18,569 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-04-22 06:57:18,605 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2024-04-22 06:57:18,637 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/java.io.tmpdir/Jetty_localhost_45945_hdfs____.jjhxx9/webapp 2024-04-22 06:57:18,763 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45945 2024-04-22 06:57:18,773 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-04-22 06:57:18,773 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-04-22 06:57:19,322 WARN [Listener at localhost/38355] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-04-22 06:57:19,392 WARN [Listener at localhost/38355] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-04-22 06:57:19,412 WARN [Listener at localhost/38355] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-04-22 06:57:19,420 INFO [Listener at localhost/38355] log.Slf4jLog(67): jetty-6.1.26 2024-04-22 06:57:19,425 INFO [Listener at localhost/38355] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/java.io.tmpdir/Jetty_localhost_35535_datanode____nuvpy4/webapp 2024-04-22 06:57:19,523 INFO [Listener at localhost/38355] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35535 2024-04-22 06:57:19,853 WARN [Listener at localhost/43701] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-04-22 06:57:19,872 WARN [Listener at localhost/43701] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-04-22 06:57:19,876 WARN [Listener at localhost/43701] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-04-22 06:57:19,879 INFO [Listener at localhost/43701] log.Slf4jLog(67): jetty-6.1.26 2024-04-22 06:57:19,886 INFO [Listener at localhost/43701] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/java.io.tmpdir/Jetty_localhost_41515_datanode____ppbm8z/webapp 2024-04-22 06:57:19,987 INFO [Listener at localhost/43701] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41515 2024-04-22 06:57:20,006 WARN [Listener at localhost/40363] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-04-22 06:57:20,400 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xef9c91b5fc80b211: Processing first storage report for DS-97510530-e25f-427e-a86d-bb60050431da from datanode c7535ef9-18ba-46fb-b86c-81bbdf58de73 2024-04-22 06:57:20,402 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xef9c91b5fc80b211: from storage DS-97510530-e25f-427e-a86d-bb60050431da node DatanodeRegistration(127.0.0.1:42991, datanodeUuid=c7535ef9-18ba-46fb-b86c-81bbdf58de73, infoPort=34633, infoSecurePort=0, ipcPort=43701, storageInfo=lv=-57;cid=testClusterID;nsid=201315963;c=1713769038146), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2024-04-22 06:57:20,402 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xed8602fbfba788be: Processing first storage report for DS-87e4d4f4-1761-42a3-a75f-525d703fcf67 from datanode 931a37bd-a4c9-400a-aef0-39c8ad90d90a 2024-04-22 06:57:20,402 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xed8602fbfba788be: from storage DS-87e4d4f4-1761-42a3-a75f-525d703fcf67 node DatanodeRegistration(127.0.0.1:37321, datanodeUuid=931a37bd-a4c9-400a-aef0-39c8ad90d90a, infoPort=41451, infoSecurePort=0, ipcPort=40363, storageInfo=lv=-57;cid=testClusterID;nsid=201315963;c=1713769038146), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2024-04-22 06:57:20,402 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xef9c91b5fc80b211: Processing first storage report for DS-db5edd70-aa19-4afe-b721-92bcdf7f1c8e from datanode c7535ef9-18ba-46fb-b86c-81bbdf58de73 2024-04-22 06:57:20,402 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xef9c91b5fc80b211: from storage DS-db5edd70-aa19-4afe-b721-92bcdf7f1c8e node DatanodeRegistration(127.0.0.1:42991, datanodeUuid=c7535ef9-18ba-46fb-b86c-81bbdf58de73, infoPort=34633, infoSecurePort=0, ipcPort=43701, storageInfo=lv=-57;cid=testClusterID;nsid=201315963;c=1713769038146), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-04-22 06:57:20,403 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xed8602fbfba788be: Processing first storage report for DS-a88a7f30-86ad-4b12-b436-78dcab8886d0 from datanode 931a37bd-a4c9-400a-aef0-39c8ad90d90a 2024-04-22 06:57:20,403 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xed8602fbfba788be: from storage DS-a88a7f30-86ad-4b12-b436-78dcab8886d0 node DatanodeRegistration(127.0.0.1:37321, datanodeUuid=931a37bd-a4c9-400a-aef0-39c8ad90d90a, infoPort=41451, infoSecurePort=0, ipcPort=40363, storageInfo=lv=-57;cid=testClusterID;nsid=201315963;c=1713769038146), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-04-22 06:57:20,513 DEBUG [Listener at localhost/40363] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c 2024-04-22 06:57:20,632 INFO [Listener at localhost/40363] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/cluster_6184197d-533f-d0b3-d2d4-ec91c7d097d1/zookeeper_0, clientPort=56669, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/cluster_6184197d-533f-d0b3-d2d4-ec91c7d097d1/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/cluster_6184197d-533f-d0b3-d2d4-ec91c7d097d1/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2024-04-22 06:57:20,648 INFO [Listener at localhost/40363] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=56669 2024-04-22 06:57:20,656 INFO [Listener at localhost/40363] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-22 06:57:20,659 INFO [Listener at localhost/40363] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-22 06:57:21,363 INFO [Listener at localhost/40363] util.FSUtils(471): Created version file at hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e with version=8 2024-04-22 06:57:21,363 INFO [Listener at localhost/40363] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/hbase-staging 2024-04-22 06:57:21,720 INFO [Listener at localhost/40363] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2024-04-22 06:57:22,212 INFO [Listener at localhost/40363] client.ConnectionUtils(126): master/jenkins-hbase4:0 server-side Connection retries=45 2024-04-22 06:57:22,247 INFO [Listener at localhost/40363] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-04-22 06:57:22,248 INFO [Listener at localhost/40363] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-04-22 06:57:22,248 INFO [Listener at localhost/40363] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-04-22 06:57:22,248 INFO [Listener at localhost/40363] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-04-22 06:57:22,248 INFO [Listener at localhost/40363] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-04-22 06:57:22,401 INFO [Listener at localhost/40363] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2024-04-22 06:57:22,479 DEBUG [Listener at localhost/40363] util.ClassSize(228): Using Unsafe to estimate memory layout 2024-04-22 06:57:22,576 INFO [Listener at localhost/40363] ipc.NettyRpcServer(120): Bind to /172.31.14.131:46823 2024-04-22 06:57:22,586 INFO [Listener at localhost/40363] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-22 06:57:22,589 INFO [Listener at localhost/40363] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-22 06:57:22,611 INFO [Listener at localhost/40363] zookeeper.RecoverableZooKeeper(93): Process identifier=master:46823 connecting to ZooKeeper ensemble=127.0.0.1:56669 2024-04-22 06:57:22,656 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:468230x0, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-04-22 06:57:22,658 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:46823-0x10129f912600000 connected 2024-04-22 06:57:22,691 DEBUG [Listener at localhost/40363] zookeeper.ZKUtil(165): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-04-22 06:57:22,692 DEBUG [Listener at localhost/40363] zookeeper.ZKUtil(165): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-04-22 06:57:22,695 DEBUG [Listener at localhost/40363] zookeeper.ZKUtil(165): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-04-22 06:57:22,704 DEBUG [Listener at localhost/40363] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=46823 2024-04-22 06:57:22,704 DEBUG [Listener at localhost/40363] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=46823 2024-04-22 06:57:22,704 DEBUG [Listener at localhost/40363] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=46823 2024-04-22 06:57:22,705 DEBUG [Listener at localhost/40363] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=46823 2024-04-22 06:57:22,706 DEBUG [Listener at localhost/40363] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=46823 2024-04-22 06:57:22,712 INFO [Listener at localhost/40363] master.HMaster(445): hbase.rootdir=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e, hbase.cluster.distributed=false 2024-04-22 06:57:22,783 INFO [Listener at localhost/40363] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-04-22 06:57:22,783 INFO [Listener at localhost/40363] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-04-22 06:57:22,784 INFO [Listener at localhost/40363] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-04-22 06:57:22,784 INFO [Listener at localhost/40363] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-04-22 06:57:22,784 INFO [Listener at localhost/40363] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-04-22 06:57:22,784 INFO [Listener at localhost/40363] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-04-22 06:57:22,789 INFO [Listener at localhost/40363] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-04-22 06:57:22,792 INFO [Listener at localhost/40363] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41835 2024-04-22 06:57:22,794 INFO [Listener at localhost/40363] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-04-22 06:57:22,802 DEBUG [Listener at localhost/40363] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-04-22 06:57:22,803 INFO [Listener at localhost/40363] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-22 06:57:22,805 INFO [Listener at localhost/40363] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-22 06:57:22,807 INFO [Listener at localhost/40363] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:41835 connecting to ZooKeeper ensemble=127.0.0.1:56669 2024-04-22 06:57:22,811 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): regionserver:418350x0, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-04-22 06:57:22,812 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:41835-0x10129f912600001 connected 2024-04-22 06:57:22,813 DEBUG [Listener at localhost/40363] zookeeper.ZKUtil(165): regionserver:41835-0x10129f912600001, quorum=127.0.0.1:56669, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-04-22 06:57:22,814 DEBUG [Listener at localhost/40363] zookeeper.ZKUtil(165): regionserver:41835-0x10129f912600001, quorum=127.0.0.1:56669, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-04-22 06:57:22,815 DEBUG [Listener at localhost/40363] zookeeper.ZKUtil(165): regionserver:41835-0x10129f912600001, quorum=127.0.0.1:56669, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-04-22 06:57:22,816 DEBUG [Listener at localhost/40363] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41835 2024-04-22 06:57:22,816 DEBUG [Listener at localhost/40363] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41835 2024-04-22 06:57:22,817 DEBUG [Listener at localhost/40363] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41835 2024-04-22 06:57:22,818 DEBUG [Listener at localhost/40363] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41835 2024-04-22 06:57:22,818 DEBUG [Listener at localhost/40363] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41835 2024-04-22 06:57:22,832 INFO [Listener at localhost/40363] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-04-22 06:57:22,832 INFO [Listener at localhost/40363] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-04-22 06:57:22,832 INFO [Listener at localhost/40363] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-04-22 06:57:22,833 INFO [Listener at localhost/40363] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-04-22 06:57:22,833 INFO [Listener at localhost/40363] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-04-22 06:57:22,833 INFO [Listener at localhost/40363] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-04-22 06:57:22,833 INFO [Listener at localhost/40363] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-04-22 06:57:22,835 INFO [Listener at localhost/40363] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43163 2024-04-22 06:57:22,835 INFO [Listener at localhost/40363] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-04-22 06:57:22,836 DEBUG [Listener at localhost/40363] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-04-22 06:57:22,837 INFO [Listener at localhost/40363] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-22 06:57:22,839 INFO [Listener at localhost/40363] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-22 06:57:22,841 INFO [Listener at localhost/40363] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43163 connecting to ZooKeeper ensemble=127.0.0.1:56669 2024-04-22 06:57:22,845 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): regionserver:431630x0, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-04-22 06:57:22,846 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43163-0x10129f912600002 connected 2024-04-22 06:57:22,846 DEBUG [Listener at localhost/40363] zookeeper.ZKUtil(165): regionserver:43163-0x10129f912600002, quorum=127.0.0.1:56669, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-04-22 06:57:22,847 DEBUG [Listener at localhost/40363] zookeeper.ZKUtil(165): regionserver:43163-0x10129f912600002, quorum=127.0.0.1:56669, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-04-22 06:57:22,848 DEBUG [Listener at localhost/40363] zookeeper.ZKUtil(165): regionserver:43163-0x10129f912600002, quorum=127.0.0.1:56669, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-04-22 06:57:22,849 DEBUG [Listener at localhost/40363] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43163 2024-04-22 06:57:22,849 DEBUG [Listener at localhost/40363] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43163 2024-04-22 06:57:22,849 DEBUG [Listener at localhost/40363] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43163 2024-04-22 06:57:22,850 DEBUG [Listener at localhost/40363] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43163 2024-04-22 06:57:22,850 DEBUG [Listener at localhost/40363] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43163 2024-04-22 06:57:22,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2174): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,46823,1713769041522 2024-04-22 06:57:22,862 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-04-22 06:57:22,864 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,46823,1713769041522 2024-04-22 06:57:22,884 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): regionserver:43163-0x10129f912600002, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-04-22 06:57:22,884 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): regionserver:41835-0x10129f912600001, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-04-22 06:57:22,884 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-04-22 06:57:22,886 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-22 06:57:22,887 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-04-22 06:57:22,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,46823,1713769041522 from backup master directory 2024-04-22 06:57:22,888 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(163): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-04-22 06:57:22,892 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,46823,1713769041522 2024-04-22 06:57:22,892 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-04-22 06:57:22,893 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-04-22 06:57:22,893 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,46823,1713769041522 2024-04-22 06:57:22,896 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2024-04-22 06:57:22,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2024-04-22 06:57:23,001 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/hbase.id with ID: 2642a44e-ff87-418a-838f-5bfb4c13c7cd 2024-04-22 06:57:23,047 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-22 06:57:23,063 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-22 06:57:23,108 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x260b560d to 127.0.0.1:56669 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-04-22 06:57:23,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c0e7aa7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-04-22 06:57:23,170 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-04-22 06:57:23,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2024-04-22 06:57:23,190 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2024-04-22 06:57:23,190 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2024-04-22 06:57:23,192 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-04-22 06:57:23,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-04-22 06:57:23,197 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-04-22 06:57:23,232 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/MasterData/data/master/store-tmp 2024-04-22 06:57:23,265 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-22 06:57:23,265 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-04-22 06:57:23,266 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-22 06:57:23,266 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-22 06:57:23,266 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-04-22 06:57:23,266 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-22 06:57:23,266 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-22 06:57:23,266 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-04-22 06:57:23,268 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/MasterData/WALs/jenkins-hbase4.apache.org,46823,1713769041522 2024-04-22 06:57:23,288 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(492): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C46823%2C1713769041522, suffix=, logDir=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/MasterData/WALs/jenkins-hbase4.apache.org,46823,1713769041522, archiveDir=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/MasterData/oldWALs, maxLogs=10 2024-04-22 06:57:23,352 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42991,DS-97510530-e25f-427e-a86d-bb60050431da,DISK] 2024-04-22 06:57:23,352 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37321,DS-87e4d4f4-1761-42a3-a75f-525d703fcf67,DISK] 2024-04-22 06:57:23,361 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2024-04-22 06:57:23,431 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(809): New WAL /user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/MasterData/WALs/jenkins-hbase4.apache.org,46823,1713769041522/jenkins-hbase4.apache.org%2C46823%2C1713769041522.1713769043298 2024-04-22 06:57:23,431 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(890): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37321,DS-87e4d4f4-1761-42a3-a75f-525d703fcf67,DISK], DatanodeInfoWithStorage[127.0.0.1:42991,DS-97510530-e25f-427e-a86d-bb60050431da,DISK]] 2024-04-22 06:57:23,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2024-04-22 06:57:23,432 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-22 06:57:23,436 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2024-04-22 06:57:23,437 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2024-04-22 06:57:23,495 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2024-04-22 06:57:23,504 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2024-04-22 06:57:23,530 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2024-04-22 06:57:23,542 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-22 06:57:23,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-04-22 06:57:23,550 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-04-22 06:57:23,565 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2024-04-22 06:57:23,569 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-22 06:57:23,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63653537, jitterRate=-0.05148838460445404}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-04-22 06:57:23,570 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2024-04-22 06:57:23,572 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2024-04-22 06:57:23,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2024-04-22 06:57:23,591 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(608): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2024-04-22 06:57:23,594 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2024-04-22 06:57:23,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(628): Recovered RegionProcedureStore lease in 1 msec 2024-04-22 06:57:23,631 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(642): Loaded RegionProcedureStore in 34 msec 2024-04-22 06:57:23,631 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2024-04-22 06:57:23,658 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2024-04-22 06:57:23,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2024-04-22 06:57:23,695 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2024-04-22 06:57:23,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2024-04-22 06:57:23,702 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2024-04-22 06:57:23,709 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2024-04-22 06:57:23,713 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2024-04-22 06:57:23,717 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-22 06:57:23,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2024-04-22 06:57:23,719 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2024-04-22 06:57:23,732 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2024-04-22 06:57:23,737 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): regionserver:43163-0x10129f912600002, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-04-22 06:57:23,737 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-04-22 06:57:23,737 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-22 06:57:23,737 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): regionserver:41835-0x10129f912600001, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-04-22 06:57:23,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(745): Active/primary master=jenkins-hbase4.apache.org,46823,1713769041522, sessionid=0x10129f912600000, setting cluster-up flag (Was=false) 2024-04-22 06:57:23,757 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-22 06:57:23,764 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2024-04-22 06:57:23,766 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46823,1713769041522 2024-04-22 06:57:23,771 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-22 06:57:23,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2024-04-22 06:57:23,780 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,46823,1713769041522 2024-04-22 06:57:23,783 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.hbase-snapshot/.tmp 2024-04-22 06:57:23,827 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver loaded, priority=536870911. 2024-04-22 06:57:23,854 INFO [RS:1;jenkins-hbase4:43163] regionserver.HRegionServer(957): ClusterId : 2642a44e-ff87-418a-838f-5bfb4c13c7cd 2024-04-22 06:57:23,854 INFO [RS:0;jenkins-hbase4:41835] regionserver.HRegionServer(957): ClusterId : 2642a44e-ff87-418a-838f-5bfb4c13c7cd 2024-04-22 06:57:23,861 DEBUG [RS:0;jenkins-hbase4:41835] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-04-22 06:57:23,861 DEBUG [RS:1;jenkins-hbase4:43163] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-04-22 06:57:23,868 DEBUG [RS:1;jenkins-hbase4:43163] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-04-22 06:57:23,868 DEBUG [RS:0;jenkins-hbase4:41835] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-04-22 06:57:23,868 DEBUG [RS:1;jenkins-hbase4:43163] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-04-22 06:57:23,868 DEBUG [RS:0;jenkins-hbase4:41835] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-04-22 06:57:23,872 DEBUG [RS:1;jenkins-hbase4:43163] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-04-22 06:57:23,872 DEBUG [RS:0;jenkins-hbase4:41835] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-04-22 06:57:23,875 DEBUG [RS:1;jenkins-hbase4:43163] zookeeper.ReadOnlyZKClient(139): Connect 0x101d1cf6 to 127.0.0.1:56669 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-04-22 06:57:23,875 DEBUG [RS:0;jenkins-hbase4:41835] zookeeper.ReadOnlyZKClient(139): Connect 0x220b8dcc to 127.0.0.1:56669 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-04-22 06:57:23,885 DEBUG [RS:1;jenkins-hbase4:43163] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1edaf085, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-04-22 06:57:23,886 DEBUG [RS:1;jenkins-hbase4:43163] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ae57786, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-04-22 06:57:23,886 DEBUG [RS:0;jenkins-hbase4:41835] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ccc67fd, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-04-22 06:57:23,886 DEBUG [RS:0;jenkins-hbase4:41835] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@28f3e6bc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-04-22 06:57:23,909 DEBUG [RS:0;jenkins-hbase4:41835] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:41835 2024-04-22 06:57:23,910 DEBUG [RS:1;jenkins-hbase4:43163] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43163 2024-04-22 06:57:23,914 INFO [RS:0;jenkins-hbase4:41835] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-04-22 06:57:23,914 INFO [RS:1;jenkins-hbase4:43163] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-04-22 06:57:23,915 INFO [RS:0;jenkins-hbase4:41835] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-04-22 06:57:23,915 INFO [RS:1;jenkins-hbase4:43163] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-04-22 06:57:23,915 DEBUG [RS:0;jenkins-hbase4:41835] regionserver.HRegionServer(1028): About to register with Master. 2024-04-22 06:57:23,915 DEBUG [RS:1;jenkins-hbase4:43163] regionserver.HRegionServer(1028): About to register with Master. 2024-04-22 06:57:23,918 INFO [RS:0;jenkins-hbase4:41835] regionserver.HRegionServer(2820): reportForDuty to master=jenkins-hbase4.apache.org,46823,1713769041522 with isa=jenkins-hbase4.apache.org/172.31.14.131:41835, startcode=1713769042782 2024-04-22 06:57:23,918 INFO [RS:1;jenkins-hbase4:43163] regionserver.HRegionServer(2820): reportForDuty to master=jenkins-hbase4.apache.org,46823,1713769041522 with isa=jenkins-hbase4.apache.org/172.31.14.131:43163, startcode=1713769042831 2024-04-22 06:57:23,921 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2024-04-22 06:57:23,932 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-04-22 06:57:23,932 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-04-22 06:57:23,932 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-04-22 06:57:23,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-04-22 06:57:23,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2024-04-22 06:57:23,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-22 06:57:23,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-04-22 06:57:23,933 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-22 06:57:23,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1713769073935 2024-04-22 06:57:23,936 DEBUG [RS:0;jenkins-hbase4:41835] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-04-22 06:57:23,936 DEBUG [RS:1;jenkins-hbase4:43163] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-04-22 06:57:23,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2024-04-22 06:57:23,941 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2024-04-22 06:57:23,942 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2024-04-22 06:57:23,947 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-04-22 06:57:23,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2024-04-22 06:57:23,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2024-04-22 06:57:23,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2024-04-22 06:57:23,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2024-04-22 06:57:23,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2024-04-22 06:57:23,959 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:23,960 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2024-04-22 06:57:23,962 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2024-04-22 06:57:23,962 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2024-04-22 06:57:23,964 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2024-04-22 06:57:23,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2024-04-22 06:57:23,968 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1713769043968,5,FailOnTimeoutGroup] 2024-04-22 06:57:23,968 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1713769043968,5,FailOnTimeoutGroup] 2024-04-22 06:57:23,968 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:23,969 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1466): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2024-04-22 06:57:23,970 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:23,971 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:23,994 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-04-22 06:57:23,996 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-04-22 06:57:23,996 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e 2024-04-22 06:57:24,006 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58237, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2024-04-22 06:57:24,006 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:50789, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2024-04-22 06:57:24,019 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-22 06:57:24,022 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-04-22 06:57:24,024 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46823] master.ServerManager(404): Registering regionserver=jenkins-hbase4.apache.org,43163,1713769042831 2024-04-22 06:57:24,025 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/meta/1588230740/info 2024-04-22 06:57:24,026 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-04-22 06:57:24,027 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-22 06:57:24,027 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-04-22 06:57:24,030 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/meta/1588230740/rep_barrier 2024-04-22 06:57:24,030 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-04-22 06:57:24,031 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-22 06:57:24,031 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-04-22 06:57:24,033 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/meta/1588230740/table 2024-04-22 06:57:24,034 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-04-22 06:57:24,035 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-22 06:57:24,037 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/meta/1588230740 2024-04-22 06:57:24,037 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=46823] master.ServerManager(404): Registering regionserver=jenkins-hbase4.apache.org,41835,1713769042782 2024-04-22 06:57:24,038 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/meta/1588230740 2024-04-22 06:57:24,043 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-04-22 06:57:24,043 DEBUG [RS:1;jenkins-hbase4:43163] regionserver.HRegionServer(1601): Config from master: hbase.rootdir=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e 2024-04-22 06:57:24,043 DEBUG [RS:0;jenkins-hbase4:41835] regionserver.HRegionServer(1601): Config from master: hbase.rootdir=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e 2024-04-22 06:57:24,044 DEBUG [RS:1;jenkins-hbase4:43163] regionserver.HRegionServer(1601): Config from master: fs.defaultFS=hdfs://localhost:38355 2024-04-22 06:57:24,044 DEBUG [RS:0;jenkins-hbase4:41835] regionserver.HRegionServer(1601): Config from master: fs.defaultFS=hdfs://localhost:38355 2024-04-22 06:57:24,044 DEBUG [RS:0;jenkins-hbase4:41835] regionserver.HRegionServer(1601): Config from master: hbase.master.info.port=-1 2024-04-22 06:57:24,044 DEBUG [RS:1;jenkins-hbase4:43163] regionserver.HRegionServer(1601): Config from master: hbase.master.info.port=-1 2024-04-22 06:57:24,046 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2024-04-22 06:57:24,051 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-22 06:57:24,053 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68898760, jitterRate=0.026671528816223145}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-04-22 06:57:24,053 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2024-04-22 06:57:24,053 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-04-22 06:57:24,053 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-04-22 06:57:24,053 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-04-22 06:57:24,053 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-04-22 06:57:24,053 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-04-22 06:57:24,054 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-04-22 06:57:24,054 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-04-22 06:57:24,055 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-04-22 06:57:24,055 DEBUG [RS:0;jenkins-hbase4:41835] zookeeper.ZKUtil(163): regionserver:41835-0x10129f912600001, quorum=127.0.0.1:56669, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41835,1713769042782 2024-04-22 06:57:24,055 DEBUG [RS:1;jenkins-hbase4:43163] zookeeper.ZKUtil(163): regionserver:43163-0x10129f912600002, quorum=127.0.0.1:56669, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43163,1713769042831 2024-04-22 06:57:24,055 WARN [RS:0;jenkins-hbase4:41835] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-04-22 06:57:24,055 WARN [RS:1;jenkins-hbase4:43163] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-04-22 06:57:24,056 INFO [RS:0;jenkins-hbase4:41835] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-04-22 06:57:24,056 INFO [RS:1;jenkins-hbase4:43163] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-04-22 06:57:24,056 DEBUG [RS:0;jenkins-hbase4:41835] regionserver.HRegionServer(1953): logDir=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/WALs/jenkins-hbase4.apache.org,41835,1713769042782 2024-04-22 06:57:24,056 DEBUG [RS:1;jenkins-hbase4:43163] regionserver.HRegionServer(1953): logDir=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/WALs/jenkins-hbase4.apache.org,43163,1713769042831 2024-04-22 06:57:24,057 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43163,1713769042831] 2024-04-22 06:57:24,057 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,41835,1713769042782] 2024-04-22 06:57:24,064 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2024-04-22 06:57:24,064 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2024-04-22 06:57:24,068 DEBUG [RS:1;jenkins-hbase4:43163] zookeeper.ZKUtil(163): regionserver:43163-0x10129f912600002, quorum=127.0.0.1:56669, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43163,1713769042831 2024-04-22 06:57:24,068 DEBUG [RS:0;jenkins-hbase4:41835] zookeeper.ZKUtil(163): regionserver:41835-0x10129f912600001, quorum=127.0.0.1:56669, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43163,1713769042831 2024-04-22 06:57:24,069 DEBUG [RS:1;jenkins-hbase4:43163] zookeeper.ZKUtil(163): regionserver:43163-0x10129f912600002, quorum=127.0.0.1:56669, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41835,1713769042782 2024-04-22 06:57:24,069 DEBUG [RS:0;jenkins-hbase4:41835] zookeeper.ZKUtil(163): regionserver:41835-0x10129f912600001, quorum=127.0.0.1:56669, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,41835,1713769042782 2024-04-22 06:57:24,075 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2024-04-22 06:57:24,080 DEBUG [RS:0;jenkins-hbase4:41835] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-04-22 06:57:24,080 DEBUG [RS:1;jenkins-hbase4:43163] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-04-22 06:57:24,087 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2024-04-22 06:57:24,090 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2024-04-22 06:57:24,090 INFO [RS:0;jenkins-hbase4:41835] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-04-22 06:57:24,090 INFO [RS:1;jenkins-hbase4:43163] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-04-22 06:57:24,109 INFO [RS:1;jenkins-hbase4:43163] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-04-22 06:57:24,109 INFO [RS:0;jenkins-hbase4:41835] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-04-22 06:57:24,113 INFO [RS:1;jenkins-hbase4:43163] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-04-22 06:57:24,113 INFO [RS:0;jenkins-hbase4:41835] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-04-22 06:57:24,113 INFO [RS:1;jenkins-hbase4:43163] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:24,113 INFO [RS:0;jenkins-hbase4:41835] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:24,115 INFO [RS:1;jenkins-hbase4:43163] regionserver.HRegionServer$CompactionChecker(1843): CompactionChecker runs every PT1S 2024-04-22 06:57:24,115 INFO [RS:0;jenkins-hbase4:41835] regionserver.HRegionServer$CompactionChecker(1843): CompactionChecker runs every PT1S 2024-04-22 06:57:24,123 INFO [RS:0;jenkins-hbase4:41835] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:24,123 INFO [RS:1;jenkins-hbase4:43163] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:24,123 DEBUG [RS:0;jenkins-hbase4:41835] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-22 06:57:24,123 DEBUG [RS:1;jenkins-hbase4:43163] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-22 06:57:24,123 DEBUG [RS:0;jenkins-hbase4:41835] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-22 06:57:24,123 DEBUG [RS:1;jenkins-hbase4:43163] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-22 06:57:24,123 DEBUG [RS:0;jenkins-hbase4:41835] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-22 06:57:24,123 DEBUG [RS:1;jenkins-hbase4:43163] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-22 06:57:24,124 DEBUG [RS:0;jenkins-hbase4:41835] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-22 06:57:24,124 DEBUG [RS:1;jenkins-hbase4:43163] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-22 06:57:24,124 DEBUG [RS:0;jenkins-hbase4:41835] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-22 06:57:24,124 DEBUG [RS:1;jenkins-hbase4:43163] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-22 06:57:24,124 DEBUG [RS:0;jenkins-hbase4:41835] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-04-22 06:57:24,124 DEBUG [RS:1;jenkins-hbase4:43163] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-04-22 06:57:24,124 DEBUG [RS:0;jenkins-hbase4:41835] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-22 06:57:24,124 DEBUG [RS:1;jenkins-hbase4:43163] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-22 06:57:24,124 DEBUG [RS:0;jenkins-hbase4:41835] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-22 06:57:24,124 DEBUG [RS:1;jenkins-hbase4:43163] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-22 06:57:24,124 DEBUG [RS:0;jenkins-hbase4:41835] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-22 06:57:24,124 DEBUG [RS:1;jenkins-hbase4:43163] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-22 06:57:24,124 DEBUG [RS:0;jenkins-hbase4:41835] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-22 06:57:24,124 DEBUG [RS:1;jenkins-hbase4:43163] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-22 06:57:24,126 INFO [RS:0;jenkins-hbase4:41835] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:24,126 INFO [RS:1;jenkins-hbase4:43163] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:24,126 INFO [RS:0;jenkins-hbase4:41835] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:24,126 INFO [RS:1;jenkins-hbase4:43163] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:24,126 INFO [RS:0;jenkins-hbase4:41835] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:24,126 INFO [RS:1;jenkins-hbase4:43163] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:24,126 INFO [RS:0;jenkins-hbase4:41835] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:24,126 INFO [RS:1;jenkins-hbase4:43163] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:24,149 INFO [RS:1;jenkins-hbase4:43163] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-04-22 06:57:24,149 INFO [RS:0;jenkins-hbase4:41835] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-04-22 06:57:24,152 INFO [RS:0;jenkins-hbase4:41835] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41835,1713769042782-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:24,152 INFO [RS:1;jenkins-hbase4:43163] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43163,1713769042831-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:24,177 INFO [RS:1;jenkins-hbase4:43163] regionserver.Replication(203): jenkins-hbase4.apache.org,43163,1713769042831 started 2024-04-22 06:57:24,177 INFO [RS:0;jenkins-hbase4:41835] regionserver.Replication(203): jenkins-hbase4.apache.org,41835,1713769042782 started 2024-04-22 06:57:24,177 INFO [RS:1;jenkins-hbase4:43163] regionserver.HRegionServer(1643): Serving as jenkins-hbase4.apache.org,43163,1713769042831, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43163, sessionid=0x10129f912600002 2024-04-22 06:57:24,177 INFO [RS:0;jenkins-hbase4:41835] regionserver.HRegionServer(1643): Serving as jenkins-hbase4.apache.org,41835,1713769042782, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:41835, sessionid=0x10129f912600001 2024-04-22 06:57:24,178 DEBUG [RS:0;jenkins-hbase4:41835] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-04-22 06:57:24,178 DEBUG [RS:1;jenkins-hbase4:43163] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-04-22 06:57:24,178 DEBUG [RS:0;jenkins-hbase4:41835] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,41835,1713769042782 2024-04-22 06:57:24,178 DEBUG [RS:1;jenkins-hbase4:43163] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43163,1713769042831 2024-04-22 06:57:24,178 DEBUG [RS:0;jenkins-hbase4:41835] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41835,1713769042782' 2024-04-22 06:57:24,179 DEBUG [RS:1;jenkins-hbase4:43163] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43163,1713769042831' 2024-04-22 06:57:24,179 DEBUG [RS:0;jenkins-hbase4:41835] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-04-22 06:57:24,179 DEBUG [RS:1;jenkins-hbase4:43163] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-04-22 06:57:24,180 DEBUG [RS:0;jenkins-hbase4:41835] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-04-22 06:57:24,180 DEBUG [RS:1;jenkins-hbase4:43163] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-04-22 06:57:24,181 DEBUG [RS:0;jenkins-hbase4:41835] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-04-22 06:57:24,181 DEBUG [RS:0;jenkins-hbase4:41835] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-04-22 06:57:24,181 DEBUG [RS:1;jenkins-hbase4:43163] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-04-22 06:57:24,181 DEBUG [RS:0;jenkins-hbase4:41835] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,41835,1713769042782 2024-04-22 06:57:24,181 DEBUG [RS:1;jenkins-hbase4:43163] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-04-22 06:57:24,181 DEBUG [RS:0;jenkins-hbase4:41835] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,41835,1713769042782' 2024-04-22 06:57:24,182 DEBUG [RS:0;jenkins-hbase4:41835] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-04-22 06:57:24,181 DEBUG [RS:1;jenkins-hbase4:43163] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43163,1713769042831 2024-04-22 06:57:24,182 DEBUG [RS:1;jenkins-hbase4:43163] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43163,1713769042831' 2024-04-22 06:57:24,182 DEBUG [RS:1;jenkins-hbase4:43163] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-04-22 06:57:24,183 DEBUG [RS:0;jenkins-hbase4:41835] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-04-22 06:57:24,183 DEBUG [RS:1;jenkins-hbase4:43163] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-04-22 06:57:24,183 DEBUG [RS:0;jenkins-hbase4:41835] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-04-22 06:57:24,183 INFO [RS:0;jenkins-hbase4:41835] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-04-22 06:57:24,184 DEBUG [RS:1;jenkins-hbase4:43163] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-04-22 06:57:24,184 INFO [RS:1;jenkins-hbase4:43163] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-04-22 06:57:24,185 INFO [RS:0;jenkins-hbase4:41835] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:24,185 INFO [RS:1;jenkins-hbase4:43163] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:24,186 DEBUG [RS:0;jenkins-hbase4:41835] zookeeper.ZKUtil(399): regionserver:41835-0x10129f912600001, quorum=127.0.0.1:56669, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-04-22 06:57:24,186 INFO [RS:0;jenkins-hbase4:41835] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-04-22 06:57:24,186 DEBUG [RS:1;jenkins-hbase4:43163] zookeeper.ZKUtil(399): regionserver:43163-0x10129f912600002, quorum=127.0.0.1:56669, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-04-22 06:57:24,187 INFO [RS:1;jenkins-hbase4:43163] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-04-22 06:57:24,187 INFO [RS:0;jenkins-hbase4:41835] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:24,187 INFO [RS:1;jenkins-hbase4:43163] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:24,187 INFO [RS:1;jenkins-hbase4:43163] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:24,187 INFO [RS:0;jenkins-hbase4:41835] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:24,242 DEBUG [jenkins-hbase4:46823] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=2, allServersCount=2 2024-04-22 06:57:24,245 DEBUG [jenkins-hbase4:46823] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-04-22 06:57:24,252 DEBUG [jenkins-hbase4:46823] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-04-22 06:57:24,252 DEBUG [jenkins-hbase4:46823] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-04-22 06:57:24,252 DEBUG [jenkins-hbase4:46823] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-04-22 06:57:24,255 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41835,1713769042782, state=OPENING 2024-04-22 06:57:24,262 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2024-04-22 06:57:24,264 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-22 06:57:24,265 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-04-22 06:57:24,268 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41835,1713769042782}] 2024-04-22 06:57:24,299 INFO [RS:1;jenkins-hbase4:43163] wal.AbstractFSWAL(492): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43163%2C1713769042831, suffix=, logDir=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/WALs/jenkins-hbase4.apache.org,43163,1713769042831, archiveDir=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/oldWALs, maxLogs=32 2024-04-22 06:57:24,299 INFO [RS:0;jenkins-hbase4:41835] wal.AbstractFSWAL(492): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41835%2C1713769042782, suffix=, logDir=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/WALs/jenkins-hbase4.apache.org,41835,1713769042782, archiveDir=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/oldWALs, maxLogs=32 2024-04-22 06:57:24,322 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42991,DS-97510530-e25f-427e-a86d-bb60050431da,DISK] 2024-04-22 06:57:24,322 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37321,DS-87e4d4f4-1761-42a3-a75f-525d703fcf67,DISK] 2024-04-22 06:57:24,324 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42991,DS-97510530-e25f-427e-a86d-bb60050431da,DISK] 2024-04-22 06:57:24,325 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37321,DS-87e4d4f4-1761-42a3-a75f-525d703fcf67,DISK] 2024-04-22 06:57:24,332 INFO [RS:0;jenkins-hbase4:41835] wal.AbstractFSWAL(809): New WAL /user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/WALs/jenkins-hbase4.apache.org,41835,1713769042782/jenkins-hbase4.apache.org%2C41835%2C1713769042782.1713769044303 2024-04-22 06:57:24,332 DEBUG [RS:0;jenkins-hbase4:41835] wal.AbstractFSWAL(890): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:42991,DS-97510530-e25f-427e-a86d-bb60050431da,DISK], DatanodeInfoWithStorage[127.0.0.1:37321,DS-87e4d4f4-1761-42a3-a75f-525d703fcf67,DISK]] 2024-04-22 06:57:24,374 INFO [RS:1;jenkins-hbase4:43163] wal.AbstractFSWAL(809): New WAL /user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/WALs/jenkins-hbase4.apache.org,43163,1713769042831/jenkins-hbase4.apache.org%2C43163%2C1713769042831.1713769044303 2024-04-22 06:57:24,374 DEBUG [RS:1;jenkins-hbase4:43163] wal.AbstractFSWAL(890): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37321,DS-87e4d4f4-1761-42a3-a75f-525d703fcf67,DISK], DatanodeInfoWithStorage[127.0.0.1:42991,DS-97510530-e25f-427e-a86d-bb60050431da,DISK]] 2024-04-22 06:57:24,455 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,41835,1713769042782 2024-04-22 06:57:24,457 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-04-22 06:57:24,460 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36248, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-04-22 06:57:24,474 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2024-04-22 06:57:24,474 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-04-22 06:57:24,480 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(492): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41835%2C1713769042782.meta, suffix=.meta, logDir=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/WALs/jenkins-hbase4.apache.org,41835,1713769042782, archiveDir=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/oldWALs, maxLogs=32 2024-04-22 06:57:24,501 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:37321,DS-87e4d4f4-1761-42a3-a75f-525d703fcf67,DISK] 2024-04-22 06:57:24,502 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:42991,DS-97510530-e25f-427e-a86d-bb60050431da,DISK] 2024-04-22 06:57:24,509 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(809): New WAL /user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/WALs/jenkins-hbase4.apache.org,41835,1713769042782/jenkins-hbase4.apache.org%2C41835%2C1713769042782.meta.1713769044482.meta 2024-04-22 06:57:24,510 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(890): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:37321,DS-87e4d4f4-1761-42a3-a75f-525d703fcf67,DISK], DatanodeInfoWithStorage[127.0.0.1:42991,DS-97510530-e25f-427e-a86d-bb60050431da,DISK]] 2024-04-22 06:57:24,510 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2024-04-22 06:57:24,512 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2024-04-22 06:57:24,530 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2024-04-22 06:57:24,534 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2024-04-22 06:57:24,540 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2024-04-22 06:57:24,540 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-22 06:57:24,540 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2024-04-22 06:57:24,540 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2024-04-22 06:57:24,544 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-04-22 06:57:24,546 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/meta/1588230740/info 2024-04-22 06:57:24,546 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/meta/1588230740/info 2024-04-22 06:57:24,546 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-04-22 06:57:24,547 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-22 06:57:24,547 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-04-22 06:57:24,549 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/meta/1588230740/rep_barrier 2024-04-22 06:57:24,549 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/meta/1588230740/rep_barrier 2024-04-22 06:57:24,550 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-04-22 06:57:24,551 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-22 06:57:24,551 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-04-22 06:57:24,553 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/meta/1588230740/table 2024-04-22 06:57:24,553 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/meta/1588230740/table 2024-04-22 06:57:24,553 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-04-22 06:57:24,554 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-22 06:57:24,556 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/meta/1588230740 2024-04-22 06:57:24,560 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/meta/1588230740 2024-04-22 06:57:24,564 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-04-22 06:57:24,566 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2024-04-22 06:57:24,568 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66944236, jitterRate=-0.002453148365020752}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-04-22 06:57:24,568 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2024-04-22 06:57:24,583 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2345): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1713769044446 2024-04-22 06:57:24,605 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2372): Finished post open deploy task for hbase:meta,,1.1588230740 2024-04-22 06:57:24,606 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2024-04-22 06:57:24,607 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,41835,1713769042782, state=OPEN 2024-04-22 06:57:24,610 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2024-04-22 06:57:24,610 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-04-22 06:57:24,615 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=3, resume processing ppid=2 2024-04-22 06:57:24,615 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,41835,1713769042782 in 342 msec 2024-04-22 06:57:24,621 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=2, resume processing ppid=1 2024-04-22 06:57:24,621 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 541 msec 2024-04-22 06:57:24,627 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 792 msec 2024-04-22 06:57:24,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(954): Wait for region servers to report in: status=null, state=RUNNING, startTime=1713769044627, completionTime=-1 2024-04-22 06:57:24,627 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(824): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2024-04-22 06:57:24,628 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2024-04-22 06:57:24,696 DEBUG [hconnection-0x111b004d-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-04-22 06:57:24,699 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36260, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-04-22 06:57:24,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=2 2024-04-22 06:57:24,716 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1713769104716 2024-04-22 06:57:24,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1713769164717 2024-04-22 06:57:24,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 89 msec 2024-04-22 06:57:24,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46823,1713769041522-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:24,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46823,1713769041522-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:24,741 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46823,1713769041522-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:24,743 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:46823, period=300000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:24,743 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:24,750 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2024-04-22 06:57:24,759 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2024-04-22 06:57:24,760 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-04-22 06:57:24,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2024-04-22 06:57:24,773 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2024-04-22 06:57:24,775 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-04-22 06:57:24,799 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/hbase/namespace/4cd3ca96be98ad75577cdc42f7218a5f 2024-04-22 06:57:24,801 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/hbase/namespace/4cd3ca96be98ad75577cdc42f7218a5f empty. 2024-04-22 06:57:24,802 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/hbase/namespace/4cd3ca96be98ad75577cdc42f7218a5f 2024-04-22 06:57:24,802 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2024-04-22 06:57:24,832 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2024-04-22 06:57:24,834 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4cd3ca96be98ad75577cdc42f7218a5f, NAME => 'hbase:namespace,,1713769044759.4cd3ca96be98ad75577cdc42f7218a5f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp 2024-04-22 06:57:24,850 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1713769044759.4cd3ca96be98ad75577cdc42f7218a5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-22 06:57:24,850 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 4cd3ca96be98ad75577cdc42f7218a5f, disabling compactions & flushes 2024-04-22 06:57:24,850 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1713769044759.4cd3ca96be98ad75577cdc42f7218a5f. 2024-04-22 06:57:24,850 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1713769044759.4cd3ca96be98ad75577cdc42f7218a5f. 2024-04-22 06:57:24,850 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1713769044759.4cd3ca96be98ad75577cdc42f7218a5f. after waiting 0 ms 2024-04-22 06:57:24,850 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1713769044759.4cd3ca96be98ad75577cdc42f7218a5f. 2024-04-22 06:57:24,851 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1713769044759.4cd3ca96be98ad75577cdc42f7218a5f. 2024-04-22 06:57:24,851 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 4cd3ca96be98ad75577cdc42f7218a5f: 2024-04-22 06:57:24,856 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2024-04-22 06:57:24,871 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1713769044759.4cd3ca96be98ad75577cdc42f7218a5f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1713769044859"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713769044859"}]},"ts":"1713769044859"} 2024-04-22 06:57:24,900 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-04-22 06:57:24,902 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-04-22 06:57:24,907 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713769044903"}]},"ts":"1713769044903"} 2024-04-22 06:57:24,913 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2024-04-22 06:57:24,918 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-04-22 06:57:24,920 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-04-22 06:57:24,920 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-04-22 06:57:24,920 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-04-22 06:57:24,923 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4cd3ca96be98ad75577cdc42f7218a5f, ASSIGN}] 2024-04-22 06:57:24,925 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=4cd3ca96be98ad75577cdc42f7218a5f, ASSIGN 2024-04-22 06:57:24,928 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=4cd3ca96be98ad75577cdc42f7218a5f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41835,1713769042782; forceNewPlan=false, retain=false 2024-04-22 06:57:25,081 INFO [jenkins-hbase4:46823] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-04-22 06:57:25,082 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4cd3ca96be98ad75577cdc42f7218a5f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41835,1713769042782 2024-04-22 06:57:25,082 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1713769044759.4cd3ca96be98ad75577cdc42f7218a5f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1713769045081"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713769045081"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713769045081"}]},"ts":"1713769045081"} 2024-04-22 06:57:25,087 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 4cd3ca96be98ad75577cdc42f7218a5f, server=jenkins-hbase4.apache.org,41835,1713769042782}] 2024-04-22 06:57:25,242 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,41835,1713769042782 2024-04-22 06:57:25,249 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1713769044759.4cd3ca96be98ad75577cdc42f7218a5f. 2024-04-22 06:57:25,250 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4cd3ca96be98ad75577cdc42f7218a5f, NAME => 'hbase:namespace,,1713769044759.4cd3ca96be98ad75577cdc42f7218a5f.', STARTKEY => '', ENDKEY => ''} 2024-04-22 06:57:25,251 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 4cd3ca96be98ad75577cdc42f7218a5f 2024-04-22 06:57:25,251 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1713769044759.4cd3ca96be98ad75577cdc42f7218a5f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-22 06:57:25,251 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4cd3ca96be98ad75577cdc42f7218a5f 2024-04-22 06:57:25,251 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4cd3ca96be98ad75577cdc42f7218a5f 2024-04-22 06:57:25,254 INFO [StoreOpener-4cd3ca96be98ad75577cdc42f7218a5f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 4cd3ca96be98ad75577cdc42f7218a5f 2024-04-22 06:57:25,257 DEBUG [StoreOpener-4cd3ca96be98ad75577cdc42f7218a5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/namespace/4cd3ca96be98ad75577cdc42f7218a5f/info 2024-04-22 06:57:25,257 DEBUG [StoreOpener-4cd3ca96be98ad75577cdc42f7218a5f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/namespace/4cd3ca96be98ad75577cdc42f7218a5f/info 2024-04-22 06:57:25,258 INFO [StoreOpener-4cd3ca96be98ad75577cdc42f7218a5f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4cd3ca96be98ad75577cdc42f7218a5f columnFamilyName info 2024-04-22 06:57:25,259 INFO [StoreOpener-4cd3ca96be98ad75577cdc42f7218a5f-1] regionserver.HStore(310): Store=4cd3ca96be98ad75577cdc42f7218a5f/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-22 06:57:25,262 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/namespace/4cd3ca96be98ad75577cdc42f7218a5f 2024-04-22 06:57:25,263 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/namespace/4cd3ca96be98ad75577cdc42f7218a5f 2024-04-22 06:57:25,268 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4cd3ca96be98ad75577cdc42f7218a5f 2024-04-22 06:57:25,272 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/namespace/4cd3ca96be98ad75577cdc42f7218a5f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-22 06:57:25,273 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4cd3ca96be98ad75577cdc42f7218a5f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62490213, jitterRate=-0.06882326304912567}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-04-22 06:57:25,273 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4cd3ca96be98ad75577cdc42f7218a5f: 2024-04-22 06:57:25,275 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2345): Post open deploy tasks for hbase:namespace,,1713769044759.4cd3ca96be98ad75577cdc42f7218a5f., pid=6, masterSystemTime=1713769045242 2024-04-22 06:57:25,280 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2372): Finished post open deploy task for hbase:namespace,,1713769044759.4cd3ca96be98ad75577cdc42f7218a5f. 2024-04-22 06:57:25,280 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1713769044759.4cd3ca96be98ad75577cdc42f7218a5f. 2024-04-22 06:57:25,282 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=4cd3ca96be98ad75577cdc42f7218a5f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41835,1713769042782 2024-04-22 06:57:25,282 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1713769044759.4cd3ca96be98ad75577cdc42f7218a5f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1713769045281"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1713769045281"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1713769045281"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1713769045281"}]},"ts":"1713769045281"} 2024-04-22 06:57:25,290 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=6, resume processing ppid=5 2024-04-22 06:57:25,292 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 4cd3ca96be98ad75577cdc42f7218a5f, server=jenkins-hbase4.apache.org,41835,1713769042782 in 199 msec 2024-04-22 06:57:25,295 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=5, resume processing ppid=4 2024-04-22 06:57:25,295 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=4cd3ca96be98ad75577cdc42f7218a5f, ASSIGN in 368 msec 2024-04-22 06:57:25,298 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-04-22 06:57:25,299 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713769045298"}]},"ts":"1713769045298"} 2024-04-22 06:57:25,302 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2024-04-22 06:57:25,307 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2024-04-22 06:57:25,310 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 546 msec 2024-04-22 06:57:25,373 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2024-04-22 06:57:25,375 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2024-04-22 06:57:25,375 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-22 06:57:25,414 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2024-04-22 06:57:25,433 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-04-22 06:57:25,441 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 33 msec 2024-04-22 06:57:25,447 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2024-04-22 06:57:25,460 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-04-22 06:57:25,466 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2024-04-22 06:57:25,474 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2024-04-22 06:57:25,478 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2024-04-22 06:57:25,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1084): Master has completed initialization 2.587sec 2024-04-22 06:57:25,483 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(103): Quota table not found. Creating... 2024-04-22 06:57:25,483 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-04-22 06:57:25,486 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:quota 2024-04-22 06:57:25,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(107): Initializing quota support 2024-04-22 06:57:25,489 INFO [PEWorker-4] procedure.CreateTableProcedure(82): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_PRE_OPERATION 2024-04-22 06:57:25,490 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(59): Namespace State Manager started. 2024-04-22 06:57:25,491 INFO [PEWorker-4] procedure.CreateTableProcedure(82): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-04-22 06:57:25,495 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/hbase/quota/018780bee830aae71606868a2bdf615c 2024-04-22 06:57:25,496 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/hbase/quota/018780bee830aae71606868a2bdf615c empty. 2024-04-22 06:57:25,499 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/hbase/quota/018780bee830aae71606868a2bdf615c 2024-04-22 06:57:25,499 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:quota regions 2024-04-22 06:57:25,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(222): Finished updating state of 2 namespaces. 2024-04-22 06:57:25,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceAuditor(50): NamespaceAuditor started. 2024-04-22 06:57:25,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:25,504 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=300000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:25,506 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2024-04-22 06:57:25,506 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2024-04-22 06:57:25,508 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46823,1713769041522-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2024-04-22 06:57:25,509 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46823,1713769041522-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2024-04-22 06:57:25,528 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1176): Balancer post startup initialization complete, took 0 seconds 2024-04-22 06:57:25,529 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,46823,1713769041522-OldWALsDirSizeChore, period=300000, unit=MILLISECONDS is enabled. 2024-04-22 06:57:25,538 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/hbase/quota/.tabledesc/.tableinfo.0000000001 2024-04-22 06:57:25,543 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(7675): creating {ENCODED => 018780bee830aae71606868a2bdf615c, NAME => 'hbase:quota,,1713769045483.018780bee830aae71606868a2bdf615c.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp 2024-04-22 06:57:25,565 DEBUG [Listener at localhost/40363] zookeeper.ReadOnlyZKClient(139): Connect 0x2921a0a0 to 127.0.0.1:56669 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-04-22 06:57:25,584 DEBUG [Listener at localhost/40363] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@578c3464, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-04-22 06:57:25,585 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(866): Instantiated hbase:quota,,1713769045483.018780bee830aae71606868a2bdf615c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-22 06:57:25,585 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1604): Closing 018780bee830aae71606868a2bdf615c, disabling compactions & flushes 2024-04-22 06:57:25,585 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1626): Closing region hbase:quota,,1713769045483.018780bee830aae71606868a2bdf615c. 2024-04-22 06:57:25,585 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1713769045483.018780bee830aae71606868a2bdf615c. 2024-04-22 06:57:25,585 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1713769045483.018780bee830aae71606868a2bdf615c. after waiting 0 ms 2024-04-22 06:57:25,585 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1713769045483.018780bee830aae71606868a2bdf615c. 2024-04-22 06:57:25,585 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1838): Closed hbase:quota,,1713769045483.018780bee830aae71606868a2bdf615c. 2024-04-22 06:57:25,586 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1558): Region close journal for 018780bee830aae71606868a2bdf615c: 2024-04-22 06:57:25,592 INFO [PEWorker-4] procedure.CreateTableProcedure(82): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ADD_TO_META 2024-04-22 06:57:25,594 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:quota,,1713769045483.018780bee830aae71606868a2bdf615c.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1713769045594"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713769045594"}]},"ts":"1713769045594"} 2024-04-22 06:57:25,598 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-04-22 06:57:25,602 INFO [PEWorker-4] procedure.CreateTableProcedure(82): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-04-22 06:57:25,602 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713769045602"}]},"ts":"1713769045602"} 2024-04-22 06:57:25,604 DEBUG [hconnection-0x778f033e-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-04-22 06:57:25,606 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLING in hbase:meta 2024-04-22 06:57:25,612 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-04-22 06:57:25,614 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-04-22 06:57:25,614 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-04-22 06:57:25,614 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-04-22 06:57:25,614 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=018780bee830aae71606868a2bdf615c, ASSIGN}] 2024-04-22 06:57:25,619 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=018780bee830aae71606868a2bdf615c, ASSIGN 2024-04-22 06:57:25,619 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59810, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-04-22 06:57:25,621 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:quota, region=018780bee830aae71606868a2bdf615c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41835,1713769042782; forceNewPlan=false, retain=false 2024-04-22 06:57:25,631 INFO [Listener at localhost/40363] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,46823,1713769041522 2024-04-22 06:57:25,633 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:57:25,637 DEBUG [Listener at localhost/40363] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-04-22 06:57:25,740 DEBUG [Listener at localhost/40363] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-04-22 06:57:25,772 INFO [jenkins-hbase4:46823] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-04-22 06:57:25,773 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=018780bee830aae71606868a2bdf615c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41835,1713769042782 2024-04-22 06:57:25,773 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:quota,,1713769045483.018780bee830aae71606868a2bdf615c.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1713769045773"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713769045773"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713769045773"}]},"ts":"1713769045773"} 2024-04-22 06:57:25,777 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 018780bee830aae71606868a2bdf615c, server=jenkins-hbase4.apache.org,41835,1713769042782}] 2024-04-22 06:57:25,843 DEBUG [Listener at localhost/40363] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-04-22 06:57:25,931 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,41835,1713769042782 2024-04-22 06:57:25,938 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:quota,,1713769045483.018780bee830aae71606868a2bdf615c. 2024-04-22 06:57:25,939 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 018780bee830aae71606868a2bdf615c, NAME => 'hbase:quota,,1713769045483.018780bee830aae71606868a2bdf615c.', STARTKEY => '', ENDKEY => ''} 2024-04-22 06:57:25,939 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table quota 018780bee830aae71606868a2bdf615c 2024-04-22 06:57:25,939 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:quota,,1713769045483.018780bee830aae71606868a2bdf615c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-22 06:57:25,939 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 018780bee830aae71606868a2bdf615c 2024-04-22 06:57:25,940 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 018780bee830aae71606868a2bdf615c 2024-04-22 06:57:25,942 INFO [StoreOpener-018780bee830aae71606868a2bdf615c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family q of region 018780bee830aae71606868a2bdf615c 2024-04-22 06:57:25,945 DEBUG [StoreOpener-018780bee830aae71606868a2bdf615c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/quota/018780bee830aae71606868a2bdf615c/q 2024-04-22 06:57:25,945 DEBUG [StoreOpener-018780bee830aae71606868a2bdf615c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/quota/018780bee830aae71606868a2bdf615c/q 2024-04-22 06:57:25,945 DEBUG [Listener at localhost/40363] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-04-22 06:57:25,946 INFO [StoreOpener-018780bee830aae71606868a2bdf615c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 018780bee830aae71606868a2bdf615c columnFamilyName q 2024-04-22 06:57:25,947 INFO [StoreOpener-018780bee830aae71606868a2bdf615c-1] regionserver.HStore(310): Store=018780bee830aae71606868a2bdf615c/q, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-22 06:57:25,947 INFO [StoreOpener-018780bee830aae71606868a2bdf615c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family u of region 018780bee830aae71606868a2bdf615c 2024-04-22 06:57:25,949 DEBUG [StoreOpener-018780bee830aae71606868a2bdf615c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/quota/018780bee830aae71606868a2bdf615c/u 2024-04-22 06:57:25,949 DEBUG [StoreOpener-018780bee830aae71606868a2bdf615c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/quota/018780bee830aae71606868a2bdf615c/u 2024-04-22 06:57:25,950 INFO [StoreOpener-018780bee830aae71606868a2bdf615c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 018780bee830aae71606868a2bdf615c columnFamilyName u 2024-04-22 06:57:25,951 INFO [StoreOpener-018780bee830aae71606868a2bdf615c-1] regionserver.HStore(310): Store=018780bee830aae71606868a2bdf615c/u, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-22 06:57:25,953 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/quota/018780bee830aae71606868a2bdf615c 2024-04-22 06:57:25,955 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/quota/018780bee830aae71606868a2bdf615c 2024-04-22 06:57:25,959 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:quota descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2024-04-22 06:57:25,961 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 018780bee830aae71606868a2bdf615c 2024-04-22 06:57:25,965 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/quota/018780bee830aae71606868a2bdf615c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-22 06:57:25,966 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 018780bee830aae71606868a2bdf615c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62067916, jitterRate=-0.07511597871780396}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2024-04-22 06:57:25,967 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 018780bee830aae71606868a2bdf615c: 2024-04-22 06:57:25,968 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2345): Post open deploy tasks for hbase:quota,,1713769045483.018780bee830aae71606868a2bdf615c., pid=11, masterSystemTime=1713769045931 2024-04-22 06:57:25,972 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2372): Finished post open deploy task for hbase:quota,,1713769045483.018780bee830aae71606868a2bdf615c. 2024-04-22 06:57:25,972 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:quota,,1713769045483.018780bee830aae71606868a2bdf615c. 2024-04-22 06:57:25,973 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=018780bee830aae71606868a2bdf615c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41835,1713769042782 2024-04-22 06:57:25,973 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:quota,,1713769045483.018780bee830aae71606868a2bdf615c.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1713769045973"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1713769045973"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1713769045973"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1713769045973"}]},"ts":"1713769045973"} 2024-04-22 06:57:25,980 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=11, resume processing ppid=10 2024-04-22 06:57:25,981 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 018780bee830aae71606868a2bdf615c, server=jenkins-hbase4.apache.org,41835,1713769042782 in 199 msec 2024-04-22 06:57:25,984 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=10, resume processing ppid=9 2024-04-22 06:57:25,984 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:quota, region=018780bee830aae71606868a2bdf615c, ASSIGN in 366 msec 2024-04-22 06:57:25,985 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-04-22 06:57:25,985 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713769045985"}]},"ts":"1713769045985"} 2024-04-22 06:57:25,988 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLED in hbase:meta 2024-04-22 06:57:25,992 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_POST_OPERATION 2024-04-22 06:57:25,994 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:quota in 509 msec 2024-04-22 06:57:26,060 DEBUG [Listener at localhost/40363] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-04-22 06:57:26,064 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52148, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2024-04-22 06:57:26,099 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-04-22 06:57:26,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1075): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin0 2024-04-22 06:57:26,106 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_PRE_OPERATION 2024-04-22 06:57:26,108 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-04-22 06:57:26,112 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin0" procId is: 12 2024-04-22 06:57:26,114 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/default/TestQuotaAdmin0/c6d73e069db2b6227e7fc911b7686443 2024-04-22 06:57:26,117 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/default/TestQuotaAdmin0/c6d73e069db2b6227e7fc911b7686443 empty. 2024-04-22 06:57:26,118 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/default/TestQuotaAdmin0/c6d73e069db2b6227e7fc911b7686443 2024-04-22 06:57:26,118 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-04-22 06:57:26,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-04-22 06:57:26,155 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/default/TestQuotaAdmin0/.tabledesc/.tableinfo.0000000001 2024-04-22 06:57:26,158 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(7675): creating {ENCODED => c6d73e069db2b6227e7fc911b7686443, NAME => 'TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp 2024-04-22 06:57:26,190 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-22 06:57:26,190 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1604): Closing c6d73e069db2b6227e7fc911b7686443, disabling compactions & flushes 2024-04-22 06:57:26,190 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443. 2024-04-22 06:57:26,190 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443. 2024-04-22 06:57:26,190 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443. after waiting 0 ms 2024-04-22 06:57:26,190 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443. 2024-04-22 06:57:26,190 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443. 2024-04-22 06:57:26,190 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1558): Region close journal for c6d73e069db2b6227e7fc911b7686443: 2024-04-22 06:57:26,196 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ADD_TO_META 2024-04-22 06:57:26,198 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713769046198"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713769046198"}]},"ts":"1713769046198"} 2024-04-22 06:57:26,201 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-04-22 06:57:26,204 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-04-22 06:57:26,204 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713769046204"}]},"ts":"1713769046204"} 2024-04-22 06:57:26,207 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLING in hbase:meta 2024-04-22 06:57:26,213 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-04-22 06:57:26,215 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-04-22 06:57:26,215 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-04-22 06:57:26,215 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-04-22 06:57:26,215 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=c6d73e069db2b6227e7fc911b7686443, ASSIGN}] 2024-04-22 06:57:26,218 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=c6d73e069db2b6227e7fc911b7686443, ASSIGN 2024-04-22 06:57:26,220 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin0, region=c6d73e069db2b6227e7fc911b7686443, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43163,1713769042831; forceNewPlan=false, retain=false 2024-04-22 06:57:26,371 INFO [jenkins-hbase4:46823] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-04-22 06:57:26,372 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=c6d73e069db2b6227e7fc911b7686443, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43163,1713769042831 2024-04-22 06:57:26,372 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713769046372"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713769046372"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713769046372"}]},"ts":"1713769046372"} 2024-04-22 06:57:26,375 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; OpenRegionProcedure c6d73e069db2b6227e7fc911b7686443, server=jenkins-hbase4.apache.org,43163,1713769042831}] 2024-04-22 06:57:26,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-04-22 06:57:26,529 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,43163,1713769042831 2024-04-22 06:57:26,530 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-04-22 06:57:26,533 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45926, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-04-22 06:57:26,540 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443. 2024-04-22 06:57:26,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c6d73e069db2b6227e7fc911b7686443, NAME => 'TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443.', STARTKEY => '', ENDKEY => ''} 2024-04-22 06:57:26,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin0 c6d73e069db2b6227e7fc911b7686443 2024-04-22 06:57:26,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-22 06:57:26,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c6d73e069db2b6227e7fc911b7686443 2024-04-22 06:57:26,541 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c6d73e069db2b6227e7fc911b7686443 2024-04-22 06:57:26,543 INFO [StoreOpener-c6d73e069db2b6227e7fc911b7686443-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region c6d73e069db2b6227e7fc911b7686443 2024-04-22 06:57:26,545 DEBUG [StoreOpener-c6d73e069db2b6227e7fc911b7686443-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/default/TestQuotaAdmin0/c6d73e069db2b6227e7fc911b7686443/cf 2024-04-22 06:57:26,545 DEBUG [StoreOpener-c6d73e069db2b6227e7fc911b7686443-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/default/TestQuotaAdmin0/c6d73e069db2b6227e7fc911b7686443/cf 2024-04-22 06:57:26,546 INFO [StoreOpener-c6d73e069db2b6227e7fc911b7686443-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c6d73e069db2b6227e7fc911b7686443 columnFamilyName cf 2024-04-22 06:57:26,547 INFO [StoreOpener-c6d73e069db2b6227e7fc911b7686443-1] regionserver.HStore(310): Store=c6d73e069db2b6227e7fc911b7686443/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-22 06:57:26,548 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/default/TestQuotaAdmin0/c6d73e069db2b6227e7fc911b7686443 2024-04-22 06:57:26,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/default/TestQuotaAdmin0/c6d73e069db2b6227e7fc911b7686443 2024-04-22 06:57:26,554 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c6d73e069db2b6227e7fc911b7686443 2024-04-22 06:57:26,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/default/TestQuotaAdmin0/c6d73e069db2b6227e7fc911b7686443/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-22 06:57:26,559 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c6d73e069db2b6227e7fc911b7686443; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68060595, jitterRate=0.014181897044181824}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-04-22 06:57:26,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c6d73e069db2b6227e7fc911b7686443: 2024-04-22 06:57:26,560 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2345): Post open deploy tasks for TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443., pid=14, masterSystemTime=1713769046529 2024-04-22 06:57:26,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2372): Finished post open deploy task for TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443. 2024-04-22 06:57:26,564 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443. 2024-04-22 06:57:26,565 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=c6d73e069db2b6227e7fc911b7686443, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43163,1713769042831 2024-04-22 06:57:26,565 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713769046565"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1713769046565"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1713769046565"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1713769046565"}]},"ts":"1713769046565"} 2024-04-22 06:57:26,572 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=14, resume processing ppid=13 2024-04-22 06:57:26,572 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=14, ppid=13, state=SUCCESS; OpenRegionProcedure c6d73e069db2b6227e7fc911b7686443, server=jenkins-hbase4.apache.org,43163,1713769042831 in 193 msec 2024-04-22 06:57:26,575 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=13, resume processing ppid=12 2024-04-22 06:57:26,576 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=c6d73e069db2b6227e7fc911b7686443, ASSIGN in 357 msec 2024-04-22 06:57:26,577 INFO [PEWorker-5] procedure.CreateTableProcedure(82): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-04-22 06:57:26,577 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713769046577"}]},"ts":"1713769046577"} 2024-04-22 06:57:26,580 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLED in hbase:meta 2024-04-22 06:57:26,584 INFO [PEWorker-5] procedure.CreateTableProcedure(82): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_POST_OPERATION 2024-04-22 06:57:26,587 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=12, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin0 in 484 msec 2024-04-22 06:57:26,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-04-22 06:57:26,882 INFO [Listener at localhost/40363] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin0, procId: 12 completed 2024-04-22 06:57:26,882 DEBUG [Listener at localhost/40363] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin0 get assigned. Timeout = 60000ms 2024-04-22 06:57:26,883 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:57:26,888 INFO [Listener at localhost/40363] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin0 assigned to meta. Checking AM states. 2024-04-22 06:57:26,888 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:57:26,889 INFO [Listener at localhost/40363] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin0 assigned. 2024-04-22 06:57:26,889 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:57:26,899 DEBUG [hconnection-0x778f033e-shared-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-04-22 06:57:26,903 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45938, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-04-22 06:57:26,908 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-04-22 06:57:26,910 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52152, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=MasterService 2024-04-22 06:57:26,911 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-04-22 06:57:26,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1075): Stored pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin1 2024-04-22 06:57:26,916 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_PRE_OPERATION 2024-04-22 06:57:26,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin1" procId is: 15 2024-04-22 06:57:26,918 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=15, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-04-22 06:57:26,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-04-22 06:57:26,921 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/default/TestQuotaAdmin1/4de96e5ccfebd759d7a5eb735f57e289 2024-04-22 06:57:26,922 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/default/TestQuotaAdmin1/4de96e5ccfebd759d7a5eb735f57e289 empty. 2024-04-22 06:57:26,923 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/default/TestQuotaAdmin1/4de96e5ccfebd759d7a5eb735f57e289 2024-04-22 06:57:26,923 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-04-22 06:57:26,948 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/default/TestQuotaAdmin1/.tabledesc/.tableinfo.0000000001 2024-04-22 06:57:26,950 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 4de96e5ccfebd759d7a5eb735f57e289, NAME => 'TestQuotaAdmin1,,1713769046911.4de96e5ccfebd759d7a5eb735f57e289.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp 2024-04-22 06:57:26,958 DEBUG [hconnection-0xc17002f-metaLookup-shared--pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-04-22 06:57:26,961 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59824, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2024-04-22 06:57:26,968 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1713769046911.4de96e5ccfebd759d7a5eb735f57e289.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-22 06:57:26,969 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1604): Closing 4de96e5ccfebd759d7a5eb735f57e289, disabling compactions & flushes 2024-04-22 06:57:26,969 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1713769046911.4de96e5ccfebd759d7a5eb735f57e289. 2024-04-22 06:57:26,969 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1713769046911.4de96e5ccfebd759d7a5eb735f57e289. 2024-04-22 06:57:26,969 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1713769046911.4de96e5ccfebd759d7a5eb735f57e289. after waiting 0 ms 2024-04-22 06:57:26,969 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1713769046911.4de96e5ccfebd759d7a5eb735f57e289. 2024-04-22 06:57:26,969 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1713769046911.4de96e5ccfebd759d7a5eb735f57e289. 2024-04-22 06:57:26,969 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1558): Region close journal for 4de96e5ccfebd759d7a5eb735f57e289: 2024-04-22 06:57:26,975 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=15, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ADD_TO_META 2024-04-22 06:57:26,977 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1713769046911.4de96e5ccfebd759d7a5eb735f57e289.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713769046977"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713769046977"}]},"ts":"1713769046977"} 2024-04-22 06:57:26,979 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-04-22 06:57:26,981 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=15, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-04-22 06:57:26,981 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713769046981"}]},"ts":"1713769046981"} 2024-04-22 06:57:26,983 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLING in hbase:meta 2024-04-22 06:57:26,988 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-04-22 06:57:26,989 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-04-22 06:57:26,990 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-04-22 06:57:26,990 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-04-22 06:57:26,990 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=4de96e5ccfebd759d7a5eb735f57e289, ASSIGN}] 2024-04-22 06:57:26,992 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=4de96e5ccfebd759d7a5eb735f57e289, ASSIGN 2024-04-22 06:57:26,993 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin1, region=4de96e5ccfebd759d7a5eb735f57e289, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43163,1713769042831; forceNewPlan=false, retain=false 2024-04-22 06:57:27,143 INFO [jenkins-hbase4:46823] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-04-22 06:57:27,144 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=4de96e5ccfebd759d7a5eb735f57e289, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43163,1713769042831 2024-04-22 06:57:27,144 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1713769046911.4de96e5ccfebd759d7a5eb735f57e289.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713769047144"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713769047144"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713769047144"}]},"ts":"1713769047144"} 2024-04-22 06:57:27,147 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure 4de96e5ccfebd759d7a5eb735f57e289, server=jenkins-hbase4.apache.org,43163,1713769042831}] 2024-04-22 06:57:27,171 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-04-22 06:57:27,300 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,43163,1713769042831 2024-04-22 06:57:27,307 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin1,,1713769046911.4de96e5ccfebd759d7a5eb735f57e289. 2024-04-22 06:57:27,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 4de96e5ccfebd759d7a5eb735f57e289, NAME => 'TestQuotaAdmin1,,1713769046911.4de96e5ccfebd759d7a5eb735f57e289.', STARTKEY => '', ENDKEY => ''} 2024-04-22 06:57:27,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin1 4de96e5ccfebd759d7a5eb735f57e289 2024-04-22 06:57:27,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1713769046911.4de96e5ccfebd759d7a5eb735f57e289.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-22 06:57:27,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 4de96e5ccfebd759d7a5eb735f57e289 2024-04-22 06:57:27,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 4de96e5ccfebd759d7a5eb735f57e289 2024-04-22 06:57:27,310 INFO [StoreOpener-4de96e5ccfebd759d7a5eb735f57e289-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 4de96e5ccfebd759d7a5eb735f57e289 2024-04-22 06:57:27,312 DEBUG [StoreOpener-4de96e5ccfebd759d7a5eb735f57e289-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/default/TestQuotaAdmin1/4de96e5ccfebd759d7a5eb735f57e289/cf 2024-04-22 06:57:27,312 DEBUG [StoreOpener-4de96e5ccfebd759d7a5eb735f57e289-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/default/TestQuotaAdmin1/4de96e5ccfebd759d7a5eb735f57e289/cf 2024-04-22 06:57:27,313 INFO [StoreOpener-4de96e5ccfebd759d7a5eb735f57e289-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 4de96e5ccfebd759d7a5eb735f57e289 columnFamilyName cf 2024-04-22 06:57:27,314 INFO [StoreOpener-4de96e5ccfebd759d7a5eb735f57e289-1] regionserver.HStore(310): Store=4de96e5ccfebd759d7a5eb735f57e289/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-22 06:57:27,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/default/TestQuotaAdmin1/4de96e5ccfebd759d7a5eb735f57e289 2024-04-22 06:57:27,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/default/TestQuotaAdmin1/4de96e5ccfebd759d7a5eb735f57e289 2024-04-22 06:57:27,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 4de96e5ccfebd759d7a5eb735f57e289 2024-04-22 06:57:27,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/default/TestQuotaAdmin1/4de96e5ccfebd759d7a5eb735f57e289/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-22 06:57:27,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 4de96e5ccfebd759d7a5eb735f57e289; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75390865, jitterRate=0.12341143190860748}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-04-22 06:57:27,328 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 4de96e5ccfebd759d7a5eb735f57e289: 2024-04-22 06:57:27,329 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2345): Post open deploy tasks for TestQuotaAdmin1,,1713769046911.4de96e5ccfebd759d7a5eb735f57e289., pid=17, masterSystemTime=1713769047300 2024-04-22 06:57:27,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2372): Finished post open deploy task for TestQuotaAdmin1,,1713769046911.4de96e5ccfebd759d7a5eb735f57e289. 2024-04-22 06:57:27,332 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin1,,1713769046911.4de96e5ccfebd759d7a5eb735f57e289. 2024-04-22 06:57:27,333 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=4de96e5ccfebd759d7a5eb735f57e289, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43163,1713769042831 2024-04-22 06:57:27,334 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin1,,1713769046911.4de96e5ccfebd759d7a5eb735f57e289.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713769047333"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1713769047333"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1713769047333"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1713769047333"}]},"ts":"1713769047333"} 2024-04-22 06:57:27,340 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=17, resume processing ppid=16 2024-04-22 06:57:27,341 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure 4de96e5ccfebd759d7a5eb735f57e289, server=jenkins-hbase4.apache.org,43163,1713769042831 in 189 msec 2024-04-22 06:57:27,343 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=16, resume processing ppid=15 2024-04-22 06:57:27,345 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=4de96e5ccfebd759d7a5eb735f57e289, ASSIGN in 350 msec 2024-04-22 06:57:27,346 INFO [PEWorker-4] procedure.CreateTableProcedure(82): pid=15, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-04-22 06:57:27,346 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713769047346"}]},"ts":"1713769047346"} 2024-04-22 06:57:27,349 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLED in hbase:meta 2024-04-22 06:57:27,352 INFO [PEWorker-4] procedure.CreateTableProcedure(82): pid=15, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_POST_OPERATION 2024-04-22 06:57:27,355 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=15, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin1 in 441 msec 2024-04-22 06:57:27,674 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-04-22 06:57:27,674 INFO [Listener at localhost/40363] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin1, procId: 15 completed 2024-04-22 06:57:27,674 DEBUG [Listener at localhost/40363] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin1 get assigned. Timeout = 60000ms 2024-04-22 06:57:27,674 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:57:27,678 INFO [Listener at localhost/40363] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin1 assigned to meta. Checking AM states. 2024-04-22 06:57:27,678 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:57:27,678 INFO [Listener at localhost/40363] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin1 assigned. 2024-04-22 06:57:27,678 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:57:27,691 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-04-22 06:57:27,693 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1075): Stored pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin2 2024-04-22 06:57:27,695 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_PRE_OPERATION 2024-04-22 06:57:27,695 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin2" procId is: 18 2024-04-22 06:57:27,697 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=18, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-04-22 06:57:27,697 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-04-22 06:57:27,700 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/default/TestQuotaAdmin2/d28f954b31070c84a412ba4a62e1909e 2024-04-22 06:57:27,701 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/default/TestQuotaAdmin2/d28f954b31070c84a412ba4a62e1909e empty. 2024-04-22 06:57:27,701 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/default/TestQuotaAdmin2/d28f954b31070c84a412ba4a62e1909e 2024-04-22 06:57:27,701 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-04-22 06:57:27,724 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/default/TestQuotaAdmin2/.tabledesc/.tableinfo.0000000001 2024-04-22 06:57:27,725 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(7675): creating {ENCODED => d28f954b31070c84a412ba4a62e1909e, NAME => 'TestQuotaAdmin2,,1713769047690.d28f954b31070c84a412ba4a62e1909e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp 2024-04-22 06:57:27,742 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1713769047690.d28f954b31070c84a412ba4a62e1909e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-22 06:57:27,742 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1604): Closing d28f954b31070c84a412ba4a62e1909e, disabling compactions & flushes 2024-04-22 06:57:27,742 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1713769047690.d28f954b31070c84a412ba4a62e1909e. 2024-04-22 06:57:27,742 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1713769047690.d28f954b31070c84a412ba4a62e1909e. 2024-04-22 06:57:27,742 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1713769047690.d28f954b31070c84a412ba4a62e1909e. after waiting 0 ms 2024-04-22 06:57:27,742 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1713769047690.d28f954b31070c84a412ba4a62e1909e. 2024-04-22 06:57:27,742 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1713769047690.d28f954b31070c84a412ba4a62e1909e. 2024-04-22 06:57:27,742 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1558): Region close journal for d28f954b31070c84a412ba4a62e1909e: 2024-04-22 06:57:27,747 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=18, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ADD_TO_META 2024-04-22 06:57:27,749 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1713769047690.d28f954b31070c84a412ba4a62e1909e.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713769047749"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713769047749"}]},"ts":"1713769047749"} 2024-04-22 06:57:27,752 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-04-22 06:57:27,753 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=18, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-04-22 06:57:27,754 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713769047753"}]},"ts":"1713769047753"} 2024-04-22 06:57:27,756 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLING in hbase:meta 2024-04-22 06:57:27,762 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-04-22 06:57:27,763 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-04-22 06:57:27,763 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-04-22 06:57:27,763 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-04-22 06:57:27,764 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=d28f954b31070c84a412ba4a62e1909e, ASSIGN}] 2024-04-22 06:57:27,765 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=d28f954b31070c84a412ba4a62e1909e, ASSIGN 2024-04-22 06:57:27,767 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin2, region=d28f954b31070c84a412ba4a62e1909e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41835,1713769042782; forceNewPlan=false, retain=false 2024-04-22 06:57:27,917 INFO [jenkins-hbase4:46823] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-04-22 06:57:27,918 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=d28f954b31070c84a412ba4a62e1909e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41835,1713769042782 2024-04-22 06:57:27,918 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1713769047690.d28f954b31070c84a412ba4a62e1909e.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713769047918"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713769047918"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713769047918"}]},"ts":"1713769047918"} 2024-04-22 06:57:27,922 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE; OpenRegionProcedure d28f954b31070c84a412ba4a62e1909e, server=jenkins-hbase4.apache.org,41835,1713769042782}] 2024-04-22 06:57:27,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-04-22 06:57:28,075 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,41835,1713769042782 2024-04-22 06:57:28,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin2,,1713769047690.d28f954b31070c84a412ba4a62e1909e. 2024-04-22 06:57:28,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d28f954b31070c84a412ba4a62e1909e, NAME => 'TestQuotaAdmin2,,1713769047690.d28f954b31070c84a412ba4a62e1909e.', STARTKEY => '', ENDKEY => ''} 2024-04-22 06:57:28,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin2 d28f954b31070c84a412ba4a62e1909e 2024-04-22 06:57:28,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1713769047690.d28f954b31070c84a412ba4a62e1909e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-22 06:57:28,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d28f954b31070c84a412ba4a62e1909e 2024-04-22 06:57:28,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d28f954b31070c84a412ba4a62e1909e 2024-04-22 06:57:28,084 INFO [StoreOpener-d28f954b31070c84a412ba4a62e1909e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d28f954b31070c84a412ba4a62e1909e 2024-04-22 06:57:28,087 DEBUG [StoreOpener-d28f954b31070c84a412ba4a62e1909e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/default/TestQuotaAdmin2/d28f954b31070c84a412ba4a62e1909e/cf 2024-04-22 06:57:28,087 DEBUG [StoreOpener-d28f954b31070c84a412ba4a62e1909e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/default/TestQuotaAdmin2/d28f954b31070c84a412ba4a62e1909e/cf 2024-04-22 06:57:28,088 INFO [StoreOpener-d28f954b31070c84a412ba4a62e1909e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d28f954b31070c84a412ba4a62e1909e columnFamilyName cf 2024-04-22 06:57:28,088 INFO [StoreOpener-d28f954b31070c84a412ba4a62e1909e-1] regionserver.HStore(310): Store=d28f954b31070c84a412ba4a62e1909e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-22 06:57:28,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/default/TestQuotaAdmin2/d28f954b31070c84a412ba4a62e1909e 2024-04-22 06:57:28,092 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/default/TestQuotaAdmin2/d28f954b31070c84a412ba4a62e1909e 2024-04-22 06:57:28,097 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d28f954b31070c84a412ba4a62e1909e 2024-04-22 06:57:28,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/default/TestQuotaAdmin2/d28f954b31070c84a412ba4a62e1909e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-22 06:57:28,102 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d28f954b31070c84a412ba4a62e1909e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62315127, jitterRate=-0.07143224775791168}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-04-22 06:57:28,102 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d28f954b31070c84a412ba4a62e1909e: 2024-04-22 06:57:28,103 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2345): Post open deploy tasks for TestQuotaAdmin2,,1713769047690.d28f954b31070c84a412ba4a62e1909e., pid=20, masterSystemTime=1713769048075 2024-04-22 06:57:28,106 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2372): Finished post open deploy task for TestQuotaAdmin2,,1713769047690.d28f954b31070c84a412ba4a62e1909e. 2024-04-22 06:57:28,106 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin2,,1713769047690.d28f954b31070c84a412ba4a62e1909e. 2024-04-22 06:57:28,107 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=d28f954b31070c84a412ba4a62e1909e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41835,1713769042782 2024-04-22 06:57:28,107 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin2,,1713769047690.d28f954b31070c84a412ba4a62e1909e.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713769048107"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1713769048107"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1713769048107"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1713769048107"}]},"ts":"1713769048107"} 2024-04-22 06:57:28,114 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=20, resume processing ppid=19 2024-04-22 06:57:28,114 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=20, ppid=19, state=SUCCESS; OpenRegionProcedure d28f954b31070c84a412ba4a62e1909e, server=jenkins-hbase4.apache.org,41835,1713769042782 in 188 msec 2024-04-22 06:57:28,117 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=19, resume processing ppid=18 2024-04-22 06:57:28,118 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=19, ppid=18, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=d28f954b31070c84a412ba4a62e1909e, ASSIGN in 351 msec 2024-04-22 06:57:28,119 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=18, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-04-22 06:57:28,120 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713769048119"}]},"ts":"1713769048119"} 2024-04-22 06:57:28,122 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLED in hbase:meta 2024-04-22 06:57:28,126 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=18, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_POST_OPERATION 2024-04-22 06:57:28,128 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=18, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin2 in 435 msec 2024-04-22 06:57:28,452 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-04-22 06:57:28,452 INFO [Listener at localhost/40363] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin2, procId: 18 completed 2024-04-22 06:57:28,453 DEBUG [Listener at localhost/40363] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin2 get assigned. Timeout = 60000ms 2024-04-22 06:57:28,453 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:57:28,457 INFO [Listener at localhost/40363] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin2 assigned to meta. Checking AM states. 2024-04-22 06:57:28,457 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:57:28,457 INFO [Listener at localhost/40363] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin2 assigned. 2024-04-22 06:57:28,457 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:57:28,468 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-04-22 06:57:28,472 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52154, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService 2024-04-22 06:57:28,477 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$15(3020): Client=jenkins//172.31.14.131 creating {NAME => 'TestNs'} 2024-04-22 06:57:28,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1075): Stored pid=21, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=TestNs 2024-04-22 06:57:28,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-04-22 06:57:28,498 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-04-22 06:57:28,505 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=21, state=SUCCESS; CreateNamespaceProcedure, namespace=TestNs in 24 msec 2024-04-22 06:57:28,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-04-22 06:57:28,743 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-04-22 06:57:28,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1075): Stored pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestNs:TestTable 2024-04-22 06:57:28,747 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_PRE_OPERATION 2024-04-22 06:57:28,748 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "TestNs" qualifier: "TestTable" procId is: 22 2024-04-22 06:57:28,749 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=22, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-04-22 06:57:28,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-04-22 06:57:28,753 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/TestNs/TestTable/849a1b60a71b5d3ecd3f1929cc1d4c66 2024-04-22 06:57:28,753 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/TestNs/TestTable/f34bedc38eed6db7727bae6d7a55585c 2024-04-22 06:57:28,753 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/TestNs/TestTable/849a1b60a71b5d3ecd3f1929cc1d4c66 empty. 2024-04-22 06:57:28,754 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/TestNs/TestTable/f34bedc38eed6db7727bae6d7a55585c empty. 2024-04-22 06:57:28,754 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/TestNs/TestTable/849a1b60a71b5d3ecd3f1929cc1d4c66 2024-04-22 06:57:28,754 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/TestNs/TestTable/f34bedc38eed6db7727bae6d7a55585c 2024-04-22 06:57:28,754 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-04-22 06:57:28,774 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/TestNs/TestTable/.tabledesc/.tableinfo.0000000001 2024-04-22 06:57:28,775 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(7675): creating {ENCODED => 849a1b60a71b5d3ecd3f1929cc1d4c66, NAME => 'TestNs:TestTable,,1713769048743.849a1b60a71b5d3ecd3f1929cc1d4c66.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp 2024-04-22 06:57:28,776 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(7675): creating {ENCODED => f34bedc38eed6db7727bae6d7a55585c, NAME => 'TestNs:TestTable,1,1713769048743.f34bedc38eed6db7727bae6d7a55585c.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp 2024-04-22 06:57:28,795 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1713769048743.f34bedc38eed6db7727bae6d7a55585c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-22 06:57:28,795 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1604): Closing f34bedc38eed6db7727bae6d7a55585c, disabling compactions & flushes 2024-04-22 06:57:28,795 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1713769048743.f34bedc38eed6db7727bae6d7a55585c. 2024-04-22 06:57:28,795 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1713769048743.f34bedc38eed6db7727bae6d7a55585c. 2024-04-22 06:57:28,795 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1713769048743.f34bedc38eed6db7727bae6d7a55585c. after waiting 0 ms 2024-04-22 06:57:28,795 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1713769048743.f34bedc38eed6db7727bae6d7a55585c. 2024-04-22 06:57:28,795 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1713769048743.f34bedc38eed6db7727bae6d7a55585c. 2024-04-22 06:57:28,795 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1558): Region close journal for f34bedc38eed6db7727bae6d7a55585c: 2024-04-22 06:57:28,795 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1713769048743.849a1b60a71b5d3ecd3f1929cc1d4c66.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-22 06:57:28,796 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1604): Closing 849a1b60a71b5d3ecd3f1929cc1d4c66, disabling compactions & flushes 2024-04-22 06:57:28,796 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1713769048743.849a1b60a71b5d3ecd3f1929cc1d4c66. 2024-04-22 06:57:28,796 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1713769048743.849a1b60a71b5d3ecd3f1929cc1d4c66. 2024-04-22 06:57:28,796 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1713769048743.849a1b60a71b5d3ecd3f1929cc1d4c66. after waiting 0 ms 2024-04-22 06:57:28,796 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1713769048743.849a1b60a71b5d3ecd3f1929cc1d4c66. 2024-04-22 06:57:28,796 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1713769048743.849a1b60a71b5d3ecd3f1929cc1d4c66. 2024-04-22 06:57:28,796 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1558): Region close journal for 849a1b60a71b5d3ecd3f1929cc1d4c66: 2024-04-22 06:57:28,800 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=22, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ADD_TO_META 2024-04-22 06:57:28,802 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1713769048743.f34bedc38eed6db7727bae6d7a55585c.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713769048802"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713769048802"}]},"ts":"1713769048802"} 2024-04-22 06:57:28,802 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,,1713769048743.849a1b60a71b5d3ecd3f1929cc1d4c66.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713769048802"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713769048802"}]},"ts":"1713769048802"} 2024-04-22 06:57:28,806 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2024-04-22 06:57:28,807 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=22, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-04-22 06:57:28,808 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713769048807"}]},"ts":"1713769048807"} 2024-04-22 06:57:28,810 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLING in hbase:meta 2024-04-22 06:57:28,815 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-04-22 06:57:28,817 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-04-22 06:57:28,817 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-04-22 06:57:28,817 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-04-22 06:57:28,818 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=849a1b60a71b5d3ecd3f1929cc1d4c66, ASSIGN}, {pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=f34bedc38eed6db7727bae6d7a55585c, ASSIGN}] 2024-04-22 06:57:28,820 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=f34bedc38eed6db7727bae6d7a55585c, ASSIGN 2024-04-22 06:57:28,820 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=849a1b60a71b5d3ecd3f1929cc1d4c66, ASSIGN 2024-04-22 06:57:28,821 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=f34bedc38eed6db7727bae6d7a55585c, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,41835,1713769042782; forceNewPlan=false, retain=false 2024-04-22 06:57:28,821 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=849a1b60a71b5d3ecd3f1929cc1d4c66, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43163,1713769042831; forceNewPlan=false, retain=false 2024-04-22 06:57:28,971 INFO [jenkins-hbase4:46823] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2024-04-22 06:57:28,973 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=849a1b60a71b5d3ecd3f1929cc1d4c66, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43163,1713769042831 2024-04-22 06:57:28,973 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=f34bedc38eed6db7727bae6d7a55585c, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,41835,1713769042782 2024-04-22 06:57:28,973 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1713769048743.849a1b60a71b5d3ecd3f1929cc1d4c66.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713769048973"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713769048973"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713769048973"}]},"ts":"1713769048973"} 2024-04-22 06:57:28,973 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1713769048743.f34bedc38eed6db7727bae6d7a55585c.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713769048973"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713769048973"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713769048973"}]},"ts":"1713769048973"} 2024-04-22 06:57:28,976 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; OpenRegionProcedure 849a1b60a71b5d3ecd3f1929cc1d4c66, server=jenkins-hbase4.apache.org,43163,1713769042831}] 2024-04-22 06:57:28,978 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=26, ppid=24, state=RUNNABLE; OpenRegionProcedure f34bedc38eed6db7727bae6d7a55585c, server=jenkins-hbase4.apache.org,41835,1713769042782}] 2024-04-22 06:57:29,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-04-22 06:57:29,130 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,43163,1713769042831 2024-04-22 06:57:29,132 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,41835,1713769042782 2024-04-22 06:57:29,136 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,,1713769048743.849a1b60a71b5d3ecd3f1929cc1d4c66. 2024-04-22 06:57:29,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 849a1b60a71b5d3ecd3f1929cc1d4c66, NAME => 'TestNs:TestTable,,1713769048743.849a1b60a71b5d3ecd3f1929cc1d4c66.', STARTKEY => '', ENDKEY => '1'} 2024-04-22 06:57:29,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable 849a1b60a71b5d3ecd3f1929cc1d4c66 2024-04-22 06:57:29,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1713769048743.849a1b60a71b5d3ecd3f1929cc1d4c66.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-22 06:57:29,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 849a1b60a71b5d3ecd3f1929cc1d4c66 2024-04-22 06:57:29,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 849a1b60a71b5d3ecd3f1929cc1d4c66 2024-04-22 06:57:29,137 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,1,1713769048743.f34bedc38eed6db7727bae6d7a55585c. 2024-04-22 06:57:29,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f34bedc38eed6db7727bae6d7a55585c, NAME => 'TestNs:TestTable,1,1713769048743.f34bedc38eed6db7727bae6d7a55585c.', STARTKEY => '1', ENDKEY => ''} 2024-04-22 06:57:29,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable f34bedc38eed6db7727bae6d7a55585c 2024-04-22 06:57:29,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1713769048743.f34bedc38eed6db7727bae6d7a55585c.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-22 06:57:29,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f34bedc38eed6db7727bae6d7a55585c 2024-04-22 06:57:29,138 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f34bedc38eed6db7727bae6d7a55585c 2024-04-22 06:57:29,138 INFO [StoreOpener-849a1b60a71b5d3ecd3f1929cc1d4c66-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 849a1b60a71b5d3ecd3f1929cc1d4c66 2024-04-22 06:57:29,140 INFO [StoreOpener-f34bedc38eed6db7727bae6d7a55585c-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f34bedc38eed6db7727bae6d7a55585c 2024-04-22 06:57:29,141 DEBUG [StoreOpener-849a1b60a71b5d3ecd3f1929cc1d4c66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/TestNs/TestTable/849a1b60a71b5d3ecd3f1929cc1d4c66/cf 2024-04-22 06:57:29,141 DEBUG [StoreOpener-849a1b60a71b5d3ecd3f1929cc1d4c66-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/TestNs/TestTable/849a1b60a71b5d3ecd3f1929cc1d4c66/cf 2024-04-22 06:57:29,141 INFO [StoreOpener-849a1b60a71b5d3ecd3f1929cc1d4c66-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 849a1b60a71b5d3ecd3f1929cc1d4c66 columnFamilyName cf 2024-04-22 06:57:29,142 DEBUG [StoreOpener-f34bedc38eed6db7727bae6d7a55585c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/TestNs/TestTable/f34bedc38eed6db7727bae6d7a55585c/cf 2024-04-22 06:57:29,142 DEBUG [StoreOpener-f34bedc38eed6db7727bae6d7a55585c-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/TestNs/TestTable/f34bedc38eed6db7727bae6d7a55585c/cf 2024-04-22 06:57:29,142 INFO [StoreOpener-849a1b60a71b5d3ecd3f1929cc1d4c66-1] regionserver.HStore(310): Store=849a1b60a71b5d3ecd3f1929cc1d4c66/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-22 06:57:29,144 INFO [StoreOpener-f34bedc38eed6db7727bae6d7a55585c-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f34bedc38eed6db7727bae6d7a55585c columnFamilyName cf 2024-04-22 06:57:29,144 INFO [StoreOpener-f34bedc38eed6db7727bae6d7a55585c-1] regionserver.HStore(310): Store=f34bedc38eed6db7727bae6d7a55585c/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-22 06:57:29,145 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/TestNs/TestTable/849a1b60a71b5d3ecd3f1929cc1d4c66 2024-04-22 06:57:29,146 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/TestNs/TestTable/849a1b60a71b5d3ecd3f1929cc1d4c66 2024-04-22 06:57:29,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/TestNs/TestTable/f34bedc38eed6db7727bae6d7a55585c 2024-04-22 06:57:29,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/TestNs/TestTable/f34bedc38eed6db7727bae6d7a55585c 2024-04-22 06:57:29,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 849a1b60a71b5d3ecd3f1929cc1d4c66 2024-04-22 06:57:29,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f34bedc38eed6db7727bae6d7a55585c 2024-04-22 06:57:29,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/TestNs/TestTable/849a1b60a71b5d3ecd3f1929cc1d4c66/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-22 06:57:29,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/TestNs/TestTable/f34bedc38eed6db7727bae6d7a55585c/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-22 06:57:29,156 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 849a1b60a71b5d3ecd3f1929cc1d4c66; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63617271, jitterRate=-0.05202879011631012}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-04-22 06:57:29,156 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 849a1b60a71b5d3ecd3f1929cc1d4c66: 2024-04-22 06:57:29,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f34bedc38eed6db7727bae6d7a55585c; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59710480, jitterRate=-0.1102445125579834}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-04-22 06:57:29,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f34bedc38eed6db7727bae6d7a55585c: 2024-04-22 06:57:29,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2345): Post open deploy tasks for TestNs:TestTable,,1713769048743.849a1b60a71b5d3ecd3f1929cc1d4c66., pid=25, masterSystemTime=1713769049130 2024-04-22 06:57:29,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2345): Post open deploy tasks for TestNs:TestTable,1,1713769048743.f34bedc38eed6db7727bae6d7a55585c., pid=26, masterSystemTime=1713769049132 2024-04-22 06:57:29,161 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2372): Finished post open deploy task for TestNs:TestTable,,1713769048743.849a1b60a71b5d3ecd3f1929cc1d4c66. 2024-04-22 06:57:29,161 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,,1713769048743.849a1b60a71b5d3ecd3f1929cc1d4c66. 2024-04-22 06:57:29,162 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=849a1b60a71b5d3ecd3f1929cc1d4c66, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43163,1713769042831 2024-04-22 06:57:29,162 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,,1713769048743.849a1b60a71b5d3ecd3f1929cc1d4c66.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713769049162"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1713769049162"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1713769049162"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1713769049162"}]},"ts":"1713769049162"} 2024-04-22 06:57:29,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2372): Finished post open deploy task for TestNs:TestTable,1,1713769048743.f34bedc38eed6db7727bae6d7a55585c. 2024-04-22 06:57:29,163 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,1,1713769048743.f34bedc38eed6db7727bae6d7a55585c. 2024-04-22 06:57:29,164 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=f34bedc38eed6db7727bae6d7a55585c, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,41835,1713769042782 2024-04-22 06:57:29,165 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,1,1713769048743.f34bedc38eed6db7727bae6d7a55585c.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713769049163"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1713769049163"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1713769049163"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1713769049163"}]},"ts":"1713769049163"} 2024-04-22 06:57:29,169 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=25, resume processing ppid=23 2024-04-22 06:57:29,169 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=25, ppid=23, state=SUCCESS; OpenRegionProcedure 849a1b60a71b5d3ecd3f1929cc1d4c66, server=jenkins-hbase4.apache.org,43163,1713769042831 in 189 msec 2024-04-22 06:57:29,171 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=26, resume processing ppid=24 2024-04-22 06:57:29,173 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=26, ppid=24, state=SUCCESS; OpenRegionProcedure f34bedc38eed6db7727bae6d7a55585c, server=jenkins-hbase4.apache.org,41835,1713769042782 in 190 msec 2024-04-22 06:57:29,173 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=23, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=849a1b60a71b5d3ecd3f1929cc1d4c66, ASSIGN in 352 msec 2024-04-22 06:57:29,175 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=24, resume processing ppid=22 2024-04-22 06:57:29,175 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=24, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=f34bedc38eed6db7727bae6d7a55585c, ASSIGN in 354 msec 2024-04-22 06:57:29,176 INFO [PEWorker-4] procedure.CreateTableProcedure(82): pid=22, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-04-22 06:57:29,176 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713769049176"}]},"ts":"1713769049176"} 2024-04-22 06:57:29,179 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLED in hbase:meta 2024-04-22 06:57:29,182 INFO [PEWorker-4] procedure.CreateTableProcedure(82): pid=22, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_POST_OPERATION 2024-04-22 06:57:29,185 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=22, state=SUCCESS; CreateTableProcedure table=TestNs:TestTable in 438 msec 2024-04-22 06:57:29,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-04-22 06:57:29,504 INFO [Listener at localhost/40363] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: TestNs:TestTable, procId: 22 completed 2024-04-22 06:57:29,504 DEBUG [Listener at localhost/40363] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestNs:TestTable get assigned. Timeout = 60000ms 2024-04-22 06:57:29,504 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:57:29,508 INFO [Listener at localhost/40363] hbase.HBaseTestingUtility(3484): All regions for table TestNs:TestTable assigned to meta. Checking AM states. 2024-04-22 06:57:29,508 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:57:29,508 INFO [Listener at localhost/40363] hbase.HBaseTestingUtility(3504): All regions for table TestNs:TestTable assigned. 2024-04-22 06:57:29,509 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:57:29,563 INFO [Listener at localhost/40363] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=307, OpenFileDescriptor=631, MaxFileDescriptor=60000, SystemLoadAverage=390, ProcessCount=167, AvailableMemoryMB=13869 2024-04-22 06:57:29,895 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:57:29,896 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-22 06:57:29,896 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713772649644 bypass), TestNs=QuotaState(ts=1713772649644 bypass)} 2024-04-22 06:57:29,896 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713772649644 bypass), TestQuotaAdmin2=QuotaState(ts=1713772649644 bypass)} 2024-04-22 06:57:29,896 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713772649644 [ TestNs:TestTable ])} 2024-04-22 06:57:29,896 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713772649644 bypass)} 2024-04-22 06:57:30,070 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2024-04-22 06:57:30,139 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2024-04-22 06:57:30,140 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2024-04-22 06:57:30,141 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestNs:TestTable' 2024-04-22 06:57:30,141 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin2' 2024-04-22 06:57:30,141 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:quota' 2024-04-22 06:57:30,142 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin0' 2024-04-22 06:57:30,142 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin1' 2024-04-22 06:57:30,146 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:57:30,146 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-22 06:57:30,146 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713772649644 bypass), TestNs=QuotaState(ts=1713772649644 bypass)} 2024-04-22 06:57:30,146 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713772649644 bypass), TestNs:TestTable=QuotaState(ts=1713772649644 bypass), TestQuotaAdmin1=QuotaState(ts=1713772649644 bypass)} 2024-04-22 06:57:30,147 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713772649644 [ TestNs:TestTable ])} 2024-04-22 06:57:30,147 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713772649644 bypass)} 2024-04-22 06:57:30,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:57:30,165 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.CallRunner(144): callId: 90 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:59810 deadline: 1713769060163, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:57:30,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:57:30,438 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.CallRunner(144): callId: 92 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:59810 deadline: 1713769060163, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:57:30,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:57:30,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.CallRunner(144): callId: 94 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:59810 deadline: 1713769060164, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:57:31,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:57:31,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.CallRunner(144): callId: 96 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:59810 deadline: 1713769060164, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:57:31,712 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-04-22 06:57:31,712 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver Metrics about HBase MasterObservers 2024-04-22 06:57:31,713 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-04-22 06:57:31,713 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2024-04-22 06:57:32,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:57:32,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.CallRunner(144): callId: 98 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:59810 deadline: 1713769060163, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:57:35,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:57:35,489 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.CallRunner(144): callId: 100 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:59810 deadline: 1713769060163, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:57:35,490 ERROR [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10353: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1713769048743.f34bedc38eed6db7727bae6d7a55585c., hostname=jenkins-hbase4.apache.org,41835,1713769042782, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-22 06:57:35,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:57:35,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.CallRunner(144): callId: 101 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:59810 deadline: 1713769065492, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:57:35,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:57:35,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.CallRunner(144): callId: 103 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:59810 deadline: 1713769065493, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:57:36,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:57:36,254 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.CallRunner(144): callId: 105 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:59810 deadline: 1713769065492, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:57:37,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:57:37,008 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.CallRunner(144): callId: 107 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:59810 deadline: 1713769065493, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:57:38,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:57:38,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.CallRunner(144): callId: 109 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:59810 deadline: 1713769065493, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:57:40,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:57:40,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.CallRunner(144): callId: 111 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:59810 deadline: 1713769065493, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:57:40,784 ERROR [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10334: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1713769048743.f34bedc38eed6db7727bae6d7a55585c., hostname=jenkins-hbase4.apache.org,41835,1713769042782, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-22 06:57:41,047 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:57:41,047 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-22 06:57:41,047 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713776249644 bypass), TestNs=QuotaState(ts=1713776249644 bypass)} 2024-04-22 06:57:41,047 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713776249644 bypass), TestQuotaAdmin2=QuotaState(ts=1713776249644 bypass)} 2024-04-22 06:57:41,047 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713776249644 bypass)} 2024-04-22 06:57:41,047 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713776249644 bypass)} 2024-04-22 06:57:41,298 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:57:41,298 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-22 06:57:41,298 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713776249644 bypass), TestNs=QuotaState(ts=1713776249644 bypass)} 2024-04-22 06:57:41,298 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713776249644 bypass), TestNs:TestTable=QuotaState(ts=1713776249644 bypass), TestQuotaAdmin1=QuotaState(ts=1713776249644 bypass)} 2024-04-22 06:57:41,298 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713776249644 bypass)} 2024-04-22 06:57:41,298 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713776249644 bypass)} 2024-04-22 06:57:41,315 INFO [Listener at localhost/40363] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=290 (was 307), OpenFileDescriptor=598 (was 631), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=304 (was 390), ProcessCount=167 (was 167), AvailableMemoryMB=13780 (was 13869) 2024-04-22 06:57:41,330 INFO [Listener at localhost/40363] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=290, OpenFileDescriptor=598, MaxFileDescriptor=60000, SystemLoadAverage=304, ProcessCount=167, AvailableMemoryMB=13780 2024-04-22 06:57:41,594 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:57:41,594 INFO [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-04-22 06:57:41,845 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-22 06:57:41,846 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713779849744 bypass), TestNs=QuotaState(ts=1713779849744 bypass)} 2024-04-22 06:57:41,846 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713779849744 bypass), TestQuotaAdmin2=QuotaState(ts=1713779849744 bypass)} 2024-04-22 06:57:41,846 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713779849744 [ default ])} 2024-04-22 06:57:41,847 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713779849744 bypass)} 2024-04-22 06:57:42,097 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:57:42,097 INFO [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-04-22 06:57:42,348 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-22 06:57:42,349 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713779849844 bypass), TestNs=QuotaState(ts=1713779849844 bypass)} 2024-04-22 06:57:42,350 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713779849844 bypass), TestNs:TestTable=QuotaState(ts=1713779849844 bypass), TestQuotaAdmin1=QuotaState(ts=1713779849844 bypass)} 2024-04-22 06:57:42,350 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713779849844 [ default ])} 2024-04-22 06:57:42,350 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713779849844 bypass)} 2024-04-22 06:57:42,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-04-22 06:57:42,364 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 123 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:45938 deadline: 1713769072364, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-04-22 06:57:42,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-04-22 06:57:42,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 125 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:45938 deadline: 1713769072363, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-04-22 06:57:43,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-04-22 06:57:43,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 127 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:45938 deadline: 1713769072364, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-04-22 06:57:43,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-04-22 06:57:43,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 129 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:45938 deadline: 1713769072364, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-04-22 06:57:45,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-04-22 06:57:45,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 131 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:45938 deadline: 1713769072363, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-04-22 06:57:47,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-04-22 06:57:47,648 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 133 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:45938 deadline: 1713769072364, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-04-22 06:57:47,650 ERROR [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10312: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443., hostname=jenkins-hbase4.apache.org,43163,1713769042831, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:199) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-22 06:57:47,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-22 06:57:47,668 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 140 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:45938 deadline: 1713769077668, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-22 06:57:47,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-22 06:57:47,923 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 142 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:45938 deadline: 1713769077667, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-22 06:57:48,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-22 06:57:48,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 144 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:45938 deadline: 1713769077668, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-22 06:57:49,188 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-22 06:57:49,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 146 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:45938 deadline: 1713769077667, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-22 06:57:50,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-22 06:57:50,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 148 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:45938 deadline: 1713769077667, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-22 06:57:52,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-22 06:57:52,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 150 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:45938 deadline: 1713769077668, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-22 06:57:52,974 ERROR [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10355: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443., hostname=jenkins-hbase4.apache.org,43163,1713769042831, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:200) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-22 06:57:53,238 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:57:53,239 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-22 06:57:53,239 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713783449844 bypass), TestNs=QuotaState(ts=1713783449844 bypass)} 2024-04-22 06:57:53,239 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713783449844 bypass), TestQuotaAdmin2=QuotaState(ts=1713783449844 bypass)} 2024-04-22 06:57:53,239 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713783449844 bypass)} 2024-04-22 06:57:53,239 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713783449844 bypass)} 2024-04-22 06:57:53,489 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:57:53,489 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-22 06:57:53,489 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713783449844 bypass), TestNs=QuotaState(ts=1713783449844 bypass)} 2024-04-22 06:57:53,489 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713783449844 bypass), TestNs:TestTable=QuotaState(ts=1713783449844 bypass), TestQuotaAdmin1=QuotaState(ts=1713783449844 bypass)} 2024-04-22 06:57:53,489 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713783449844 bypass)} 2024-04-22 06:57:53,490 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713783449844 bypass)} 2024-04-22 06:57:53,504 INFO [Listener at localhost/40363] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=290 (was 290), OpenFileDescriptor=594 (was 598), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=287 (was 304), ProcessCount=167 (was 167), AvailableMemoryMB=13647 (was 13780) 2024-04-22 06:57:53,518 INFO [Listener at localhost/40363] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=290, OpenFileDescriptor=594, MaxFileDescriptor=60000, SystemLoadAverage=287, ProcessCount=167, AvailableMemoryMB=13647 2024-04-22 06:57:53,781 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:57:53,782 INFO [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-04-22 06:57:54,032 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-22 06:57:54,033 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713787049944 bypass), TestNs=QuotaState(ts=1713787049944 bypass)} 2024-04-22 06:57:54,034 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713787049944 bypass), TestQuotaAdmin2=QuotaState(ts=1713787049944 bypass)} 2024-04-22 06:57:54,034 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713787049944 global-limiter)} 2024-04-22 06:57:54,034 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713787049944 bypass)} 2024-04-22 06:57:54,284 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:57:54,285 INFO [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-04-22 06:57:54,535 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-22 06:57:54,536 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713787050044 bypass), TestNs=QuotaState(ts=1713787050044 bypass)} 2024-04-22 06:57:54,537 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713787050044 bypass), TestNs:TestTable=QuotaState(ts=1713787050044 bypass), TestQuotaAdmin1=QuotaState(ts=1713787050044 bypass)} 2024-04-22 06:57:54,537 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713787050044 global-limiter)} 2024-04-22 06:57:54,537 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713787050044 bypass)} 2024-04-22 06:57:54,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-22 06:57:54,553 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 163 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:45938 deadline: 1713769084552, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-22 06:57:54,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-22 06:57:54,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 165 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:45938 deadline: 1713769084553, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-22 06:57:55,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-22 06:57:55,316 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 167 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:45938 deadline: 1713769084552, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-22 06:57:56,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-22 06:57:56,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 169 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:45938 deadline: 1713769084553, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-22 06:57:57,331 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-22 06:57:57,332 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 171 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:45938 deadline: 1713769084552, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-22 06:57:59,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-22 06:57:59,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 173 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:45938 deadline: 1713769084553, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-22 06:57:59,841 ERROR [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10292: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443., hostname=jenkins-hbase4.apache.org,43163,1713769042831, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:178) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-22 06:57:59,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-04-22 06:57:59,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 177 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:45938 deadline: 1713769089847, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-04-22 06:58:00,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-04-22 06:58:00,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 179 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:45938 deadline: 1713769089848, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-04-22 06:58:00,606 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-04-22 06:58:00,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 181 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:45938 deadline: 1713769089847, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-04-22 06:58:01,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-04-22 06:58:01,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 183 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:45938 deadline: 1713769089848, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-04-22 06:58:02,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-04-22 06:58:02,621 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 185 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:45938 deadline: 1713769089847, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-04-22 06:58:05,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-04-22 06:58:05,144 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 187 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:45938 deadline: 1713769089848, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-04-22 06:58:05,145 ERROR [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=3 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10302: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-3' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443., hostname=jenkins-hbase4.apache.org,43163,1713769042831, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-22 06:58:05,402 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:58:05,402 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-22 06:58:05,402 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713790650044 bypass), TestNs=QuotaState(ts=1713790650044 bypass)} 2024-04-22 06:58:05,402 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713790650044 bypass), TestQuotaAdmin2=QuotaState(ts=1713790650044 bypass)} 2024-04-22 06:58:05,402 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713790650044 bypass)} 2024-04-22 06:58:05,402 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713790650044 bypass)} 2024-04-22 06:58:05,653 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:58:05,653 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-22 06:58:05,653 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713790650044 bypass), TestNs=QuotaState(ts=1713790650044 bypass)} 2024-04-22 06:58:05,653 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713790650044 bypass), TestNs:TestTable=QuotaState(ts=1713790650044 bypass), TestQuotaAdmin1=QuotaState(ts=1713790650044 bypass)} 2024-04-22 06:58:05,653 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713790650044 bypass)} 2024-04-22 06:58:05,653 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713790650044 bypass)} 2024-04-22 06:58:05,666 INFO [Listener at localhost/40363] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=281 (was 290), OpenFileDescriptor=592 (was 594), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=242 (was 287), ProcessCount=166 (was 167), AvailableMemoryMB=13602 (was 13647) 2024-04-22 06:58:05,679 INFO [Listener at localhost/40363] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=281, OpenFileDescriptor=592, MaxFileDescriptor=60000, SystemLoadAverage=242, ProcessCount=166, AvailableMemoryMB=13602 2024-04-22 06:58:05,936 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:58:05,937 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-22 06:58:05,937 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713794250044 bypass), TestNs=QuotaState(ts=1713794250044 bypass)} 2024-04-22 06:58:05,939 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713794250044 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin2=QuotaState(ts=1713794250044 bypass)} 2024-04-22 06:58:05,939 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(218): {} 2024-04-22 06:58:05,939 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713794250044 bypass)} 2024-04-22 06:58:06,189 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:58:06,191 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-22 06:58:06,191 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713794250044 bypass), TestNs=QuotaState(ts=1713794250044 bypass)} 2024-04-22 06:58:06,191 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713794250044 bypass), TestNs:TestTable=QuotaState(ts=1713794250044 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin1=QuotaState(ts=1713794250044 bypass)} 2024-04-22 06:58:06,191 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(218): {} 2024-04-22 06:58:06,191 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713794250044 bypass)} 2024-04-22 06:58:06,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:58:06,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.CallRunner(144): callId: 202 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:59810 deadline: 1713769096206, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:58:06,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:58:06,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.CallRunner(144): callId: 204 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:59810 deadline: 1713769096206, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:58:06,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:58:06,968 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.CallRunner(144): callId: 206 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:59810 deadline: 1713769096206, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:58:07,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:58:07,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.CallRunner(144): callId: 208 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:59810 deadline: 1713769096206, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:58:08,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:58:08,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.CallRunner(144): callId: 210 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:59810 deadline: 1713769096207, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:58:11,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:58:11,493 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.CallRunner(144): callId: 212 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:59810 deadline: 1713769096206, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:58:11,494 ERROR [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10320: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1713769048743.f34bedc38eed6db7727bae6d7a55585c., hostname=jenkins-hbase4.apache.org,41835,1713769042782, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-22 06:58:11,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:58:11,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.CallRunner(144): callId: 213 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:59810 deadline: 1713769101496, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:58:11,753 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:58:11,754 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.CallRunner(144): callId: 215 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:59810 deadline: 1713769101495, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:58:12,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:58:12,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.CallRunner(144): callId: 217 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:59810 deadline: 1713769101496, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:58:13,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:58:13,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.CallRunner(144): callId: 219 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:59810 deadline: 1713769101495, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:58:14,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:58:14,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.CallRunner(144): callId: 221 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:59810 deadline: 1713769101496, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:58:16,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:58:16,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41835] ipc.CallRunner(144): callId: 223 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:59810 deadline: 1713769101495, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-22 06:58:16,787 ERROR [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10313: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1713769048743.f34bedc38eed6db7727bae6d7a55585c., hostname=jenkins-hbase4.apache.org,41835,1713769042782, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-22 06:58:17,044 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:58:17,045 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-22 06:58:17,045 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713797850044 bypass), TestNs=QuotaState(ts=1713797850044 bypass)} 2024-04-22 06:58:17,045 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713797850044 bypass), TestQuotaAdmin2=QuotaState(ts=1713797850044 bypass)} 2024-04-22 06:58:17,045 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713797850044 bypass)} 2024-04-22 06:58:17,045 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713797850044 bypass)} 2024-04-22 06:58:17,295 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:58:17,295 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-22 06:58:17,295 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713797850044 bypass), TestNs=QuotaState(ts=1713797850044 bypass)} 2024-04-22 06:58:17,296 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713797850044 bypass), TestNs:TestTable=QuotaState(ts=1713797850044 bypass), TestQuotaAdmin1=QuotaState(ts=1713797850044 bypass)} 2024-04-22 06:58:17,296 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(218): {} 2024-04-22 06:58:17,296 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713797850044 bypass)} 2024-04-22 06:58:17,309 INFO [Listener at localhost/40363] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=281 (was 281), OpenFileDescriptor=592 (was 592), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=231 (was 242), ProcessCount=166 (was 166), AvailableMemoryMB=13606 (was 13602) - AvailableMemoryMB LEAK? - 2024-04-22 06:58:17,322 INFO [Listener at localhost/40363] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=281, OpenFileDescriptor=592, MaxFileDescriptor=60000, SystemLoadAverage=231, ProcessCount=166, AvailableMemoryMB=13606 2024-04-22 06:58:17,584 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:58:17,584 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-22 06:58:17,585 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713801450044 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1713801450044 bypass)} 2024-04-22 06:58:17,585 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713801450044 bypass), TestQuotaAdmin2=QuotaState(ts=1713801450044 bypass)} 2024-04-22 06:58:17,585 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(218): {} 2024-04-22 06:58:17,585 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713801450044 bypass)} 2024-04-22 06:58:17,835 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:58:17,835 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-22 06:58:17,836 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713801450044 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1713801450044 bypass)} 2024-04-22 06:58:17,837 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713801450044 bypass), TestNs:TestTable=QuotaState(ts=1713801450044 bypass), TestQuotaAdmin1=QuotaState(ts=1713801450044 bypass)} 2024-04-22 06:58:17,837 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(218): {} 2024-04-22 06:58:17,837 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713801450044 bypass)} 2024-04-22 06:58:17,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-04-22 06:58:17,851 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 235 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:45938 deadline: 1713769107851, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-04-22 06:58:18,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-04-22 06:58:18,107 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 237 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:45938 deadline: 1713769107851, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-04-22 06:58:18,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-04-22 06:58:18,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 239 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:45938 deadline: 1713769107850, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-04-22 06:58:19,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-04-22 06:58:19,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 241 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:45938 deadline: 1713769107851, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-04-22 06:58:20,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-04-22 06:58:20,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 243 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:45938 deadline: 1713769107850, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-04-22 06:58:23,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-04-22 06:58:23,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 245 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:45938 deadline: 1713769107851, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-04-22 06:58:23,139 ERROR [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10294: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443., hostname=jenkins-hbase4.apache.org,43163,1713769042831, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:128) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-22 06:58:23,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-04-22 06:58:23,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 252 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:45938 deadline: 1713769113147, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-04-22 06:58:23,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-04-22 06:58:23,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 254 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:45938 deadline: 1713769113148, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-04-22 06:58:23,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-04-22 06:58:23,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 256 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:45938 deadline: 1713769113147, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-04-22 06:58:24,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-04-22 06:58:24,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 258 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:45938 deadline: 1713769113148, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-04-22 06:58:25,917 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-04-22 06:58:25,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 260 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:45938 deadline: 1713769113147, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-04-22 06:58:28,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-04-22 06:58:28,441 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43163] ipc.CallRunner(144): callId: 262 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:45938 deadline: 1713769113148, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-04-22 06:58:28,442 ERROR [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10297: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443., hostname=jenkins-hbase4.apache.org,43163,1713769042831, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-22 06:58:28,700 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:58:28,700 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-22 06:58:28,700 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713805050044 bypass), TestNs=QuotaState(ts=1713805050044 bypass)} 2024-04-22 06:58:28,700 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713805050044 bypass), TestQuotaAdmin2=QuotaState(ts=1713805050044 bypass)} 2024-04-22 06:58:28,700 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(218): {} 2024-04-22 06:58:28,701 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713805050044 bypass)} 2024-04-22 06:58:28,951 INFO [Listener at localhost/40363] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-22 06:58:28,951 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-22 06:58:28,951 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713805050044 bypass), TestNs=QuotaState(ts=1713805050044 bypass)} 2024-04-22 06:58:28,951 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713805050044 bypass), TestNs:TestTable=QuotaState(ts=1713805050044 bypass), TestQuotaAdmin1=QuotaState(ts=1713805050044 bypass)} 2024-04-22 06:58:28,951 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713805050044 bypass)} 2024-04-22 06:58:28,951 DEBUG [Listener at localhost/40363] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713805050044 bypass)} 2024-04-22 06:58:28,965 INFO [Listener at localhost/40363] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=265 (was 281), OpenFileDescriptor=583 (was 592), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=197 (was 231), ProcessCount=166 (was 166), AvailableMemoryMB=13603 (was 13606) 2024-04-22 06:58:28,968 INFO [Listener at localhost/40363] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin0 2024-04-22 06:58:28,972 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin0 2024-04-22 06:58:28,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1075): Stored pid=27, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin0 2024-04-22 06:58:28,982 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713769108982"}]},"ts":"1713769108982"} 2024-04-22 06:58:28,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-04-22 06:58:28,984 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLING in hbase:meta 2024-04-22 06:58:28,986 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set TestQuotaAdmin0 to state=DISABLING 2024-04-22 06:58:28,988 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=c6d73e069db2b6227e7fc911b7686443, UNASSIGN}] 2024-04-22 06:58:28,989 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=c6d73e069db2b6227e7fc911b7686443, UNASSIGN 2024-04-22 06:58:28,990 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=c6d73e069db2b6227e7fc911b7686443, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43163,1713769042831 2024-04-22 06:58:28,990 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713769108990"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713769108990"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713769108990"}]},"ts":"1713769108990"} 2024-04-22 06:58:28,992 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure c6d73e069db2b6227e7fc911b7686443, server=jenkins-hbase4.apache.org,43163,1713769042831}] 2024-04-22 06:58:29,132 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase4.apache.org,43163,1713769042831, timeout=1713769109147, delay=15, operations=[pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure c6d73e069db2b6227e7fc911b7686443, server=jenkins-hbase4.apache.org,43163,1713769042831]] 2024-04-22 06:58:29,150 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,43163,1713769042831 2024-04-22 06:58:29,152 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close c6d73e069db2b6227e7fc911b7686443 2024-04-22 06:58:29,153 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c6d73e069db2b6227e7fc911b7686443, disabling compactions & flushes 2024-04-22 06:58:29,153 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443. 2024-04-22 06:58:29,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443. 2024-04-22 06:58:29,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443. after waiting 0 ms 2024-04-22 06:58:29,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443. 2024-04-22 06:58:29,154 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c6d73e069db2b6227e7fc911b7686443 1/1 column families, dataSize=578 B heapSize=2.11 KB 2024-04-22 06:58:29,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-04-22 06:58:29,241 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=578 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/default/TestQuotaAdmin0/c6d73e069db2b6227e7fc911b7686443/.tmp/cf/b84f3041204c4a7283a6ae4449b3e0b6 2024-04-22 06:58:29,287 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/default/TestQuotaAdmin0/c6d73e069db2b6227e7fc911b7686443/.tmp/cf/b84f3041204c4a7283a6ae4449b3e0b6 as hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/default/TestQuotaAdmin0/c6d73e069db2b6227e7fc911b7686443/cf/b84f3041204c4a7283a6ae4449b3e0b6 2024-04-22 06:58:29,299 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/default/TestQuotaAdmin0/c6d73e069db2b6227e7fc911b7686443/cf/b84f3041204c4a7283a6ae4449b3e0b6, entries=6, sequenceid=21, filesize=4.7 K 2024-04-22 06:58:29,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~578 B/578, heapSize ~2.09 KB/2144, currentSize=0 B/0 for c6d73e069db2b6227e7fc911b7686443 in 148ms, sequenceid=21, compaction requested=false 2024-04-22 06:58:29,312 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/default/TestQuotaAdmin0/c6d73e069db2b6227e7fc911b7686443/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2024-04-22 06:58:29,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443. 2024-04-22 06:58:29,314 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c6d73e069db2b6227e7fc911b7686443: 2024-04-22 06:58:29,316 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed c6d73e069db2b6227e7fc911b7686443 2024-04-22 06:58:29,316 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=c6d73e069db2b6227e7fc911b7686443, regionState=CLOSED 2024-04-22 06:58:29,317 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713769109316"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713769109316"}]},"ts":"1713769109316"} 2024-04-22 06:58:29,320 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=29, resume processing ppid=28 2024-04-22 06:58:29,321 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=29, ppid=28, state=SUCCESS; CloseRegionProcedure c6d73e069db2b6227e7fc911b7686443, server=jenkins-hbase4.apache.org,43163,1713769042831 in 326 msec 2024-04-22 06:58:29,323 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=28, resume processing ppid=27 2024-04-22 06:58:29,323 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=c6d73e069db2b6227e7fc911b7686443, UNASSIGN in 333 msec 2024-04-22 06:58:29,324 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713769109324"}]},"ts":"1713769109324"} 2024-04-22 06:58:29,325 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLED in hbase:meta 2024-04-22 06:58:29,327 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set TestQuotaAdmin0 to state=DISABLED 2024-04-22 06:58:29,330 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=27, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin0 in 355 msec 2024-04-22 06:58:29,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-04-22 06:58:29,740 INFO [Listener at localhost/40363] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin0, procId: 27 completed 2024-04-22 06:58:29,745 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin0 2024-04-22 06:58:29,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1075): Stored pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin0 2024-04-22 06:58:29,754 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-04-22 06:58:29,756 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=30, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-04-22 06:58:29,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-04-22 06:58:29,763 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/default/TestQuotaAdmin0/c6d73e069db2b6227e7fc911b7686443 2024-04-22 06:58:29,768 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/default/TestQuotaAdmin0/c6d73e069db2b6227e7fc911b7686443/cf, FileablePath, hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/default/TestQuotaAdmin0/c6d73e069db2b6227e7fc911b7686443/recovered.edits] 2024-04-22 06:58:29,779 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/default/TestQuotaAdmin0/c6d73e069db2b6227e7fc911b7686443/cf/b84f3041204c4a7283a6ae4449b3e0b6 to hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/archive/data/default/TestQuotaAdmin0/c6d73e069db2b6227e7fc911b7686443/cf/b84f3041204c4a7283a6ae4449b3e0b6 2024-04-22 06:58:29,784 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/default/TestQuotaAdmin0/c6d73e069db2b6227e7fc911b7686443/recovered.edits/24.seqid to hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/archive/data/default/TestQuotaAdmin0/c6d73e069db2b6227e7fc911b7686443/recovered.edits/24.seqid 2024-04-22 06:58:29,786 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/default/TestQuotaAdmin0/c6d73e069db2b6227e7fc911b7686443 2024-04-22 06:58:29,786 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-04-22 06:58:29,789 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=30, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-04-22 06:58:29,810 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin0 from hbase:meta 2024-04-22 06:58:29,812 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin0' descriptor. 2024-04-22 06:58:29,814 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=30, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-04-22 06:58:29,814 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin0' from region states. 2024-04-22 06:58:29,814 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1713769109814"}]},"ts":"9223372036854775807"} 2024-04-22 06:58:29,816 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-04-22 06:58:29,816 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => c6d73e069db2b6227e7fc911b7686443, NAME => 'TestQuotaAdmin0,,1713769046094.c6d73e069db2b6227e7fc911b7686443.', STARTKEY => '', ENDKEY => ''}] 2024-04-22 06:58:29,816 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin0' as deleted. 2024-04-22 06:58:29,816 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1713769109816"}]},"ts":"9223372036854775807"} 2024-04-22 06:58:29,818 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin0 state from META 2024-04-22 06:58:29,821 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=30, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-04-22 06:58:29,822 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=30, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin0 in 75 msec 2024-04-22 06:58:30,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-04-22 06:58:30,013 INFO [Listener at localhost/40363] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin0, procId: 30 completed 2024-04-22 06:58:30,013 INFO [Listener at localhost/40363] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin1 2024-04-22 06:58:30,014 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin1 2024-04-22 06:58:30,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1075): Stored pid=31, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin1 2024-04-22 06:58:30,018 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-04-22 06:58:30,019 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713769110019"}]},"ts":"1713769110019"} 2024-04-22 06:58:30,021 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLING in hbase:meta 2024-04-22 06:58:30,023 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set TestQuotaAdmin1 to state=DISABLING 2024-04-22 06:58:30,024 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=4de96e5ccfebd759d7a5eb735f57e289, UNASSIGN}] 2024-04-22 06:58:30,025 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=4de96e5ccfebd759d7a5eb735f57e289, UNASSIGN 2024-04-22 06:58:30,026 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=4de96e5ccfebd759d7a5eb735f57e289, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43163,1713769042831 2024-04-22 06:58:30,026 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1713769046911.4de96e5ccfebd759d7a5eb735f57e289.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713769110026"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713769110026"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713769110026"}]},"ts":"1713769110026"} 2024-04-22 06:58:30,028 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=33, ppid=32, state=RUNNABLE; CloseRegionProcedure 4de96e5ccfebd759d7a5eb735f57e289, server=jenkins-hbase4.apache.org,43163,1713769042831}] 2024-04-22 06:58:30,180 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,43163,1713769042831 2024-04-22 06:58:30,181 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 4de96e5ccfebd759d7a5eb735f57e289 2024-04-22 06:58:30,182 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4de96e5ccfebd759d7a5eb735f57e289, disabling compactions & flushes 2024-04-22 06:58:30,182 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1713769046911.4de96e5ccfebd759d7a5eb735f57e289. 2024-04-22 06:58:30,182 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1713769046911.4de96e5ccfebd759d7a5eb735f57e289. 2024-04-22 06:58:30,182 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1713769046911.4de96e5ccfebd759d7a5eb735f57e289. after waiting 0 ms 2024-04-22 06:58:30,182 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1713769046911.4de96e5ccfebd759d7a5eb735f57e289. 2024-04-22 06:58:30,188 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/default/TestQuotaAdmin1/4de96e5ccfebd759d7a5eb735f57e289/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-04-22 06:58:30,189 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1713769046911.4de96e5ccfebd759d7a5eb735f57e289. 2024-04-22 06:58:30,189 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4de96e5ccfebd759d7a5eb735f57e289: 2024-04-22 06:58:30,191 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 4de96e5ccfebd759d7a5eb735f57e289 2024-04-22 06:58:30,192 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=4de96e5ccfebd759d7a5eb735f57e289, regionState=CLOSED 2024-04-22 06:58:30,192 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1713769046911.4de96e5ccfebd759d7a5eb735f57e289.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713769110192"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713769110192"}]},"ts":"1713769110192"} 2024-04-22 06:58:30,198 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=33, resume processing ppid=32 2024-04-22 06:58:30,198 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=33, ppid=32, state=SUCCESS; CloseRegionProcedure 4de96e5ccfebd759d7a5eb735f57e289, server=jenkins-hbase4.apache.org,43163,1713769042831 in 167 msec 2024-04-22 06:58:30,200 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=32, resume processing ppid=31 2024-04-22 06:58:30,201 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=32, ppid=31, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=4de96e5ccfebd759d7a5eb735f57e289, UNASSIGN in 174 msec 2024-04-22 06:58:30,202 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713769110201"}]},"ts":"1713769110201"} 2024-04-22 06:58:30,203 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLED in hbase:meta 2024-04-22 06:58:30,206 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set TestQuotaAdmin1 to state=DISABLED 2024-04-22 06:58:30,208 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=31, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin1 in 192 msec 2024-04-22 06:58:30,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-04-22 06:58:30,270 INFO [Listener at localhost/40363] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin1, procId: 31 completed 2024-04-22 06:58:30,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin1 2024-04-22 06:58:30,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1075): Stored pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin1 2024-04-22 06:58:30,274 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-04-22 06:58:30,275 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=34, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-04-22 06:58:30,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-04-22 06:58:30,280 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/default/TestQuotaAdmin1/4de96e5ccfebd759d7a5eb735f57e289 2024-04-22 06:58:30,283 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/default/TestQuotaAdmin1/4de96e5ccfebd759d7a5eb735f57e289/cf, FileablePath, hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/default/TestQuotaAdmin1/4de96e5ccfebd759d7a5eb735f57e289/recovered.edits] 2024-04-22 06:58:30,292 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/default/TestQuotaAdmin1/4de96e5ccfebd759d7a5eb735f57e289/recovered.edits/4.seqid to hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/archive/data/default/TestQuotaAdmin1/4de96e5ccfebd759d7a5eb735f57e289/recovered.edits/4.seqid 2024-04-22 06:58:30,293 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/default/TestQuotaAdmin1/4de96e5ccfebd759d7a5eb735f57e289 2024-04-22 06:58:30,293 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-04-22 06:58:30,297 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=34, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-04-22 06:58:30,299 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin1 from hbase:meta 2024-04-22 06:58:30,302 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin1' descriptor. 2024-04-22 06:58:30,303 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=34, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-04-22 06:58:30,303 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin1' from region states. 2024-04-22 06:58:30,303 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1,,1713769046911.4de96e5ccfebd759d7a5eb735f57e289.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1713769110303"}]},"ts":"9223372036854775807"} 2024-04-22 06:58:30,305 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-04-22 06:58:30,305 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 4de96e5ccfebd759d7a5eb735f57e289, NAME => 'TestQuotaAdmin1,,1713769046911.4de96e5ccfebd759d7a5eb735f57e289.', STARTKEY => '', ENDKEY => ''}] 2024-04-22 06:58:30,305 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin1' as deleted. 2024-04-22 06:58:30,305 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1713769110305"}]},"ts":"9223372036854775807"} 2024-04-22 06:58:30,307 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin1 state from META 2024-04-22 06:58:30,310 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=34, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-04-22 06:58:30,312 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=34, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin1 in 39 msec 2024-04-22 06:58:30,528 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-04-22 06:58:30,529 INFO [Listener at localhost/40363] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin1, procId: 34 completed 2024-04-22 06:58:30,529 INFO [Listener at localhost/40363] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin2 2024-04-22 06:58:30,530 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin2 2024-04-22 06:58:30,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1075): Stored pid=35, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin2 2024-04-22 06:58:30,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-04-22 06:58:30,535 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713769110535"}]},"ts":"1713769110535"} 2024-04-22 06:58:30,536 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLING in hbase:meta 2024-04-22 06:58:30,539 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set TestQuotaAdmin2 to state=DISABLING 2024-04-22 06:58:30,540 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=d28f954b31070c84a412ba4a62e1909e, UNASSIGN}] 2024-04-22 06:58:30,541 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=d28f954b31070c84a412ba4a62e1909e, UNASSIGN 2024-04-22 06:58:30,541 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=d28f954b31070c84a412ba4a62e1909e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41835,1713769042782 2024-04-22 06:58:30,542 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1713769047690.d28f954b31070c84a412ba4a62e1909e.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713769110541"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713769110541"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713769110541"}]},"ts":"1713769110541"} 2024-04-22 06:58:30,543 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; CloseRegionProcedure d28f954b31070c84a412ba4a62e1909e, server=jenkins-hbase4.apache.org,41835,1713769042782}] 2024-04-22 06:58:30,695 DEBUG [RSProcedureDispatcher-pool-5] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,41835,1713769042782 2024-04-22 06:58:30,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d28f954b31070c84a412ba4a62e1909e 2024-04-22 06:58:30,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d28f954b31070c84a412ba4a62e1909e, disabling compactions & flushes 2024-04-22 06:58:30,697 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1713769047690.d28f954b31070c84a412ba4a62e1909e. 2024-04-22 06:58:30,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1713769047690.d28f954b31070c84a412ba4a62e1909e. 2024-04-22 06:58:30,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1713769047690.d28f954b31070c84a412ba4a62e1909e. after waiting 0 ms 2024-04-22 06:58:30,697 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1713769047690.d28f954b31070c84a412ba4a62e1909e. 2024-04-22 06:58:30,705 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/default/TestQuotaAdmin2/d28f954b31070c84a412ba4a62e1909e/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-04-22 06:58:30,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1713769047690.d28f954b31070c84a412ba4a62e1909e. 2024-04-22 06:58:30,706 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d28f954b31070c84a412ba4a62e1909e: 2024-04-22 06:58:30,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d28f954b31070c84a412ba4a62e1909e 2024-04-22 06:58:30,709 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=d28f954b31070c84a412ba4a62e1909e, regionState=CLOSED 2024-04-22 06:58:30,709 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1713769047690.d28f954b31070c84a412ba4a62e1909e.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713769110709"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713769110709"}]},"ts":"1713769110709"} 2024-04-22 06:58:30,713 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=37, resume processing ppid=36 2024-04-22 06:58:30,713 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=37, ppid=36, state=SUCCESS; CloseRegionProcedure d28f954b31070c84a412ba4a62e1909e, server=jenkins-hbase4.apache.org,41835,1713769042782 in 168 msec 2024-04-22 06:58:30,715 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=36, resume processing ppid=35 2024-04-22 06:58:30,715 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=d28f954b31070c84a412ba4a62e1909e, UNASSIGN in 173 msec 2024-04-22 06:58:30,716 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713769110716"}]},"ts":"1713769110716"} 2024-04-22 06:58:30,717 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLED in hbase:meta 2024-04-22 06:58:30,720 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set TestQuotaAdmin2 to state=DISABLED 2024-04-22 06:58:30,722 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=35, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin2 in 190 msec 2024-04-22 06:58:30,786 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-04-22 06:58:30,786 INFO [Listener at localhost/40363] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin2, procId: 35 completed 2024-04-22 06:58:30,787 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin2 2024-04-22 06:58:30,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1075): Stored pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin2 2024-04-22 06:58:30,791 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-04-22 06:58:30,792 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=38, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-04-22 06:58:30,794 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-04-22 06:58:30,797 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/default/TestQuotaAdmin2/d28f954b31070c84a412ba4a62e1909e 2024-04-22 06:58:30,800 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/default/TestQuotaAdmin2/d28f954b31070c84a412ba4a62e1909e/cf, FileablePath, hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/default/TestQuotaAdmin2/d28f954b31070c84a412ba4a62e1909e/recovered.edits] 2024-04-22 06:58:30,807 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/default/TestQuotaAdmin2/d28f954b31070c84a412ba4a62e1909e/recovered.edits/4.seqid to hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/archive/data/default/TestQuotaAdmin2/d28f954b31070c84a412ba4a62e1909e/recovered.edits/4.seqid 2024-04-22 06:58:30,808 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/default/TestQuotaAdmin2/d28f954b31070c84a412ba4a62e1909e 2024-04-22 06:58:30,808 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-04-22 06:58:30,811 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=38, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-04-22 06:58:30,813 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin2 from hbase:meta 2024-04-22 06:58:30,815 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin2' descriptor. 2024-04-22 06:58:30,816 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=38, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-04-22 06:58:30,816 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin2' from region states. 2024-04-22 06:58:30,816 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2,,1713769047690.d28f954b31070c84a412ba4a62e1909e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1713769110816"}]},"ts":"9223372036854775807"} 2024-04-22 06:58:30,818 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-04-22 06:58:30,818 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d28f954b31070c84a412ba4a62e1909e, NAME => 'TestQuotaAdmin2,,1713769047690.d28f954b31070c84a412ba4a62e1909e.', STARTKEY => '', ENDKEY => ''}] 2024-04-22 06:58:30,818 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin2' as deleted. 2024-04-22 06:58:30,818 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1713769110818"}]},"ts":"9223372036854775807"} 2024-04-22 06:58:30,819 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin2 state from META 2024-04-22 06:58:30,822 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=38, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-04-22 06:58:30,823 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=38, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin2 in 35 msec 2024-04-22 06:58:31,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-04-22 06:58:31,046 INFO [Listener at localhost/40363] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin2, procId: 38 completed 2024-04-22 06:58:31,046 INFO [Listener at localhost/40363] client.HBaseAdmin$15(890): Started disable of TestNs:TestTable 2024-04-22 06:58:31,047 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestNs:TestTable 2024-04-22 06:58:31,048 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1075): Stored pid=39, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestNs:TestTable 2024-04-22 06:58:31,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-04-22 06:58:31,051 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713769111051"}]},"ts":"1713769111051"} 2024-04-22 06:58:31,053 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLING in hbase:meta 2024-04-22 06:58:31,055 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set TestNs:TestTable to state=DISABLING 2024-04-22 06:58:31,056 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=849a1b60a71b5d3ecd3f1929cc1d4c66, UNASSIGN}, {pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=f34bedc38eed6db7727bae6d7a55585c, UNASSIGN}] 2024-04-22 06:58:31,057 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=849a1b60a71b5d3ecd3f1929cc1d4c66, UNASSIGN 2024-04-22 06:58:31,057 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=f34bedc38eed6db7727bae6d7a55585c, UNASSIGN 2024-04-22 06:58:31,058 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=849a1b60a71b5d3ecd3f1929cc1d4c66, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43163,1713769042831 2024-04-22 06:58:31,058 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=f34bedc38eed6db7727bae6d7a55585c, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,41835,1713769042782 2024-04-22 06:58:31,058 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1713769048743.849a1b60a71b5d3ecd3f1929cc1d4c66.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713769111058"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713769111058"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713769111058"}]},"ts":"1713769111058"} 2024-04-22 06:58:31,058 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1713769048743.f34bedc38eed6db7727bae6d7a55585c.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713769111058"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713769111058"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713769111058"}]},"ts":"1713769111058"} 2024-04-22 06:58:31,060 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=42, ppid=40, state=RUNNABLE; CloseRegionProcedure 849a1b60a71b5d3ecd3f1929cc1d4c66, server=jenkins-hbase4.apache.org,43163,1713769042831}] 2024-04-22 06:58:31,061 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=43, ppid=41, state=RUNNABLE; CloseRegionProcedure f34bedc38eed6db7727bae6d7a55585c, server=jenkins-hbase4.apache.org,41835,1713769042782}] 2024-04-22 06:58:31,212 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,43163,1713769042831 2024-04-22 06:58:31,213 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 849a1b60a71b5d3ecd3f1929cc1d4c66 2024-04-22 06:58:31,213 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 849a1b60a71b5d3ecd3f1929cc1d4c66, disabling compactions & flushes 2024-04-22 06:58:31,213 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1713769048743.849a1b60a71b5d3ecd3f1929cc1d4c66. 2024-04-22 06:58:31,213 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,41835,1713769042782 2024-04-22 06:58:31,213 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1713769048743.849a1b60a71b5d3ecd3f1929cc1d4c66. 2024-04-22 06:58:31,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1713769048743.849a1b60a71b5d3ecd3f1929cc1d4c66. after waiting 0 ms 2024-04-22 06:58:31,214 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1713769048743.849a1b60a71b5d3ecd3f1929cc1d4c66. 2024-04-22 06:58:31,214 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f34bedc38eed6db7727bae6d7a55585c 2024-04-22 06:58:31,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f34bedc38eed6db7727bae6d7a55585c, disabling compactions & flushes 2024-04-22 06:58:31,215 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1713769048743.f34bedc38eed6db7727bae6d7a55585c. 2024-04-22 06:58:31,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1713769048743.f34bedc38eed6db7727bae6d7a55585c. 2024-04-22 06:58:31,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1713769048743.f34bedc38eed6db7727bae6d7a55585c. after waiting 0 ms 2024-04-22 06:58:31,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1713769048743.f34bedc38eed6db7727bae6d7a55585c. 2024-04-22 06:58:31,222 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/TestNs/TestTable/f34bedc38eed6db7727bae6d7a55585c/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-04-22 06:58:31,223 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1713769048743.f34bedc38eed6db7727bae6d7a55585c. 2024-04-22 06:58:31,223 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f34bedc38eed6db7727bae6d7a55585c: 2024-04-22 06:58:31,225 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/TestNs/TestTable/849a1b60a71b5d3ecd3f1929cc1d4c66/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-04-22 06:58:31,225 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f34bedc38eed6db7727bae6d7a55585c 2024-04-22 06:58:31,226 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1713769048743.849a1b60a71b5d3ecd3f1929cc1d4c66. 2024-04-22 06:58:31,226 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 849a1b60a71b5d3ecd3f1929cc1d4c66: 2024-04-22 06:58:31,226 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=f34bedc38eed6db7727bae6d7a55585c, regionState=CLOSED 2024-04-22 06:58:31,227 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1713769048743.f34bedc38eed6db7727bae6d7a55585c.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713769111226"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713769111226"}]},"ts":"1713769111226"} 2024-04-22 06:58:31,228 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 849a1b60a71b5d3ecd3f1929cc1d4c66 2024-04-22 06:58:31,229 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=849a1b60a71b5d3ecd3f1929cc1d4c66, regionState=CLOSED 2024-04-22 06:58:31,229 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,,1713769048743.849a1b60a71b5d3ecd3f1929cc1d4c66.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713769111229"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713769111229"}]},"ts":"1713769111229"} 2024-04-22 06:58:31,231 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=43, resume processing ppid=41 2024-04-22 06:58:31,232 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=43, ppid=41, state=SUCCESS; CloseRegionProcedure f34bedc38eed6db7727bae6d7a55585c, server=jenkins-hbase4.apache.org,41835,1713769042782 in 169 msec 2024-04-22 06:58:31,233 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=42, resume processing ppid=40 2024-04-22 06:58:31,233 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=42, ppid=40, state=SUCCESS; CloseRegionProcedure 849a1b60a71b5d3ecd3f1929cc1d4c66, server=jenkins-hbase4.apache.org,43163,1713769042831 in 171 msec 2024-04-22 06:58:31,234 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=41, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=f34bedc38eed6db7727bae6d7a55585c, UNASSIGN in 176 msec 2024-04-22 06:58:31,235 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=40, resume processing ppid=39 2024-04-22 06:58:31,235 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=849a1b60a71b5d3ecd3f1929cc1d4c66, UNASSIGN in 177 msec 2024-04-22 06:58:31,236 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713769111236"}]},"ts":"1713769111236"} 2024-04-22 06:58:31,237 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLED in hbase:meta 2024-04-22 06:58:31,240 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set TestNs:TestTable to state=DISABLED 2024-04-22 06:58:31,242 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=39, state=SUCCESS; DisableTableProcedure table=TestNs:TestTable in 194 msec 2024-04-22 06:58:31,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-04-22 06:58:31,303 INFO [Listener at localhost/40363] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: TestNs:TestTable, procId: 39 completed 2024-04-22 06:58:31,304 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestNs:TestTable 2024-04-22 06:58:31,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1075): Stored pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestNs:TestTable 2024-04-22 06:58:31,308 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-04-22 06:58:31,309 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=44, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-04-22 06:58:31,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-04-22 06:58:31,317 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/TestNs/TestTable/849a1b60a71b5d3ecd3f1929cc1d4c66 2024-04-22 06:58:31,317 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/TestNs/TestTable/f34bedc38eed6db7727bae6d7a55585c 2024-04-22 06:58:31,320 DEBUG [HFileArchiver-11] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/TestNs/TestTable/849a1b60a71b5d3ecd3f1929cc1d4c66/cf, FileablePath, hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/TestNs/TestTable/849a1b60a71b5d3ecd3f1929cc1d4c66/recovered.edits] 2024-04-22 06:58:31,320 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/TestNs/TestTable/f34bedc38eed6db7727bae6d7a55585c/cf, FileablePath, hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/TestNs/TestTable/f34bedc38eed6db7727bae6d7a55585c/recovered.edits] 2024-04-22 06:58:31,330 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/TestNs/TestTable/f34bedc38eed6db7727bae6d7a55585c/recovered.edits/4.seqid to hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/archive/data/TestNs/TestTable/f34bedc38eed6db7727bae6d7a55585c/recovered.edits/4.seqid 2024-04-22 06:58:31,331 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/TestNs/TestTable/f34bedc38eed6db7727bae6d7a55585c 2024-04-22 06:58:31,332 DEBUG [HFileArchiver-11] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/TestNs/TestTable/849a1b60a71b5d3ecd3f1929cc1d4c66/recovered.edits/4.seqid to hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/archive/data/TestNs/TestTable/849a1b60a71b5d3ecd3f1929cc1d4c66/recovered.edits/4.seqid 2024-04-22 06:58:31,332 DEBUG [HFileArchiver-11] backup.HFileArchiver(596): Deleted hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/.tmp/data/TestNs/TestTable/849a1b60a71b5d3ecd3f1929cc1d4c66 2024-04-22 06:58:31,333 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-04-22 06:58:31,336 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=44, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-04-22 06:58:31,338 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of TestNs:TestTable from hbase:meta 2024-04-22 06:58:31,340 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'TestNs:TestTable' descriptor. 2024-04-22 06:58:31,342 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=44, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-04-22 06:58:31,342 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'TestNs:TestTable' from region states. 2024-04-22 06:58:31,342 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,,1713769048743.849a1b60a71b5d3ecd3f1929cc1d4c66.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1713769111342"}]},"ts":"9223372036854775807"} 2024-04-22 06:58:31,342 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,1,1713769048743.f34bedc38eed6db7727bae6d7a55585c.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1713769111342"}]},"ts":"9223372036854775807"} 2024-04-22 06:58:31,344 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2024-04-22 06:58:31,345 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 849a1b60a71b5d3ecd3f1929cc1d4c66, NAME => 'TestNs:TestTable,,1713769048743.849a1b60a71b5d3ecd3f1929cc1d4c66.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f34bedc38eed6db7727bae6d7a55585c, NAME => 'TestNs:TestTable,1,1713769048743.f34bedc38eed6db7727bae6d7a55585c.', STARTKEY => '1', ENDKEY => ''}] 2024-04-22 06:58:31,345 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'TestNs:TestTable' as deleted. 2024-04-22 06:58:31,345 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1713769111345"}]},"ts":"9223372036854775807"} 2024-04-22 06:58:31,347 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table TestNs:TestTable state from META 2024-04-22 06:58:31,350 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=44, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-04-22 06:58:31,352 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=44, state=SUCCESS; DeleteTableProcedure table=TestNs:TestTable in 46 msec 2024-04-22 06:58:31,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-04-22 06:58:31,563 INFO [Listener at localhost/40363] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: TestNs:TestTable, procId: 44 completed 2024-04-22 06:58:31,568 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.HMaster$17(3092): Client=jenkins//172.31.14.131 delete TestNs 2024-04-22 06:58:31,574 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] procedure2.ProcedureExecutor(1075): Stored pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE; DeleteNamespaceProcedure, namespace=TestNs 2024-04-22 06:58:31,576 INFO [PEWorker-1] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-04-22 06:58:31,579 INFO [PEWorker-1] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_FROM_NS_TABLE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-04-22 06:58:31,581 INFO [PEWorker-1] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_FROM_ZK, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-04-22 06:58:31,582 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-04-22 06:58:31,583 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace/TestNs 2024-04-22 06:58:31,583 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-04-22 06:58:31,584 INFO [PEWorker-1] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_DIRECTORIES, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-04-22 06:58:31,586 INFO [PEWorker-1] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_NAMESPACE_QUOTA, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-04-22 06:58:31,587 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=45, state=SUCCESS; DeleteNamespaceProcedure, namespace=TestNs in 18 msec 2024-04-22 06:58:31,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=46823] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-04-22 06:58:31,833 INFO [Listener at localhost/40363] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2024-04-22 06:58:31,833 INFO [Listener at localhost/40363] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-04-22 06:58:31,834 DEBUG [Listener at localhost/40363] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2921a0a0 to 127.0.0.1:56669 2024-04-22 06:58:31,834 DEBUG [Listener at localhost/40363] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-22 06:58:31,834 DEBUG [Listener at localhost/40363] util.JVMClusterUtil(237): Shutting down HBase Cluster 2024-04-22 06:58:31,834 DEBUG [Listener at localhost/40363] util.JVMClusterUtil(257): Found active master hash=747252101, stopped=false 2024-04-22 06:58:31,835 DEBUG [Listener at localhost/40363] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-04-22 06:58:31,835 INFO [Listener at localhost/40363] master.ServerManager(904): Cluster shutdown requested of master=jenkins-hbase4.apache.org,46823,1713769041522 2024-04-22 06:58:31,837 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): regionserver:41835-0x10129f912600001, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-04-22 06:58:31,837 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-04-22 06:58:31,837 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): regionserver:43163-0x10129f912600002, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-04-22 06:58:31,837 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-22 06:58:31,838 INFO [Listener at localhost/40363] procedure2.ProcedureExecutor(675): Stopping 2024-04-22 06:58:31,838 DEBUG [Listener at localhost/40363] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x260b560d to 127.0.0.1:56669 2024-04-22 06:58:31,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-04-22 06:58:31,838 DEBUG [Listener at localhost/40363] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-22 06:58:31,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:41835-0x10129f912600001, quorum=127.0.0.1:56669, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-04-22 06:58:31,839 INFO [Listener at localhost/40363] regionserver.HRegionServer(2306): ***** STOPPING region server 'jenkins-hbase4.apache.org,41835,1713769042782' ***** 2024-04-22 06:58:31,839 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:43163-0x10129f912600002, quorum=127.0.0.1:56669, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-04-22 06:58:31,839 INFO [Listener at localhost/40363] regionserver.HRegionServer(2320): STOPPED: Shutdown requested 2024-04-22 06:58:31,839 INFO [Listener at localhost/40363] regionserver.HRegionServer(2306): ***** STOPPING region server 'jenkins-hbase4.apache.org,43163,1713769042831' ***** 2024-04-22 06:58:31,839 INFO [Listener at localhost/40363] regionserver.HRegionServer(2320): STOPPED: Shutdown requested 2024-04-22 06:58:31,839 INFO [RS:0;jenkins-hbase4:41835] regionserver.HeapMemoryManager(220): Stopping 2024-04-22 06:58:31,839 INFO [RS:1;jenkins-hbase4:43163] regionserver.HeapMemoryManager(220): Stopping 2024-04-22 06:58:31,840 INFO [RS:0;jenkins-hbase4:41835] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-04-22 06:58:31,840 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-04-22 06:58:31,840 INFO [RS:0;jenkins-hbase4:41835] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-04-22 06:58:31,840 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-04-22 06:58:31,840 INFO [RS:1;jenkins-hbase4:43163] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-04-22 06:58:31,840 INFO [RS:0;jenkins-hbase4:41835] regionserver.HRegionServer(3314): Received CLOSE for 018780bee830aae71606868a2bdf615c 2024-04-22 06:58:31,840 INFO [RS:1;jenkins-hbase4:43163] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-04-22 06:58:31,840 INFO [RS:1;jenkins-hbase4:43163] regionserver.HRegionServer(1150): stopping server jenkins-hbase4.apache.org,43163,1713769042831 2024-04-22 06:58:31,840 INFO [RS:1;jenkins-hbase4:43163] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-04-22 06:58:31,840 DEBUG [RS:1;jenkins-hbase4:43163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x101d1cf6 to 127.0.0.1:56669 2024-04-22 06:58:31,840 DEBUG [RS:1;jenkins-hbase4:43163] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-22 06:58:31,840 INFO [RS:0;jenkins-hbase4:41835] regionserver.HRegionServer(3314): Received CLOSE for 4cd3ca96be98ad75577cdc42f7218a5f 2024-04-22 06:58:31,840 INFO [RS:1;jenkins-hbase4:43163] regionserver.HRegionServer(1176): stopping server jenkins-hbase4.apache.org,43163,1713769042831; all regions closed. 2024-04-22 06:58:31,841 INFO [RS:0;jenkins-hbase4:41835] regionserver.HRegionServer(1150): stopping server jenkins-hbase4.apache.org,41835,1713769042782 2024-04-22 06:58:31,841 INFO [RS:0;jenkins-hbase4:41835] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-04-22 06:58:31,841 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 018780bee830aae71606868a2bdf615c, disabling compactions & flushes 2024-04-22 06:58:31,841 DEBUG [RS:0;jenkins-hbase4:41835] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x220b8dcc to 127.0.0.1:56669 2024-04-22 06:58:31,841 DEBUG [RS:1;jenkins-hbase4:43163] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-04-22 06:58:31,841 DEBUG [RS:0;jenkins-hbase4:41835] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-22 06:58:31,841 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:quota,,1713769045483.018780bee830aae71606868a2bdf615c. 2024-04-22 06:58:31,842 INFO [RS:0;jenkins-hbase4:41835] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-04-22 06:58:31,842 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1713769045483.018780bee830aae71606868a2bdf615c. 2024-04-22 06:58:31,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1713769045483.018780bee830aae71606868a2bdf615c. after waiting 0 ms 2024-04-22 06:58:31,843 INFO [RS:0;jenkins-hbase4:41835] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-04-22 06:58:31,843 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1713769045483.018780bee830aae71606868a2bdf615c. 2024-04-22 06:58:31,843 INFO [RS:0;jenkins-hbase4:41835] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-04-22 06:58:31,843 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 018780bee830aae71606868a2bdf615c 2/2 column families, dataSize=726 B heapSize=2.44 KB 2024-04-22 06:58:31,843 INFO [RS:0;jenkins-hbase4:41835] regionserver.HRegionServer(3314): Received CLOSE for 1588230740 2024-04-22 06:58:31,844 INFO [RS:0;jenkins-hbase4:41835] regionserver.HRegionServer(1480): Waiting on 3 regions to close 2024-04-22 06:58:31,844 DEBUG [RS:0;jenkins-hbase4:41835] regionserver.HRegionServer(1484): Online Regions={018780bee830aae71606868a2bdf615c=hbase:quota,,1713769045483.018780bee830aae71606868a2bdf615c., 1588230740=hbase:meta,,1.1588230740, 4cd3ca96be98ad75577cdc42f7218a5f=hbase:namespace,,1713769044759.4cd3ca96be98ad75577cdc42f7218a5f.} 2024-04-22 06:58:31,845 DEBUG [RS:0;jenkins-hbase4:41835] regionserver.HRegionServer(1510): Waiting on 018780bee830aae71606868a2bdf615c, 1588230740, 4cd3ca96be98ad75577cdc42f7218a5f 2024-04-22 06:58:31,846 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-04-22 06:58:31,846 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-04-22 06:58:31,846 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-04-22 06:58:31,846 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-04-22 06:58:31,846 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-04-22 06:58:31,847 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=14.15 KB heapSize=25.10 KB 2024-04-22 06:58:31,858 DEBUG [RS:1;jenkins-hbase4:43163] wal.AbstractFSWAL(1030): Moved 1 WAL file(s) to /user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/oldWALs 2024-04-22 06:58:31,858 INFO [RS:1;jenkins-hbase4:43163] wal.AbstractFSWAL(1033): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43163%2C1713769042831:(num 1713769044303) 2024-04-22 06:58:31,858 DEBUG [RS:1;jenkins-hbase4:43163] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-22 06:58:31,858 INFO [RS:1;jenkins-hbase4:43163] regionserver.LeaseManager(133): Closed leases 2024-04-22 06:58:31,859 INFO [RS:1;jenkins-hbase4:43163] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2024-04-22 06:58:31,859 INFO [RS:1;jenkins-hbase4:43163] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-04-22 06:58:31,859 INFO [RS:1;jenkins-hbase4:43163] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-04-22 06:58:31,859 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-04-22 06:58:31,859 INFO [RS:1;jenkins-hbase4:43163] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-04-22 06:58:31,860 INFO [RS:1;jenkins-hbase4:43163] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43163 2024-04-22 06:58:31,868 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): regionserver:41835-0x10129f912600001, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43163,1713769042831 2024-04-22 06:58:31,868 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): regionserver:41835-0x10129f912600001, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-04-22 06:58:31,868 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): regionserver:43163-0x10129f912600002, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43163,1713769042831 2024-04-22 06:58:31,868 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): regionserver:43163-0x10129f912600002, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-04-22 06:58:31,868 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-04-22 06:58:31,870 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43163,1713769042831] 2024-04-22 06:58:31,870 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43163,1713769042831; numProcessing=1 2024-04-22 06:58:31,872 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43163,1713769042831 already deleted, retry=false 2024-04-22 06:58:31,872 INFO [RegionServerTracker-0] master.ServerManager(570): Cluster shutdown set; jenkins-hbase4.apache.org,43163,1713769042831 expired; onlineServers=1 2024-04-22 06:58:31,878 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-04-22 06:58:31,879 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-04-22 06:58:31,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=597 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/quota/018780bee830aae71606868a2bdf615c/.tmp/q/99a003242d2a420bbe02f7602388d350 2024-04-22 06:58:31,888 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=12.16 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/meta/1588230740/.tmp/info/eb96dedd6ec944c8a90b7f4f8f1fc59c 2024-04-22 06:58:31,898 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 99a003242d2a420bbe02f7602388d350 2024-04-22 06:58:31,899 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eb96dedd6ec944c8a90b7f4f8f1fc59c 2024-04-22 06:58:31,917 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=129 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/quota/018780bee830aae71606868a2bdf615c/.tmp/u/6a9094c4448b41009505b3a208766858 2024-04-22 06:58:31,921 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=478 B at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/meta/1588230740/.tmp/rep_barrier/4e9a73968a2848b8ab528dbe0b82d868 2024-04-22 06:58:31,930 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a9094c4448b41009505b3a208766858 2024-04-22 06:58:31,930 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4e9a73968a2848b8ab528dbe0b82d868 2024-04-22 06:58:31,931 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/quota/018780bee830aae71606868a2bdf615c/.tmp/q/99a003242d2a420bbe02f7602388d350 as hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/quota/018780bee830aae71606868a2bdf615c/q/99a003242d2a420bbe02f7602388d350 2024-04-22 06:58:31,943 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 99a003242d2a420bbe02f7602388d350 2024-04-22 06:58:31,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/quota/018780bee830aae71606868a2bdf615c/q/99a003242d2a420bbe02f7602388d350, entries=5, sequenceid=17, filesize=5.1 K 2024-04-22 06:58:31,946 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.53 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/meta/1588230740/.tmp/table/a21d96417ead4868ac26b3202db927c2 2024-04-22 06:58:31,946 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/quota/018780bee830aae71606868a2bdf615c/.tmp/u/6a9094c4448b41009505b3a208766858 as hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/quota/018780bee830aae71606868a2bdf615c/u/6a9094c4448b41009505b3a208766858 2024-04-22 06:58:31,954 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a21d96417ead4868ac26b3202db927c2 2024-04-22 06:58:31,956 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/meta/1588230740/.tmp/info/eb96dedd6ec944c8a90b7f4f8f1fc59c as hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/meta/1588230740/info/eb96dedd6ec944c8a90b7f4f8f1fc59c 2024-04-22 06:58:31,956 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a9094c4448b41009505b3a208766858 2024-04-22 06:58:31,956 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/quota/018780bee830aae71606868a2bdf615c/u/6a9094c4448b41009505b3a208766858, entries=4, sequenceid=17, filesize=5.0 K 2024-04-22 06:58:31,957 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~726 B/726, heapSize ~2.41 KB/2464, currentSize=0 B/0 for 018780bee830aae71606868a2bdf615c in 114ms, sequenceid=17, compaction requested=false 2024-04-22 06:58:31,965 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/quota/018780bee830aae71606868a2bdf615c/recovered.edits/20.seqid, newMaxSeqId=20, maxSeqId=1 2024-04-22 06:58:31,966 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:quota,,1713769045483.018780bee830aae71606868a2bdf615c. 2024-04-22 06:58:31,966 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 018780bee830aae71606868a2bdf615c: 2024-04-22 06:58:31,967 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eb96dedd6ec944c8a90b7f4f8f1fc59c 2024-04-22 06:58:31,967 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:quota,,1713769045483.018780bee830aae71606868a2bdf615c. 2024-04-22 06:58:31,967 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/meta/1588230740/info/eb96dedd6ec944c8a90b7f4f8f1fc59c, entries=30, sequenceid=66, filesize=8.0 K 2024-04-22 06:58:31,968 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/meta/1588230740/.tmp/rep_barrier/4e9a73968a2848b8ab528dbe0b82d868 as hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/meta/1588230740/rep_barrier/4e9a73968a2848b8ab528dbe0b82d868 2024-04-22 06:58:31,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 4cd3ca96be98ad75577cdc42f7218a5f, disabling compactions & flushes 2024-04-22 06:58:31,969 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1713769044759.4cd3ca96be98ad75577cdc42f7218a5f. 2024-04-22 06:58:31,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1713769044759.4cd3ca96be98ad75577cdc42f7218a5f. 2024-04-22 06:58:31,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1713769044759.4cd3ca96be98ad75577cdc42f7218a5f. after waiting 0 ms 2024-04-22 06:58:31,969 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1713769044759.4cd3ca96be98ad75577cdc42f7218a5f. 2024-04-22 06:58:31,969 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 4cd3ca96be98ad75577cdc42f7218a5f 1/1 column families, dataSize=147 B heapSize=704 B 2024-04-22 06:58:31,970 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): regionserver:43163-0x10129f912600002, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-04-22 06:58:31,970 INFO [RS:1;jenkins-hbase4:43163] regionserver.HRegionServer(1233): Exiting; stopping=jenkins-hbase4.apache.org,43163,1713769042831; zookeeper connection closed. 2024-04-22 06:58:31,970 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): regionserver:43163-0x10129f912600002, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-04-22 06:58:31,971 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@76f5c2dd] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@76f5c2dd 2024-04-22 06:58:31,982 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4e9a73968a2848b8ab528dbe0b82d868 2024-04-22 06:58:31,982 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/meta/1588230740/rep_barrier/4e9a73968a2848b8ab528dbe0b82d868, entries=5, sequenceid=66, filesize=5.3 K 2024-04-22 06:58:31,984 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/meta/1588230740/.tmp/table/a21d96417ead4868ac26b3202db927c2 as hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/meta/1588230740/table/a21d96417ead4868ac26b3202db927c2 2024-04-22 06:58:31,995 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=147 B at sequenceid=8 (bloomFilter=true), to=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/namespace/4cd3ca96be98ad75577cdc42f7218a5f/.tmp/info/6a8a7001e0d2496a94133688e0ddb58a 2024-04-22 06:58:31,995 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a21d96417ead4868ac26b3202db927c2 2024-04-22 06:58:31,995 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/meta/1588230740/table/a21d96417ead4868ac26b3202db927c2, entries=13, sequenceid=66, filesize=5.6 K 2024-04-22 06:58:31,996 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~14.15 KB/14494, heapSize ~25.05 KB/25656, currentSize=0 B/0 for 1588230740 in 150ms, sequenceid=66, compaction requested=false 2024-04-22 06:58:32,004 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/meta/1588230740/recovered.edits/69.seqid, newMaxSeqId=69, maxSeqId=1 2024-04-22 06:58:32,005 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a8a7001e0d2496a94133688e0ddb58a 2024-04-22 06:58:32,005 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-04-22 06:58:32,006 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-04-22 06:58:32,006 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-04-22 06:58:32,006 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2024-04-22 06:58:32,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/namespace/4cd3ca96be98ad75577cdc42f7218a5f/.tmp/info/6a8a7001e0d2496a94133688e0ddb58a as hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/namespace/4cd3ca96be98ad75577cdc42f7218a5f/info/6a8a7001e0d2496a94133688e0ddb58a 2024-04-22 06:58:32,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6a8a7001e0d2496a94133688e0ddb58a 2024-04-22 06:58:32,014 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/namespace/4cd3ca96be98ad75577cdc42f7218a5f/info/6a8a7001e0d2496a94133688e0ddb58a, entries=3, sequenceid=8, filesize=5.0 K 2024-04-22 06:58:32,015 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~147 B/147, heapSize ~688 B/688, currentSize=0 B/0 for 4cd3ca96be98ad75577cdc42f7218a5f in 46ms, sequenceid=8, compaction requested=false 2024-04-22 06:58:32,022 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/data/hbase/namespace/4cd3ca96be98ad75577cdc42f7218a5f/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=1 2024-04-22 06:58:32,023 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1713769044759.4cd3ca96be98ad75577cdc42f7218a5f. 2024-04-22 06:58:32,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 4cd3ca96be98ad75577cdc42f7218a5f: 2024-04-22 06:58:32,023 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1713769044759.4cd3ca96be98ad75577cdc42f7218a5f. 2024-04-22 06:58:32,045 INFO [RS:0;jenkins-hbase4:41835] regionserver.HRegionServer(1176): stopping server jenkins-hbase4.apache.org,41835,1713769042782; all regions closed. 2024-04-22 06:58:32,046 DEBUG [RS:0;jenkins-hbase4:41835] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-04-22 06:58:32,050 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/WALs/jenkins-hbase4.apache.org,41835,1713769042782/jenkins-hbase4.apache.org%2C41835%2C1713769042782.meta.1713769044482.meta not finished, retry = 0 2024-04-22 06:58:32,154 DEBUG [RS:0;jenkins-hbase4:41835] wal.AbstractFSWAL(1030): Moved 1 WAL file(s) to /user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/oldWALs 2024-04-22 06:58:32,154 INFO [RS:0;jenkins-hbase4:41835] wal.AbstractFSWAL(1033): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41835%2C1713769042782.meta:.meta(num 1713769044482) 2024-04-22 06:58:32,159 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2024-04-22 06:58:32,159 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2024-04-22 06:58:32,161 DEBUG [RS:0;jenkins-hbase4:41835] wal.AbstractFSWAL(1030): Moved 1 WAL file(s) to /user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/oldWALs 2024-04-22 06:58:32,161 INFO [RS:0;jenkins-hbase4:41835] wal.AbstractFSWAL(1033): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C41835%2C1713769042782:(num 1713769044303) 2024-04-22 06:58:32,161 DEBUG [RS:0;jenkins-hbase4:41835] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-22 06:58:32,161 INFO [RS:0;jenkins-hbase4:41835] regionserver.LeaseManager(133): Closed leases 2024-04-22 06:58:32,162 INFO [RS:0;jenkins-hbase4:41835] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2024-04-22 06:58:32,162 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-04-22 06:58:32,163 INFO [RS:0;jenkins-hbase4:41835] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41835 2024-04-22 06:58:32,165 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): regionserver:41835-0x10129f912600001, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,41835,1713769042782 2024-04-22 06:58:32,165 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-04-22 06:58:32,166 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,41835,1713769042782] 2024-04-22 06:58:32,166 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,41835,1713769042782; numProcessing=2 2024-04-22 06:58:32,167 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,41835,1713769042782 already deleted, retry=false 2024-04-22 06:58:32,167 INFO [RegionServerTracker-0] master.ServerManager(570): Cluster shutdown set; jenkins-hbase4.apache.org,41835,1713769042782 expired; onlineServers=0 2024-04-22 06:58:32,167 INFO [RegionServerTracker-0] regionserver.HRegionServer(2306): ***** STOPPING region server 'jenkins-hbase4.apache.org,46823,1713769041522' ***** 2024-04-22 06:58:32,167 INFO [RegionServerTracker-0] regionserver.HRegionServer(2320): STOPPED: Cluster shutdown set; onlineServer=0 2024-04-22 06:58:32,168 DEBUG [M:0;jenkins-hbase4:46823] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@212b5d97, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-04-22 06:58:32,168 INFO [M:0;jenkins-hbase4:46823] regionserver.HRegionServer(1150): stopping server jenkins-hbase4.apache.org,46823,1713769041522 2024-04-22 06:58:32,168 INFO [M:0;jenkins-hbase4:46823] regionserver.HRegionServer(1176): stopping server jenkins-hbase4.apache.org,46823,1713769041522; all regions closed. 2024-04-22 06:58:32,168 DEBUG [M:0;jenkins-hbase4:46823] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-22 06:58:32,168 DEBUG [M:0;jenkins-hbase4:46823] cleaner.LogCleaner(198): Cancelling LogCleaner 2024-04-22 06:58:32,169 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2024-04-22 06:58:32,169 DEBUG [M:0;jenkins-hbase4:46823] cleaner.HFileCleaner(317): Stopping file delete threads 2024-04-22 06:58:32,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1713769043968] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1713769043968,5,FailOnTimeoutGroup] 2024-04-22 06:58:32,169 INFO [M:0;jenkins-hbase4:46823] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2024-04-22 06:58:32,169 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1713769043968] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1713769043968,5,FailOnTimeoutGroup] 2024-04-22 06:58:32,169 INFO [M:0;jenkins-hbase4:46823] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2024-04-22 06:58:32,169 INFO [M:0;jenkins-hbase4:46823] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS] on shutdown 2024-04-22 06:58:32,169 DEBUG [M:0;jenkins-hbase4:46823] master.HMaster(1517): Stopping service threads 2024-04-22 06:58:32,170 INFO [M:0;jenkins-hbase4:46823] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2024-04-22 06:58:32,170 ERROR [M:0;jenkins-hbase4:46823] procedure2.ProcedureExecutor(699): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-8,5,PEWorkerGroup] Thread[HFileArchiver-9,5,PEWorkerGroup] Thread[HFileArchiver-10,5,PEWorkerGroup] Thread[HFileArchiver-11,5,PEWorkerGroup] Thread[HFileArchiver-12,5,PEWorkerGroup] 2024-04-22 06:58:32,170 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2024-04-22 06:58:32,170 INFO [M:0;jenkins-hbase4:46823] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2024-04-22 06:58:32,170 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-22 06:58:32,170 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2024-04-22 06:58:32,171 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-04-22 06:58:32,171 DEBUG [M:0;jenkins-hbase4:46823] zookeeper.ZKUtil(399): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2024-04-22 06:58:32,171 WARN [M:0;jenkins-hbase4:46823] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2024-04-22 06:58:32,171 INFO [M:0;jenkins-hbase4:46823] assignment.AssignmentManager(315): Stopping assignment manager 2024-04-22 06:58:32,171 INFO [M:0;jenkins-hbase4:46823] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2024-04-22 06:58:32,172 DEBUG [M:0;jenkins-hbase4:46823] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-04-22 06:58:32,172 INFO [M:0;jenkins-hbase4:46823] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-22 06:58:32,172 DEBUG [M:0;jenkins-hbase4:46823] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-22 06:58:32,172 DEBUG [M:0;jenkins-hbase4:46823] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-04-22 06:58:32,172 DEBUG [M:0;jenkins-hbase4:46823] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-22 06:58:32,172 INFO [M:0;jenkins-hbase4:46823] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=152.95 KB heapSize=184.78 KB 2024-04-22 06:58:32,189 INFO [M:0;jenkins-hbase4:46823] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=152.95 KB at sequenceid=376 (bloomFilter=true), to=hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ce6ef5a5da0e497cad427340c9888591 2024-04-22 06:58:32,197 INFO [M:0;jenkins-hbase4:46823] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ce6ef5a5da0e497cad427340c9888591 2024-04-22 06:58:32,198 DEBUG [M:0;jenkins-hbase4:46823] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/ce6ef5a5da0e497cad427340c9888591 as hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ce6ef5a5da0e497cad427340c9888591 2024-04-22 06:58:32,205 INFO [M:0;jenkins-hbase4:46823] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ce6ef5a5da0e497cad427340c9888591 2024-04-22 06:58:32,206 INFO [M:0;jenkins-hbase4:46823] regionserver.HStore(1080): Added hdfs://localhost:38355/user/jenkins/test-data/bbea65c7-9baf-6a90-97a9-e275b19c2e3e/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/ce6ef5a5da0e497cad427340c9888591, entries=45, sequenceid=376, filesize=12.0 K 2024-04-22 06:58:32,206 INFO [M:0;jenkins-hbase4:46823] regionserver.HRegion(2948): Finished flush of dataSize ~152.95 KB/156617, heapSize ~184.77 KB/189200, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 34ms, sequenceid=376, compaction requested=false 2024-04-22 06:58:32,207 INFO [M:0;jenkins-hbase4:46823] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-22 06:58:32,208 DEBUG [M:0;jenkins-hbase4:46823] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-04-22 06:58:32,211 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-04-22 06:58:32,211 INFO [M:0;jenkins-hbase4:46823] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2024-04-22 06:58:32,212 INFO [M:0;jenkins-hbase4:46823] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:46823 2024-04-22 06:58:32,214 DEBUG [M:0;jenkins-hbase4:46823] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,46823,1713769041522 already deleted, retry=false 2024-04-22 06:58:32,267 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): regionserver:41835-0x10129f912600001, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-04-22 06:58:32,267 INFO [RS:0;jenkins-hbase4:41835] regionserver.HRegionServer(1233): Exiting; stopping=jenkins-hbase4.apache.org,41835,1713769042782; zookeeper connection closed. 2024-04-22 06:58:32,267 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): regionserver:41835-0x10129f912600001, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-04-22 06:58:32,267 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@6f803de2] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@6f803de2 2024-04-22 06:58:32,267 INFO [Listener at localhost/40363] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2024-04-22 06:58:32,316 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-04-22 06:58:32,316 INFO [M:0;jenkins-hbase4:46823] regionserver.HRegionServer(1233): Exiting; stopping=jenkins-hbase4.apache.org,46823,1713769041522; zookeeper connection closed. 2024-04-22 06:58:32,316 DEBUG [Listener at localhost/40363-EventThread] zookeeper.ZKWatcher(600): master:46823-0x10129f912600000, quorum=127.0.0.1:56669, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-04-22 06:58:32,317 WARN [Listener at localhost/40363] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-04-22 06:58:32,320 INFO [Listener at localhost/40363] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-04-22 06:58:32,350 WARN [BP-110732080-172.31.14.131-1713769038146 heartbeating to localhost/127.0.0.1:38355] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-110732080-172.31.14.131-1713769038146 (Datanode Uuid 931a37bd-a4c9-400a-aef0-39c8ad90d90a) service to localhost/127.0.0.1:38355 2024-04-22 06:58:32,352 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/cluster_6184197d-533f-d0b3-d2d4-ec91c7d097d1/dfs/data/data3/current/BP-110732080-172.31.14.131-1713769038146] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-04-22 06:58:32,352 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/cluster_6184197d-533f-d0b3-d2d4-ec91c7d097d1/dfs/data/data4/current/BP-110732080-172.31.14.131-1713769038146] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-04-22 06:58:32,428 WARN [Listener at localhost/40363] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-04-22 06:58:32,430 INFO [Listener at localhost/40363] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-04-22 06:58:32,534 WARN [BP-110732080-172.31.14.131-1713769038146 heartbeating to localhost/127.0.0.1:38355] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-04-22 06:58:32,534 WARN [BP-110732080-172.31.14.131-1713769038146 heartbeating to localhost/127.0.0.1:38355] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-110732080-172.31.14.131-1713769038146 (Datanode Uuid c7535ef9-18ba-46fb-b86c-81bbdf58de73) service to localhost/127.0.0.1:38355 2024-04-22 06:58:32,535 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/cluster_6184197d-533f-d0b3-d2d4-ec91c7d097d1/dfs/data/data1/current/BP-110732080-172.31.14.131-1713769038146] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-04-22 06:58:32,536 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/373b7eae-d987-609c-af50-40afc49e4d8c/cluster_6184197d-533f-d0b3-d2d4-ec91c7d097d1/dfs/data/data2/current/BP-110732080-172.31.14.131-1713769038146] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-04-22 06:58:32,579 INFO [Listener at localhost/40363] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-04-22 06:58:32,695 INFO [Listener at localhost/40363] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2024-04-22 06:58:32,751 INFO [Listener at localhost/40363] hbase.HBaseTestingUtility(1293): Minicluster is down