2024-02-21 09:54:35,330 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle timeout: 13 mins 2024-02-21 09:54:35,570 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95 2024-02-21 09:54:35,584 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2024-02-21 09:54:35,585 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/cluster_f849ae4e-dfee-f859-3d8b-dbe48ad6228b, deleteOnExit=true 2024-02-21 09:54:35,585 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2024-02-21 09:54:35,585 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/test.cache.data in system properties and HBase conf 2024-02-21 09:54:35,586 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/hadoop.tmp.dir in system properties and HBase conf 2024-02-21 09:54:35,586 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/hadoop.log.dir in system properties and HBase conf 2024-02-21 09:54:35,586 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/mapreduce.cluster.local.dir in system properties and HBase conf 2024-02-21 09:54:35,587 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/mapreduce.cluster.temp.dir in system properties and HBase conf 2024-02-21 09:54:35,587 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2024-02-21 09:54:35,708 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2024-02-21 09:54:36,091 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-02-21 09:54:36,096 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2024-02-21 09:54:36,096 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2024-02-21 09:54:36,097 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/yarn.nodemanager.log-dirs in system properties and HBase conf 2024-02-21 09:54:36,097 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-02-21 09:54:36,097 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2024-02-21 09:54:36,097 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2024-02-21 09:54:36,098 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-02-21 09:54:36,098 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/dfs.journalnode.edits.dir in system properties and HBase conf 2024-02-21 09:54:36,098 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2024-02-21 09:54:36,099 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/nfs.dump.dir in system properties and HBase conf 2024-02-21 09:54:36,099 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/java.io.tmpdir in system properties and HBase conf 2024-02-21 09:54:36,099 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/dfs.journalnode.edits.dir in system properties and HBase conf 2024-02-21 09:54:36,099 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2024-02-21 09:54:36,100 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2024-02-21 09:54:36,623 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-02-21 09:54:36,628 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-02-21 09:54:36,928 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2024-02-21 09:54:37,106 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2024-02-21 09:54:37,121 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-02-21 09:54:37,157 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2024-02-21 09:54:37,190 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/java.io.tmpdir/Jetty_localhost_38309_hdfs____.7ko2u7/webapp 2024-02-21 09:54:37,332 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38309 2024-02-21 09:54:37,342 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-02-21 09:54:37,342 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-02-21 09:54:37,911 WARN [Listener at localhost/44089] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-02-21 09:54:38,007 WARN [Listener at localhost/44089] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-02-21 09:54:38,033 WARN [Listener at localhost/44089] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-02-21 09:54:38,041 INFO [Listener at localhost/44089] log.Slf4jLog(67): jetty-6.1.26 2024-02-21 09:54:38,046 INFO [Listener at localhost/44089] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/java.io.tmpdir/Jetty_localhost_35255_datanode____3dbtlj/webapp 2024-02-21 09:54:38,143 INFO [Listener at localhost/44089] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35255 2024-02-21 09:54:38,458 WARN [Listener at localhost/43317] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-02-21 09:54:38,473 WARN [Listener at localhost/43317] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-02-21 09:54:38,476 WARN [Listener at localhost/43317] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-02-21 09:54:38,479 INFO [Listener at localhost/43317] log.Slf4jLog(67): jetty-6.1.26 2024-02-21 09:54:38,490 INFO [Listener at localhost/43317] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/java.io.tmpdir/Jetty_localhost_36525_datanode____nrx2sc/webapp 2024-02-21 09:54:38,599 INFO [Listener at localhost/43317] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:36525 2024-02-21 09:54:38,610 WARN [Listener at localhost/32959] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-02-21 09:54:38,919 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xaf6fc67721019672: Processing first storage report for DS-ae0c13f7-1221-4c2b-8014-ace1100715ac from datanode 2d434cc0-b682-4fa8-bcf5-9c348936ed42 2024-02-21 09:54:38,920 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xaf6fc67721019672: from storage DS-ae0c13f7-1221-4c2b-8014-ace1100715ac node DatanodeRegistration(127.0.0.1:40347, datanodeUuid=2d434cc0-b682-4fa8-bcf5-9c348936ed42, infoPort=36111, infoSecurePort=0, ipcPort=32959, storageInfo=lv=-57;cid=testClusterID;nsid=1308828257;c=1708509276708), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2024-02-21 09:54:38,921 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc5881f6a640cc7e5: Processing first storage report for DS-db83a33b-1af6-4dca-9032-f845cdfb16b9 from datanode 2df4423a-c073-4521-a348-7b9d8f679f3d 2024-02-21 09:54:38,921 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc5881f6a640cc7e5: from storage DS-db83a33b-1af6-4dca-9032-f845cdfb16b9 node DatanodeRegistration(127.0.0.1:44881, datanodeUuid=2df4423a-c073-4521-a348-7b9d8f679f3d, infoPort=33093, infoSecurePort=0, ipcPort=43317, storageInfo=lv=-57;cid=testClusterID;nsid=1308828257;c=1708509276708), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2024-02-21 09:54:38,921 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xaf6fc67721019672: Processing first storage report for DS-88598fb0-0a7d-4d6f-8cd4-da5d27cc3154 from datanode 2d434cc0-b682-4fa8-bcf5-9c348936ed42 2024-02-21 09:54:38,921 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xaf6fc67721019672: from storage DS-88598fb0-0a7d-4d6f-8cd4-da5d27cc3154 node DatanodeRegistration(127.0.0.1:40347, datanodeUuid=2d434cc0-b682-4fa8-bcf5-9c348936ed42, infoPort=36111, infoSecurePort=0, ipcPort=32959, storageInfo=lv=-57;cid=testClusterID;nsid=1308828257;c=1708509276708), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2024-02-21 09:54:38,921 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc5881f6a640cc7e5: Processing first storage report for DS-df3b1b77-5a78-47e7-808e-d93dbacd3d67 from datanode 2df4423a-c073-4521-a348-7b9d8f679f3d 2024-02-21 09:54:38,921 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc5881f6a640cc7e5: from storage DS-df3b1b77-5a78-47e7-808e-d93dbacd3d67 node DatanodeRegistration(127.0.0.1:44881, datanodeUuid=2df4423a-c073-4521-a348-7b9d8f679f3d, infoPort=33093, infoSecurePort=0, ipcPort=43317, storageInfo=lv=-57;cid=testClusterID;nsid=1308828257;c=1708509276708), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-02-21 09:54:39,051 DEBUG [Listener at localhost/32959] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95 2024-02-21 09:54:39,167 INFO [Listener at localhost/32959] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/cluster_f849ae4e-dfee-f859-3d8b-dbe48ad6228b/zookeeper_0, clientPort=64913, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/cluster_f849ae4e-dfee-f859-3d8b-dbe48ad6228b/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/cluster_f849ae4e-dfee-f859-3d8b-dbe48ad6228b/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2024-02-21 09:54:39,185 INFO [Listener at localhost/32959] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=64913 2024-02-21 09:54:39,196 INFO [Listener at localhost/32959] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-21 09:54:39,199 INFO [Listener at localhost/32959] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-21 09:54:39,907 INFO [Listener at localhost/32959] util.FSUtils(471): Created version file at hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f with version=8 2024-02-21 09:54:39,907 INFO [Listener at localhost/32959] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/hbase-staging 2024-02-21 09:54:40,236 INFO [Listener at localhost/32959] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2024-02-21 09:54:40,706 INFO [Listener at localhost/32959] client.ConnectionUtils(126): master/jenkins-hbase4:0 server-side Connection retries=45 2024-02-21 09:54:40,739 INFO [Listener at localhost/32959] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-02-21 09:54:40,740 INFO [Listener at localhost/32959] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-02-21 09:54:40,740 INFO [Listener at localhost/32959] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-02-21 09:54:40,740 INFO [Listener at localhost/32959] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-02-21 09:54:40,740 INFO [Listener at localhost/32959] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-02-21 09:54:40,890 INFO [Listener at localhost/32959] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2024-02-21 09:54:40,970 DEBUG [Listener at localhost/32959] util.ClassSize(228): Using Unsafe to estimate memory layout 2024-02-21 09:54:41,071 INFO [Listener at localhost/32959] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39319 2024-02-21 09:54:41,082 INFO [Listener at localhost/32959] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-21 09:54:41,085 INFO [Listener at localhost/32959] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-21 09:54:41,107 INFO [Listener at localhost/32959] zookeeper.RecoverableZooKeeper(93): Process identifier=master:39319 connecting to ZooKeeper ensemble=127.0.0.1:64913 2024-02-21 09:54:41,156 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:393190x0, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-02-21 09:54:41,158 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:39319-0x101e92697c90000 connected 2024-02-21 09:54:41,193 DEBUG [Listener at localhost/32959] zookeeper.ZKUtil(165): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-02-21 09:54:41,194 DEBUG [Listener at localhost/32959] zookeeper.ZKUtil(165): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-02-21 09:54:41,198 DEBUG [Listener at localhost/32959] zookeeper.ZKUtil(165): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-02-21 09:54:41,206 DEBUG [Listener at localhost/32959] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39319 2024-02-21 09:54:41,207 DEBUG [Listener at localhost/32959] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39319 2024-02-21 09:54:41,207 DEBUG [Listener at localhost/32959] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39319 2024-02-21 09:54:41,207 DEBUG [Listener at localhost/32959] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39319 2024-02-21 09:54:41,208 DEBUG [Listener at localhost/32959] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39319 2024-02-21 09:54:41,214 INFO [Listener at localhost/32959] master.HMaster(445): hbase.rootdir=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f, hbase.cluster.distributed=false 2024-02-21 09:54:41,284 INFO [Listener at localhost/32959] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-02-21 09:54:41,285 INFO [Listener at localhost/32959] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-02-21 09:54:41,285 INFO [Listener at localhost/32959] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-02-21 09:54:41,285 INFO [Listener at localhost/32959] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-02-21 09:54:41,285 INFO [Listener at localhost/32959] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-02-21 09:54:41,285 INFO [Listener at localhost/32959] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-02-21 09:54:41,290 INFO [Listener at localhost/32959] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-02-21 09:54:41,293 INFO [Listener at localhost/32959] ipc.NettyRpcServer(120): Bind to /172.31.14.131:42163 2024-02-21 09:54:41,296 INFO [Listener at localhost/32959] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-02-21 09:54:41,302 DEBUG [Listener at localhost/32959] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-02-21 09:54:41,304 INFO [Listener at localhost/32959] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-21 09:54:41,306 INFO [Listener at localhost/32959] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-21 09:54:41,308 INFO [Listener at localhost/32959] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:42163 connecting to ZooKeeper ensemble=127.0.0.1:64913 2024-02-21 09:54:41,313 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): regionserver:421630x0, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-02-21 09:54:41,314 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:42163-0x101e92697c90001 connected 2024-02-21 09:54:41,314 DEBUG [Listener at localhost/32959] zookeeper.ZKUtil(165): regionserver:42163-0x101e92697c90001, quorum=127.0.0.1:64913, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-02-21 09:54:41,316 DEBUG [Listener at localhost/32959] zookeeper.ZKUtil(165): regionserver:42163-0x101e92697c90001, quorum=127.0.0.1:64913, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-02-21 09:54:41,317 DEBUG [Listener at localhost/32959] zookeeper.ZKUtil(165): regionserver:42163-0x101e92697c90001, quorum=127.0.0.1:64913, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-02-21 09:54:41,318 DEBUG [Listener at localhost/32959] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=42163 2024-02-21 09:54:41,318 DEBUG [Listener at localhost/32959] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=42163 2024-02-21 09:54:41,318 DEBUG [Listener at localhost/32959] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=42163 2024-02-21 09:54:41,320 DEBUG [Listener at localhost/32959] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=42163 2024-02-21 09:54:41,321 DEBUG [Listener at localhost/32959] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=42163 2024-02-21 09:54:41,334 INFO [Listener at localhost/32959] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-02-21 09:54:41,334 INFO [Listener at localhost/32959] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-02-21 09:54:41,334 INFO [Listener at localhost/32959] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-02-21 09:54:41,334 INFO [Listener at localhost/32959] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-02-21 09:54:41,335 INFO [Listener at localhost/32959] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-02-21 09:54:41,335 INFO [Listener at localhost/32959] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-02-21 09:54:41,335 INFO [Listener at localhost/32959] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-02-21 09:54:41,337 INFO [Listener at localhost/32959] ipc.NettyRpcServer(120): Bind to /172.31.14.131:34401 2024-02-21 09:54:41,338 INFO [Listener at localhost/32959] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-02-21 09:54:41,339 DEBUG [Listener at localhost/32959] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-02-21 09:54:41,340 INFO [Listener at localhost/32959] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-21 09:54:41,344 INFO [Listener at localhost/32959] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-21 09:54:41,347 INFO [Listener at localhost/32959] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:34401 connecting to ZooKeeper ensemble=127.0.0.1:64913 2024-02-21 09:54:41,354 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): regionserver:344010x0, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-02-21 09:54:41,355 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:34401-0x101e92697c90002 connected 2024-02-21 09:54:41,355 DEBUG [Listener at localhost/32959] zookeeper.ZKUtil(165): regionserver:34401-0x101e92697c90002, quorum=127.0.0.1:64913, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-02-21 09:54:41,356 DEBUG [Listener at localhost/32959] zookeeper.ZKUtil(165): regionserver:34401-0x101e92697c90002, quorum=127.0.0.1:64913, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-02-21 09:54:41,357 DEBUG [Listener at localhost/32959] zookeeper.ZKUtil(165): regionserver:34401-0x101e92697c90002, quorum=127.0.0.1:64913, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-02-21 09:54:41,360 DEBUG [Listener at localhost/32959] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=34401 2024-02-21 09:54:41,360 DEBUG [Listener at localhost/32959] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=34401 2024-02-21 09:54:41,361 DEBUG [Listener at localhost/32959] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=34401 2024-02-21 09:54:41,361 DEBUG [Listener at localhost/32959] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=34401 2024-02-21 09:54:41,364 DEBUG [Listener at localhost/32959] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=34401 2024-02-21 09:54:41,366 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2174): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,39319,1708509280062 2024-02-21 09:54:41,376 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-02-21 09:54:41,378 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,39319,1708509280062 2024-02-21 09:54:41,399 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-02-21 09:54:41,399 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): regionserver:42163-0x101e92697c90001, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-02-21 09:54:41,399 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): regionserver:34401-0x101e92697c90002, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-02-21 09:54:41,399 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-21 09:54:41,402 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-02-21 09:54:41,403 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,39319,1708509280062 from backup master directory 2024-02-21 09:54:41,403 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(163): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-02-21 09:54:41,407 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,39319,1708509280062 2024-02-21 09:54:41,407 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-02-21 09:54:41,408 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-02-21 09:54:41,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,39319,1708509280062 2024-02-21 09:54:41,411 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2024-02-21 09:54:41,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2024-02-21 09:54:41,505 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/hbase.id with ID: 6e6055ca-1b79-4ddb-aad2-bcd8e0d736ea 2024-02-21 09:54:41,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-21 09:54:41,569 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-21 09:54:41,615 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5db7dbec to 127.0.0.1:64913 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-02-21 09:54:41,650 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@64fe499d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-02-21 09:54:41,674 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-02-21 09:54:41,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2024-02-21 09:54:41,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2024-02-21 09:54:41,697 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2024-02-21 09:54:41,699 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-02-21 09:54:41,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-02-21 09:54:41,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-02-21 09:54:41,740 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/MasterData/data/master/store-tmp 2024-02-21 09:54:41,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-21 09:54:41,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-02-21 09:54:41,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-21 09:54:41,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-21 09:54:41,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-02-21 09:54:41,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-21 09:54:41,777 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-21 09:54:41,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-02-21 09:54:41,779 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/MasterData/WALs/jenkins-hbase4.apache.org,39319,1708509280062 2024-02-21 09:54:41,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39319%2C1708509280062, suffix=, logDir=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/MasterData/WALs/jenkins-hbase4.apache.org,39319,1708509280062, archiveDir=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/MasterData/oldWALs, maxLogs=10 2024-02-21 09:54:41,864 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44881,DS-db83a33b-1af6-4dca-9032-f845cdfb16b9,DISK] 2024-02-21 09:54:41,864 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40347,DS-ae0c13f7-1221-4c2b-8014-ace1100715ac,DISK] 2024-02-21 09:54:41,873 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2024-02-21 09:54:41,953 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/MasterData/WALs/jenkins-hbase4.apache.org,39319,1708509280062/jenkins-hbase4.apache.org%2C39319%2C1708509280062.1708509281811 2024-02-21 09:54:41,954 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44881,DS-db83a33b-1af6-4dca-9032-f845cdfb16b9,DISK], DatanodeInfoWithStorage[127.0.0.1:40347,DS-ae0c13f7-1221-4c2b-8014-ace1100715ac,DISK]] 2024-02-21 09:54:41,955 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2024-02-21 09:54:41,956 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-21 09:54:41,959 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2024-02-21 09:54:41,960 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2024-02-21 09:54:42,021 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2024-02-21 09:54:42,030 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2024-02-21 09:54:42,055 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2024-02-21 09:54:42,068 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-21 09:54:42,073 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-02-21 09:54:42,075 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-02-21 09:54:42,091 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2024-02-21 09:54:42,096 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-21 09:54:42,098 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68466851, jitterRate=0.020235583186149597}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-02-21 09:54:42,098 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2024-02-21 09:54:42,099 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2024-02-21 09:54:42,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2024-02-21 09:54:42,120 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(608): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2024-02-21 09:54:42,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2024-02-21 09:54:42,125 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(628): Recovered RegionProcedureStore lease in 1 msec 2024-02-21 09:54:42,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(642): Loaded RegionProcedureStore in 34 msec 2024-02-21 09:54:42,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2024-02-21 09:54:42,186 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2024-02-21 09:54:42,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2024-02-21 09:54:42,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2024-02-21 09:54:42,221 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2024-02-21 09:54:42,222 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2024-02-21 09:54:42,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2024-02-21 09:54:42,232 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2024-02-21 09:54:42,236 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-21 09:54:42,237 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2024-02-21 09:54:42,238 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2024-02-21 09:54:42,253 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2024-02-21 09:54:42,259 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): regionserver:34401-0x101e92697c90002, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-02-21 09:54:42,259 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-02-21 09:54:42,259 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): regionserver:42163-0x101e92697c90001, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-02-21 09:54:42,260 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-21 09:54:42,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(745): Active/primary master=jenkins-hbase4.apache.org,39319,1708509280062, sessionid=0x101e92697c90000, setting cluster-up flag (Was=false) 2024-02-21 09:54:42,279 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-21 09:54:42,286 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2024-02-21 09:54:42,288 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39319,1708509280062 2024-02-21 09:54:42,293 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-21 09:54:42,300 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2024-02-21 09:54:42,302 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,39319,1708509280062 2024-02-21 09:54:42,305 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.hbase-snapshot/.tmp 2024-02-21 09:54:42,349 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver loaded, priority=536870911. 2024-02-21 09:54:42,369 INFO [RS:1;jenkins-hbase4:34401] regionserver.HRegionServer(954): ClusterId : 6e6055ca-1b79-4ddb-aad2-bcd8e0d736ea 2024-02-21 09:54:42,370 INFO [RS:0;jenkins-hbase4:42163] regionserver.HRegionServer(954): ClusterId : 6e6055ca-1b79-4ddb-aad2-bcd8e0d736ea 2024-02-21 09:54:42,375 DEBUG [RS:0;jenkins-hbase4:42163] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-02-21 09:54:42,375 DEBUG [RS:1;jenkins-hbase4:34401] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-02-21 09:54:42,382 DEBUG [RS:0;jenkins-hbase4:42163] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-02-21 09:54:42,382 DEBUG [RS:0;jenkins-hbase4:42163] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-02-21 09:54:42,382 DEBUG [RS:1;jenkins-hbase4:34401] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-02-21 09:54:42,382 DEBUG [RS:1;jenkins-hbase4:34401] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-02-21 09:54:42,386 DEBUG [RS:1;jenkins-hbase4:34401] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-02-21 09:54:42,386 DEBUG [RS:0;jenkins-hbase4:42163] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-02-21 09:54:42,389 DEBUG [RS:0;jenkins-hbase4:42163] zookeeper.ReadOnlyZKClient(139): Connect 0x4e1ecdc5 to 127.0.0.1:64913 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-02-21 09:54:42,389 DEBUG [RS:1;jenkins-hbase4:34401] zookeeper.ReadOnlyZKClient(139): Connect 0x21caf8ef to 127.0.0.1:64913 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-02-21 09:54:42,402 DEBUG [RS:1;jenkins-hbase4:34401] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f0d02a6, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-02-21 09:54:42,403 DEBUG [RS:1;jenkins-hbase4:34401] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2b32939f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-02-21 09:54:42,406 DEBUG [RS:0;jenkins-hbase4:42163] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@40d93a76, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-02-21 09:54:42,406 DEBUG [RS:0;jenkins-hbase4:42163] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44e6a6b5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-02-21 09:54:42,436 DEBUG [RS:1;jenkins-hbase4:34401] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:34401 2024-02-21 09:54:42,437 DEBUG [RS:0;jenkins-hbase4:42163] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:42163 2024-02-21 09:54:42,441 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2024-02-21 09:54:42,442 INFO [RS:1;jenkins-hbase4:34401] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-02-21 09:54:42,442 INFO [RS:0;jenkins-hbase4:42163] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-02-21 09:54:42,443 INFO [RS:0;jenkins-hbase4:42163] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-02-21 09:54:42,443 INFO [RS:1;jenkins-hbase4:34401] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-02-21 09:54:42,443 DEBUG [RS:0;jenkins-hbase4:42163] regionserver.HRegionServer(1025): About to register with Master. 2024-02-21 09:54:42,443 DEBUG [RS:1;jenkins-hbase4:34401] regionserver.HRegionServer(1025): About to register with Master. 2024-02-21 09:54:42,447 INFO [RS:0;jenkins-hbase4:42163] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase4.apache.org,39319,1708509280062 with isa=jenkins-hbase4.apache.org/172.31.14.131:42163, startcode=1708509281284 2024-02-21 09:54:42,447 INFO [RS:1;jenkins-hbase4:34401] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase4.apache.org,39319,1708509280062 with isa=jenkins-hbase4.apache.org/172.31.14.131:34401, startcode=1708509281333 2024-02-21 09:54:42,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-02-21 09:54:42,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-02-21 09:54:42,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-02-21 09:54:42,452 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-02-21 09:54:42,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2024-02-21 09:54:42,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-21 09:54:42,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-02-21 09:54:42,453 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-21 09:54:42,457 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1708509312457 2024-02-21 09:54:42,459 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2024-02-21 09:54:42,460 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2024-02-21 09:54:42,461 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2024-02-21 09:54:42,466 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-02-21 09:54:42,469 DEBUG [RS:0;jenkins-hbase4:42163] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-02-21 09:54:42,469 DEBUG [RS:1;jenkins-hbase4:34401] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-02-21 09:54:42,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2024-02-21 09:54:42,480 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2024-02-21 09:54:42,481 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2024-02-21 09:54:42,481 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2024-02-21 09:54:42,481 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2024-02-21 09:54:42,482 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:42,484 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2024-02-21 09:54:42,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2024-02-21 09:54:42,486 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2024-02-21 09:54:42,492 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2024-02-21 09:54:42,493 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2024-02-21 09:54:42,499 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1708509282495,5,FailOnTimeoutGroup] 2024-02-21 09:54:42,503 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1708509282502,5,FailOnTimeoutGroup] 2024-02-21 09:54:42,504 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:42,504 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1466): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2024-02-21 09:54:42,507 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:42,507 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:42,527 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-02-21 09:54:42,528 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-02-21 09:54:42,529 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f 2024-02-21 09:54:42,543 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35381, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2024-02-21 09:54:42,543 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35799, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2024-02-21 09:54:42,559 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39319] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,34401,1708509281333 2024-02-21 09:54:42,562 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-21 09:54:42,565 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-02-21 09:54:42,568 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/meta/1588230740/info 2024-02-21 09:54:42,569 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-02-21 09:54:42,571 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-21 09:54:42,571 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-02-21 09:54:42,573 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=39319] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,42163,1708509281284 2024-02-21 09:54:42,576 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/meta/1588230740/rep_barrier 2024-02-21 09:54:42,576 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-02-21 09:54:42,577 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-21 09:54:42,577 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-02-21 09:54:42,579 DEBUG [RS:0;jenkins-hbase4:42163] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f 2024-02-21 09:54:42,579 DEBUG [RS:1;jenkins-hbase4:34401] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f 2024-02-21 09:54:42,580 DEBUG [RS:0;jenkins-hbase4:42163] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:44089 2024-02-21 09:54:42,580 DEBUG [RS:1;jenkins-hbase4:34401] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:44089 2024-02-21 09:54:42,580 DEBUG [RS:0;jenkins-hbase4:42163] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-02-21 09:54:42,580 DEBUG [RS:1;jenkins-hbase4:34401] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-02-21 09:54:42,580 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/meta/1588230740/table 2024-02-21 09:54:42,581 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-02-21 09:54:42,582 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-21 09:54:42,584 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/meta/1588230740 2024-02-21 09:54:42,585 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/meta/1588230740 2024-02-21 09:54:42,588 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-02-21 09:54:42,589 DEBUG [RS:0;jenkins-hbase4:42163] zookeeper.ZKUtil(163): regionserver:42163-0x101e92697c90001, quorum=127.0.0.1:64913, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42163,1708509281284 2024-02-21 09:54:42,589 WARN [RS:0;jenkins-hbase4:42163] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-02-21 09:54:42,590 INFO [RS:0;jenkins-hbase4:42163] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-02-21 09:54:42,591 DEBUG [RS:0;jenkins-hbase4:42163] regionserver.HRegionServer(1950): logDir=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/WALs/jenkins-hbase4.apache.org,42163,1708509281284 2024-02-21 09:54:42,592 DEBUG [RS:1;jenkins-hbase4:34401] zookeeper.ZKUtil(163): regionserver:34401-0x101e92697c90002, quorum=127.0.0.1:64913, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34401,1708509281333 2024-02-21 09:54:42,593 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-02-21 09:54:42,592 WARN [RS:1;jenkins-hbase4:34401] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-02-21 09:54:42,593 INFO [RS:1;jenkins-hbase4:34401] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-02-21 09:54:42,594 DEBUG [RS:1;jenkins-hbase4:34401] regionserver.HRegionServer(1950): logDir=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/WALs/jenkins-hbase4.apache.org,34401,1708509281333 2024-02-21 09:54:42,595 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,34401,1708509281333] 2024-02-21 09:54:42,595 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,42163,1708509281284] 2024-02-21 09:54:42,597 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2024-02-21 09:54:42,603 DEBUG [RS:0;jenkins-hbase4:42163] zookeeper.ZKUtil(163): regionserver:42163-0x101e92697c90001, quorum=127.0.0.1:64913, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34401,1708509281333 2024-02-21 09:54:42,603 DEBUG [RS:1;jenkins-hbase4:34401] zookeeper.ZKUtil(163): regionserver:34401-0x101e92697c90002, quorum=127.0.0.1:64913, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,34401,1708509281333 2024-02-21 09:54:42,604 DEBUG [RS:0;jenkins-hbase4:42163] zookeeper.ZKUtil(163): regionserver:42163-0x101e92697c90001, quorum=127.0.0.1:64913, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42163,1708509281284 2024-02-21 09:54:42,604 DEBUG [RS:1;jenkins-hbase4:34401] zookeeper.ZKUtil(163): regionserver:34401-0x101e92697c90002, quorum=127.0.0.1:64913, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,42163,1708509281284 2024-02-21 09:54:42,609 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-21 09:54:42,610 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65260913, jitterRate=-0.02753661572933197}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-02-21 09:54:42,611 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2024-02-21 09:54:42,611 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-02-21 09:54:42,611 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-02-21 09:54:42,611 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-02-21 09:54:42,611 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-02-21 09:54:42,611 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-02-21 09:54:42,612 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-02-21 09:54:42,612 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-02-21 09:54:42,619 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2024-02-21 09:54:42,619 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2024-02-21 09:54:42,623 DEBUG [RS:1;jenkins-hbase4:34401] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-02-21 09:54:42,623 DEBUG [RS:0;jenkins-hbase4:42163] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-02-21 09:54:42,629 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2024-02-21 09:54:42,633 INFO [RS:1;jenkins-hbase4:34401] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-02-21 09:54:42,633 INFO [RS:0;jenkins-hbase4:42163] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-02-21 09:54:42,642 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2024-02-21 09:54:42,645 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2024-02-21 09:54:42,654 INFO [RS:1;jenkins-hbase4:34401] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-02-21 09:54:42,654 INFO [RS:0;jenkins-hbase4:42163] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-02-21 09:54:42,658 INFO [RS:0;jenkins-hbase4:42163] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-02-21 09:54:42,658 INFO [RS:1;jenkins-hbase4:34401] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-02-21 09:54:42,659 INFO [RS:0;jenkins-hbase4:42163] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:42,659 INFO [RS:1;jenkins-hbase4:34401] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:42,660 INFO [RS:0;jenkins-hbase4:42163] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-02-21 09:54:42,660 INFO [RS:1;jenkins-hbase4:34401] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-02-21 09:54:42,668 INFO [RS:1;jenkins-hbase4:34401] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:42,668 INFO [RS:0;jenkins-hbase4:42163] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:42,668 DEBUG [RS:1;jenkins-hbase4:34401] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-21 09:54:42,668 DEBUG [RS:0;jenkins-hbase4:42163] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-21 09:54:42,668 DEBUG [RS:1;jenkins-hbase4:34401] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-21 09:54:42,669 DEBUG [RS:0;jenkins-hbase4:42163] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-21 09:54:42,669 DEBUG [RS:1;jenkins-hbase4:34401] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-21 09:54:42,669 DEBUG [RS:0;jenkins-hbase4:42163] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-21 09:54:42,669 DEBUG [RS:1;jenkins-hbase4:34401] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-21 09:54:42,669 DEBUG [RS:0;jenkins-hbase4:42163] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-21 09:54:42,669 DEBUG [RS:1;jenkins-hbase4:34401] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-21 09:54:42,669 DEBUG [RS:0;jenkins-hbase4:42163] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-21 09:54:42,669 DEBUG [RS:1;jenkins-hbase4:34401] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-02-21 09:54:42,669 DEBUG [RS:0;jenkins-hbase4:42163] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-02-21 09:54:42,669 DEBUG [RS:1;jenkins-hbase4:34401] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-21 09:54:42,669 DEBUG [RS:0;jenkins-hbase4:42163] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-21 09:54:42,669 DEBUG [RS:1;jenkins-hbase4:34401] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-21 09:54:42,669 DEBUG [RS:0;jenkins-hbase4:42163] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-21 09:54:42,669 DEBUG [RS:1;jenkins-hbase4:34401] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-21 09:54:42,669 DEBUG [RS:0;jenkins-hbase4:42163] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-21 09:54:42,669 DEBUG [RS:1;jenkins-hbase4:34401] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-21 09:54:42,670 DEBUG [RS:0;jenkins-hbase4:42163] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-21 09:54:42,672 INFO [RS:1;jenkins-hbase4:34401] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:42,672 INFO [RS:1;jenkins-hbase4:34401] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:42,672 INFO [RS:1;jenkins-hbase4:34401] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:42,672 INFO [RS:1;jenkins-hbase4:34401] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:42,673 INFO [RS:0;jenkins-hbase4:42163] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:42,673 INFO [RS:0;jenkins-hbase4:42163] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:42,673 INFO [RS:0;jenkins-hbase4:42163] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:42,673 INFO [RS:0;jenkins-hbase4:42163] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:42,688 INFO [RS:0;jenkins-hbase4:42163] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-02-21 09:54:42,688 INFO [RS:1;jenkins-hbase4:34401] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-02-21 09:54:42,691 INFO [RS:0;jenkins-hbase4:42163] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,42163,1708509281284-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:42,691 INFO [RS:1;jenkins-hbase4:34401] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,34401,1708509281333-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:42,709 INFO [RS:1;jenkins-hbase4:34401] regionserver.Replication(203): jenkins-hbase4.apache.org,34401,1708509281333 started 2024-02-21 09:54:42,709 INFO [RS:0;jenkins-hbase4:42163] regionserver.Replication(203): jenkins-hbase4.apache.org,42163,1708509281284 started 2024-02-21 09:54:42,709 INFO [RS:1;jenkins-hbase4:34401] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,34401,1708509281333, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:34401, sessionid=0x101e92697c90002 2024-02-21 09:54:42,709 INFO [RS:0;jenkins-hbase4:42163] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,42163,1708509281284, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:42163, sessionid=0x101e92697c90001 2024-02-21 09:54:42,710 DEBUG [RS:0;jenkins-hbase4:42163] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-02-21 09:54:42,710 DEBUG [RS:1;jenkins-hbase4:34401] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-02-21 09:54:42,710 DEBUG [RS:0;jenkins-hbase4:42163] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,42163,1708509281284 2024-02-21 09:54:42,710 DEBUG [RS:1;jenkins-hbase4:34401] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,34401,1708509281333 2024-02-21 09:54:42,710 DEBUG [RS:0;jenkins-hbase4:42163] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42163,1708509281284' 2024-02-21 09:54:42,710 DEBUG [RS:1;jenkins-hbase4:34401] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34401,1708509281333' 2024-02-21 09:54:42,711 DEBUG [RS:1;jenkins-hbase4:34401] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-02-21 09:54:42,711 DEBUG [RS:0;jenkins-hbase4:42163] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-02-21 09:54:42,712 DEBUG [RS:0;jenkins-hbase4:42163] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-02-21 09:54:42,712 DEBUG [RS:1;jenkins-hbase4:34401] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-02-21 09:54:42,713 DEBUG [RS:0;jenkins-hbase4:42163] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-02-21 09:54:42,713 DEBUG [RS:1;jenkins-hbase4:34401] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-02-21 09:54:42,713 DEBUG [RS:1;jenkins-hbase4:34401] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-02-21 09:54:42,713 DEBUG [RS:0;jenkins-hbase4:42163] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-02-21 09:54:42,713 DEBUG [RS:1;jenkins-hbase4:34401] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,34401,1708509281333 2024-02-21 09:54:42,713 DEBUG [RS:0;jenkins-hbase4:42163] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,42163,1708509281284 2024-02-21 09:54:42,714 DEBUG [RS:0;jenkins-hbase4:42163] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,42163,1708509281284' 2024-02-21 09:54:42,714 DEBUG [RS:0;jenkins-hbase4:42163] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-02-21 09:54:42,714 DEBUG [RS:1;jenkins-hbase4:34401] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,34401,1708509281333' 2024-02-21 09:54:42,714 DEBUG [RS:1;jenkins-hbase4:34401] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-02-21 09:54:42,714 DEBUG [RS:0;jenkins-hbase4:42163] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-02-21 09:54:42,715 DEBUG [RS:1;jenkins-hbase4:34401] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-02-21 09:54:42,715 DEBUG [RS:1;jenkins-hbase4:34401] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-02-21 09:54:42,715 DEBUG [RS:0;jenkins-hbase4:42163] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-02-21 09:54:42,715 INFO [RS:1;jenkins-hbase4:34401] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-02-21 09:54:42,716 INFO [RS:0;jenkins-hbase4:42163] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-02-21 09:54:42,718 INFO [RS:1;jenkins-hbase4:34401] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:42,718 INFO [RS:0;jenkins-hbase4:42163] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:42,718 DEBUG [RS:1;jenkins-hbase4:34401] zookeeper.ZKUtil(399): regionserver:34401-0x101e92697c90002, quorum=127.0.0.1:64913, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-02-21 09:54:42,719 DEBUG [RS:0;jenkins-hbase4:42163] zookeeper.ZKUtil(399): regionserver:42163-0x101e92697c90001, quorum=127.0.0.1:64913, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-02-21 09:54:42,719 INFO [RS:1;jenkins-hbase4:34401] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-02-21 09:54:42,719 INFO [RS:0;jenkins-hbase4:42163] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-02-21 09:54:42,719 INFO [RS:1;jenkins-hbase4:34401] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:42,719 INFO [RS:0;jenkins-hbase4:42163] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:42,720 INFO [RS:0;jenkins-hbase4:42163] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:42,720 INFO [RS:1;jenkins-hbase4:34401] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:42,797 DEBUG [jenkins-hbase4:39319] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=2, allServersCount=2 2024-02-21 09:54:42,801 DEBUG [jenkins-hbase4:39319] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-02-21 09:54:42,807 DEBUG [jenkins-hbase4:39319] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-02-21 09:54:42,807 DEBUG [jenkins-hbase4:39319] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-02-21 09:54:42,807 DEBUG [jenkins-hbase4:39319] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-02-21 09:54:42,810 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34401,1708509281333, state=OPENING 2024-02-21 09:54:42,817 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2024-02-21 09:54:42,819 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-21 09:54:42,820 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-02-21 09:54:42,825 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34401,1708509281333}] 2024-02-21 09:54:42,833 INFO [RS:0;jenkins-hbase4:42163] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C42163%2C1708509281284, suffix=, logDir=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/WALs/jenkins-hbase4.apache.org,42163,1708509281284, archiveDir=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/oldWALs, maxLogs=32 2024-02-21 09:54:42,833 INFO [RS:1;jenkins-hbase4:34401] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34401%2C1708509281333, suffix=, logDir=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/WALs/jenkins-hbase4.apache.org,34401,1708509281333, archiveDir=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/oldWALs, maxLogs=32 2024-02-21 09:54:42,857 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40347,DS-ae0c13f7-1221-4c2b-8014-ace1100715ac,DISK] 2024-02-21 09:54:42,858 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44881,DS-db83a33b-1af6-4dca-9032-f845cdfb16b9,DISK] 2024-02-21 09:54:42,863 INFO [RS:1;jenkins-hbase4:34401] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/WALs/jenkins-hbase4.apache.org,34401,1708509281333/jenkins-hbase4.apache.org%2C34401%2C1708509281333.1708509282839 2024-02-21 09:54:42,863 DEBUG [RS:1;jenkins-hbase4:34401] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40347,DS-ae0c13f7-1221-4c2b-8014-ace1100715ac,DISK], DatanodeInfoWithStorage[127.0.0.1:44881,DS-db83a33b-1af6-4dca-9032-f845cdfb16b9,DISK]] 2024-02-21 09:54:42,888 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44881,DS-db83a33b-1af6-4dca-9032-f845cdfb16b9,DISK] 2024-02-21 09:54:42,888 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40347,DS-ae0c13f7-1221-4c2b-8014-ace1100715ac,DISK] 2024-02-21 09:54:42,898 INFO [RS:0;jenkins-hbase4:42163] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/WALs/jenkins-hbase4.apache.org,42163,1708509281284/jenkins-hbase4.apache.org%2C42163%2C1708509281284.1708509282839 2024-02-21 09:54:42,899 DEBUG [RS:0;jenkins-hbase4:42163] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40347,DS-ae0c13f7-1221-4c2b-8014-ace1100715ac,DISK], DatanodeInfoWithStorage[127.0.0.1:44881,DS-db83a33b-1af6-4dca-9032-f845cdfb16b9,DISK]] 2024-02-21 09:54:43,014 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,34401,1708509281333 2024-02-21 09:54:43,016 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-02-21 09:54:43,019 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43404, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-02-21 09:54:43,031 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2024-02-21 09:54:43,032 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-02-21 09:54:43,036 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C34401%2C1708509281333.meta, suffix=.meta, logDir=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/WALs/jenkins-hbase4.apache.org,34401,1708509281333, archiveDir=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/oldWALs, maxLogs=32 2024-02-21 09:54:43,054 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40347,DS-ae0c13f7-1221-4c2b-8014-ace1100715ac,DISK] 2024-02-21 09:54:43,055 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44881,DS-db83a33b-1af6-4dca-9032-f845cdfb16b9,DISK] 2024-02-21 09:54:43,062 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/WALs/jenkins-hbase4.apache.org,34401,1708509281333/jenkins-hbase4.apache.org%2C34401%2C1708509281333.meta.1708509283037.meta 2024-02-21 09:54:43,067 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40347,DS-ae0c13f7-1221-4c2b-8014-ace1100715ac,DISK], DatanodeInfoWithStorage[127.0.0.1:44881,DS-db83a33b-1af6-4dca-9032-f845cdfb16b9,DISK]] 2024-02-21 09:54:43,067 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2024-02-21 09:54:43,069 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2024-02-21 09:54:43,089 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2024-02-21 09:54:43,094 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2024-02-21 09:54:43,100 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2024-02-21 09:54:43,100 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-21 09:54:43,100 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2024-02-21 09:54:43,100 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2024-02-21 09:54:43,104 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-02-21 09:54:43,106 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/meta/1588230740/info 2024-02-21 09:54:43,106 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/meta/1588230740/info 2024-02-21 09:54:43,107 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-02-21 09:54:43,108 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-21 09:54:43,108 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-02-21 09:54:43,109 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/meta/1588230740/rep_barrier 2024-02-21 09:54:43,110 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/meta/1588230740/rep_barrier 2024-02-21 09:54:43,110 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-02-21 09:54:43,111 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-21 09:54:43,111 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-02-21 09:54:43,115 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/meta/1588230740/table 2024-02-21 09:54:43,115 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/meta/1588230740/table 2024-02-21 09:54:43,116 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-02-21 09:54:43,117 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-21 09:54:43,119 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/meta/1588230740 2024-02-21 09:54:43,121 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/meta/1588230740 2024-02-21 09:54:43,125 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-02-21 09:54:43,128 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2024-02-21 09:54:43,130 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67579163, jitterRate=0.007008001208305359}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-02-21 09:54:43,130 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2024-02-21 09:54:43,140 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1708509283004 2024-02-21 09:54:43,157 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:meta,,1.1588230740 2024-02-21 09:54:43,158 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2024-02-21 09:54:43,159 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,34401,1708509281333, state=OPEN 2024-02-21 09:54:43,162 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2024-02-21 09:54:43,163 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-02-21 09:54:43,168 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=3, resume processing ppid=2 2024-02-21 09:54:43,168 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,34401,1708509281333 in 339 msec 2024-02-21 09:54:43,173 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=2, resume processing ppid=1 2024-02-21 09:54:43,173 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 540 msec 2024-02-21 09:54:43,179 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 822 msec 2024-02-21 09:54:43,179 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(954): Wait for region servers to report in: status=null, state=RUNNING, startTime=1708509283179, completionTime=-1 2024-02-21 09:54:43,179 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2024-02-21 09:54:43,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2024-02-21 09:54:43,251 DEBUG [hconnection-0x79416b3c-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-02-21 09:54:43,254 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43410, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-02-21 09:54:43,270 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=2 2024-02-21 09:54:43,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1708509343271 2024-02-21 09:54:43,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1708509403271 2024-02-21 09:54:43,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 91 msec 2024-02-21 09:54:43,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39319,1708509280062-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:43,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39319,1708509280062-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:43,295 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39319,1708509280062-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:43,297 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:39319, period=300000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:43,298 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:43,304 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2024-02-21 09:54:43,312 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2024-02-21 09:54:43,314 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-02-21 09:54:43,324 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2024-02-21 09:54:43,328 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2024-02-21 09:54:43,330 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-02-21 09:54:43,353 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/hbase/namespace/ee363047751be7b53f6d383d4d3054c5 2024-02-21 09:54:43,355 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/hbase/namespace/ee363047751be7b53f6d383d4d3054c5 empty. 2024-02-21 09:54:43,356 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/hbase/namespace/ee363047751be7b53f6d383d4d3054c5 2024-02-21 09:54:43,357 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2024-02-21 09:54:43,387 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2024-02-21 09:54:43,389 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => ee363047751be7b53f6d383d4d3054c5, NAME => 'hbase:namespace,,1708509283313.ee363047751be7b53f6d383d4d3054c5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp 2024-02-21 09:54:43,408 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1708509283313.ee363047751be7b53f6d383d4d3054c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-21 09:54:43,408 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing ee363047751be7b53f6d383d4d3054c5, disabling compactions & flushes 2024-02-21 09:54:43,408 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1708509283313.ee363047751be7b53f6d383d4d3054c5. 2024-02-21 09:54:43,408 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1708509283313.ee363047751be7b53f6d383d4d3054c5. 2024-02-21 09:54:43,408 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1708509283313.ee363047751be7b53f6d383d4d3054c5. after waiting 0 ms 2024-02-21 09:54:43,408 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1708509283313.ee363047751be7b53f6d383d4d3054c5. 2024-02-21 09:54:43,409 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1708509283313.ee363047751be7b53f6d383d4d3054c5. 2024-02-21 09:54:43,409 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for ee363047751be7b53f6d383d4d3054c5: 2024-02-21 09:54:43,413 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2024-02-21 09:54:43,429 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1708509283313.ee363047751be7b53f6d383d4d3054c5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1708509283416"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1708509283416"}]},"ts":"1708509283416"} 2024-02-21 09:54:43,459 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-02-21 09:54:43,462 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-02-21 09:54:43,466 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708509283462"}]},"ts":"1708509283462"} 2024-02-21 09:54:43,470 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2024-02-21 09:54:43,475 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-02-21 09:54:43,478 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-02-21 09:54:43,478 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-02-21 09:54:43,478 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-02-21 09:54:43,480 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ee363047751be7b53f6d383d4d3054c5, ASSIGN}] 2024-02-21 09:54:43,483 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=ee363047751be7b53f6d383d4d3054c5, ASSIGN 2024-02-21 09:54:43,485 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=ee363047751be7b53f6d383d4d3054c5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42163,1708509281284; forceNewPlan=false, retain=false 2024-02-21 09:54:43,637 INFO [jenkins-hbase4:39319] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-02-21 09:54:43,638 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ee363047751be7b53f6d383d4d3054c5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42163,1708509281284 2024-02-21 09:54:43,638 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1708509283313.ee363047751be7b53f6d383d4d3054c5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1708509283638"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1708509283638"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1708509283638"}]},"ts":"1708509283638"} 2024-02-21 09:54:43,643 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure ee363047751be7b53f6d383d4d3054c5, server=jenkins-hbase4.apache.org,42163,1708509281284}] 2024-02-21 09:54:43,797 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42163,1708509281284 2024-02-21 09:54:43,797 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-02-21 09:54:43,800 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57952, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-02-21 09:54:43,807 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1708509283313.ee363047751be7b53f6d383d4d3054c5. 2024-02-21 09:54:43,808 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ee363047751be7b53f6d383d4d3054c5, NAME => 'hbase:namespace,,1708509283313.ee363047751be7b53f6d383d4d3054c5.', STARTKEY => '', ENDKEY => ''} 2024-02-21 09:54:43,809 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace ee363047751be7b53f6d383d4d3054c5 2024-02-21 09:54:43,809 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1708509283313.ee363047751be7b53f6d383d4d3054c5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-21 09:54:43,809 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ee363047751be7b53f6d383d4d3054c5 2024-02-21 09:54:43,809 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ee363047751be7b53f6d383d4d3054c5 2024-02-21 09:54:43,812 INFO [StoreOpener-ee363047751be7b53f6d383d4d3054c5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region ee363047751be7b53f6d383d4d3054c5 2024-02-21 09:54:43,814 DEBUG [StoreOpener-ee363047751be7b53f6d383d4d3054c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/namespace/ee363047751be7b53f6d383d4d3054c5/info 2024-02-21 09:54:43,814 DEBUG [StoreOpener-ee363047751be7b53f6d383d4d3054c5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/namespace/ee363047751be7b53f6d383d4d3054c5/info 2024-02-21 09:54:43,815 INFO [StoreOpener-ee363047751be7b53f6d383d4d3054c5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ee363047751be7b53f6d383d4d3054c5 columnFamilyName info 2024-02-21 09:54:43,816 INFO [StoreOpener-ee363047751be7b53f6d383d4d3054c5-1] regionserver.HStore(310): Store=ee363047751be7b53f6d383d4d3054c5/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-21 09:54:43,818 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/namespace/ee363047751be7b53f6d383d4d3054c5 2024-02-21 09:54:43,819 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/namespace/ee363047751be7b53f6d383d4d3054c5 2024-02-21 09:54:43,824 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ee363047751be7b53f6d383d4d3054c5 2024-02-21 09:54:43,828 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/namespace/ee363047751be7b53f6d383d4d3054c5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-21 09:54:43,829 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ee363047751be7b53f6d383d4d3054c5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71606973, jitterRate=0.06702704727649689}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-02-21 09:54:43,829 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ee363047751be7b53f6d383d4d3054c5: 2024-02-21 09:54:43,832 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:namespace,,1708509283313.ee363047751be7b53f6d383d4d3054c5., pid=6, masterSystemTime=1708509283797 2024-02-21 09:54:43,837 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:namespace,,1708509283313.ee363047751be7b53f6d383d4d3054c5. 2024-02-21 09:54:43,837 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1708509283313.ee363047751be7b53f6d383d4d3054c5. 2024-02-21 09:54:43,839 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=ee363047751be7b53f6d383d4d3054c5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42163,1708509281284 2024-02-21 09:54:43,839 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1708509283313.ee363047751be7b53f6d383d4d3054c5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1708509283839"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1708509283839"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1708509283839"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1708509283839"}]},"ts":"1708509283839"} 2024-02-21 09:54:43,849 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=6, resume processing ppid=5 2024-02-21 09:54:43,851 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure ee363047751be7b53f6d383d4d3054c5, server=jenkins-hbase4.apache.org,42163,1708509281284 in 202 msec 2024-02-21 09:54:43,854 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=5, resume processing ppid=4 2024-02-21 09:54:43,854 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=ee363047751be7b53f6d383d4d3054c5, ASSIGN in 369 msec 2024-02-21 09:54:43,856 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-02-21 09:54:43,857 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708509283857"}]},"ts":"1708509283857"} 2024-02-21 09:54:43,860 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2024-02-21 09:54:43,863 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2024-02-21 09:54:43,867 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 549 msec 2024-02-21 09:54:43,928 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2024-02-21 09:54:43,930 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2024-02-21 09:54:43,930 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-21 09:54:43,953 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-02-21 09:54:43,956 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57956, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-02-21 09:54:43,970 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2024-02-21 09:54:43,990 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-02-21 09:54:43,996 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 33 msec 2024-02-21 09:54:44,005 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2024-02-21 09:54:44,018 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-02-21 09:54:44,027 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 21 msec 2024-02-21 09:54:44,041 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2024-02-21 09:54:44,044 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2024-02-21 09:54:44,045 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1084): Master has completed initialization 2.637sec 2024-02-21 09:54:44,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(103): Quota table not found. Creating... 2024-02-21 09:54:44,048 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-02-21 09:54:44,049 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:quota 2024-02-21 09:54:44,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(107): Initializing quota support 2024-02-21 09:54:44,052 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_PRE_OPERATION 2024-02-21 09:54:44,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(59): Namespace State Manager started. 2024-02-21 09:54:44,054 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-02-21 09:54:44,057 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/hbase/quota/fbb33d9b2d3eec72f85c5982887e2d54 2024-02-21 09:54:44,059 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/hbase/quota/fbb33d9b2d3eec72f85c5982887e2d54 empty. 2024-02-21 09:54:44,061 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/hbase/quota/fbb33d9b2d3eec72f85c5982887e2d54 2024-02-21 09:54:44,061 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:quota regions 2024-02-21 09:54:44,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(222): Finished updating state of 2 namespaces. 2024-02-21 09:54:44,062 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceAuditor(50): NamespaceAuditor started. 2024-02-21 09:54:44,064 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:44,065 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=300000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:44,067 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2024-02-21 09:54:44,067 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2024-02-21 09:54:44,068 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39319,1708509280062-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2024-02-21 09:54:44,070 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39319,1708509280062-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2024-02-21 09:54:44,087 DEBUG [Listener at localhost/32959] zookeeper.ReadOnlyZKClient(139): Connect 0x281456a0 to 127.0.0.1:64913 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-02-21 09:54:44,091 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1176): Balancer post startup initialization complete, took 0 seconds 2024-02-21 09:54:44,091 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39319,1708509280062-OldWALsDirSizeChore, period=300000, unit=MILLISECONDS is enabled. 2024-02-21 09:54:44,095 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/hbase/quota/.tabledesc/.tableinfo.0000000001 2024-02-21 09:54:44,096 DEBUG [Listener at localhost/32959] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5b6d5c7b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-02-21 09:54:44,096 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(7675): creating {ENCODED => fbb33d9b2d3eec72f85c5982887e2d54, NAME => 'hbase:quota,,1708509284048.fbb33d9b2d3eec72f85c5982887e2d54.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp 2024-02-21 09:54:44,122 DEBUG [hconnection-0x5890d9fb-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-02-21 09:54:44,125 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(866): Instantiated hbase:quota,,1708509284048.fbb33d9b2d3eec72f85c5982887e2d54.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-21 09:54:44,125 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1604): Closing fbb33d9b2d3eec72f85c5982887e2d54, disabling compactions & flushes 2024-02-21 09:54:44,125 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1626): Closing region hbase:quota,,1708509284048.fbb33d9b2d3eec72f85c5982887e2d54. 2024-02-21 09:54:44,125 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1708509284048.fbb33d9b2d3eec72f85c5982887e2d54. 2024-02-21 09:54:44,125 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1708509284048.fbb33d9b2d3eec72f85c5982887e2d54. after waiting 0 ms 2024-02-21 09:54:44,125 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1708509284048.fbb33d9b2d3eec72f85c5982887e2d54. 2024-02-21 09:54:44,126 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1838): Closed hbase:quota,,1708509284048.fbb33d9b2d3eec72f85c5982887e2d54. 2024-02-21 09:54:44,126 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1558): Region close journal for fbb33d9b2d3eec72f85c5982887e2d54: 2024-02-21 09:54:44,131 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ADD_TO_META 2024-02-21 09:54:44,133 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:quota,,1708509284048.fbb33d9b2d3eec72f85c5982887e2d54.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1708509284132"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1708509284132"}]},"ts":"1708509284132"} 2024-02-21 09:54:44,136 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-02-21 09:54:44,139 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-02-21 09:54:44,139 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708509284139"}]},"ts":"1708509284139"} 2024-02-21 09:54:44,140 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43426, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-02-21 09:54:44,142 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLING in hbase:meta 2024-02-21 09:54:44,149 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-02-21 09:54:44,151 INFO [Listener at localhost/32959] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,39319,1708509280062 2024-02-21 09:54:44,152 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-02-21 09:54:44,152 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-02-21 09:54:44,152 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-02-21 09:54:44,152 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=fbb33d9b2d3eec72f85c5982887e2d54, ASSIGN}] 2024-02-21 09:54:44,153 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:54:44,155 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=fbb33d9b2d3eec72f85c5982887e2d54, ASSIGN 2024-02-21 09:54:44,156 DEBUG [Listener at localhost/32959] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-02-21 09:54:44,157 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:quota, region=fbb33d9b2d3eec72f85c5982887e2d54, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34401,1708509281333; forceNewPlan=false, retain=false 2024-02-21 09:54:44,259 DEBUG [Listener at localhost/32959] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-02-21 09:54:44,307 INFO [jenkins-hbase4:39319] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-02-21 09:54:44,308 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=fbb33d9b2d3eec72f85c5982887e2d54, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34401,1708509281333 2024-02-21 09:54:44,308 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:quota,,1708509284048.fbb33d9b2d3eec72f85c5982887e2d54.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1708509284308"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1708509284308"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1708509284308"}]},"ts":"1708509284308"} 2024-02-21 09:54:44,312 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure fbb33d9b2d3eec72f85c5982887e2d54, server=jenkins-hbase4.apache.org,34401,1708509281333}] 2024-02-21 09:54:44,361 DEBUG [Listener at localhost/32959] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-02-21 09:54:44,463 DEBUG [Listener at localhost/32959] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-02-21 09:54:44,465 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,34401,1708509281333 2024-02-21 09:54:44,472 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:quota,,1708509284048.fbb33d9b2d3eec72f85c5982887e2d54. 2024-02-21 09:54:44,473 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fbb33d9b2d3eec72f85c5982887e2d54, NAME => 'hbase:quota,,1708509284048.fbb33d9b2d3eec72f85c5982887e2d54.', STARTKEY => '', ENDKEY => ''} 2024-02-21 09:54:44,473 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table quota fbb33d9b2d3eec72f85c5982887e2d54 2024-02-21 09:54:44,473 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:quota,,1708509284048.fbb33d9b2d3eec72f85c5982887e2d54.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-21 09:54:44,473 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fbb33d9b2d3eec72f85c5982887e2d54 2024-02-21 09:54:44,473 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fbb33d9b2d3eec72f85c5982887e2d54 2024-02-21 09:54:44,476 INFO [StoreOpener-fbb33d9b2d3eec72f85c5982887e2d54-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family q of region fbb33d9b2d3eec72f85c5982887e2d54 2024-02-21 09:54:44,478 DEBUG [StoreOpener-fbb33d9b2d3eec72f85c5982887e2d54-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/quota/fbb33d9b2d3eec72f85c5982887e2d54/q 2024-02-21 09:54:44,479 DEBUG [StoreOpener-fbb33d9b2d3eec72f85c5982887e2d54-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/quota/fbb33d9b2d3eec72f85c5982887e2d54/q 2024-02-21 09:54:44,479 INFO [StoreOpener-fbb33d9b2d3eec72f85c5982887e2d54-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fbb33d9b2d3eec72f85c5982887e2d54 columnFamilyName q 2024-02-21 09:54:44,480 INFO [StoreOpener-fbb33d9b2d3eec72f85c5982887e2d54-1] regionserver.HStore(310): Store=fbb33d9b2d3eec72f85c5982887e2d54/q, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-21 09:54:44,480 INFO [StoreOpener-fbb33d9b2d3eec72f85c5982887e2d54-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family u of region fbb33d9b2d3eec72f85c5982887e2d54 2024-02-21 09:54:44,483 DEBUG [StoreOpener-fbb33d9b2d3eec72f85c5982887e2d54-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/quota/fbb33d9b2d3eec72f85c5982887e2d54/u 2024-02-21 09:54:44,483 DEBUG [StoreOpener-fbb33d9b2d3eec72f85c5982887e2d54-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/quota/fbb33d9b2d3eec72f85c5982887e2d54/u 2024-02-21 09:54:44,483 INFO [StoreOpener-fbb33d9b2d3eec72f85c5982887e2d54-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fbb33d9b2d3eec72f85c5982887e2d54 columnFamilyName u 2024-02-21 09:54:44,484 INFO [StoreOpener-fbb33d9b2d3eec72f85c5982887e2d54-1] regionserver.HStore(310): Store=fbb33d9b2d3eec72f85c5982887e2d54/u, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-21 09:54:44,486 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/quota/fbb33d9b2d3eec72f85c5982887e2d54 2024-02-21 09:54:44,488 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/quota/fbb33d9b2d3eec72f85c5982887e2d54 2024-02-21 09:54:44,491 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:quota descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2024-02-21 09:54:44,494 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fbb33d9b2d3eec72f85c5982887e2d54 2024-02-21 09:54:44,497 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/quota/fbb33d9b2d3eec72f85c5982887e2d54/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-21 09:54:44,498 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fbb33d9b2d3eec72f85c5982887e2d54; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70772179, jitterRate=0.05458764731884003}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2024-02-21 09:54:44,498 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fbb33d9b2d3eec72f85c5982887e2d54: 2024-02-21 09:54:44,499 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:quota,,1708509284048.fbb33d9b2d3eec72f85c5982887e2d54., pid=11, masterSystemTime=1708509284465 2024-02-21 09:54:44,502 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:quota,,1708509284048.fbb33d9b2d3eec72f85c5982887e2d54. 2024-02-21 09:54:44,502 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:quota,,1708509284048.fbb33d9b2d3eec72f85c5982887e2d54. 2024-02-21 09:54:44,503 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=fbb33d9b2d3eec72f85c5982887e2d54, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34401,1708509281333 2024-02-21 09:54:44,504 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:quota,,1708509284048.fbb33d9b2d3eec72f85c5982887e2d54.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1708509284503"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1708509284503"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1708509284503"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1708509284503"}]},"ts":"1708509284503"} 2024-02-21 09:54:44,510 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=11, resume processing ppid=10 2024-02-21 09:54:44,510 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure fbb33d9b2d3eec72f85c5982887e2d54, server=jenkins-hbase4.apache.org,34401,1708509281333 in 195 msec 2024-02-21 09:54:44,514 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=10, resume processing ppid=9 2024-02-21 09:54:44,514 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:quota, region=fbb33d9b2d3eec72f85c5982887e2d54, ASSIGN in 358 msec 2024-02-21 09:54:44,515 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-02-21 09:54:44,516 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708509284515"}]},"ts":"1708509284515"} 2024-02-21 09:54:44,518 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLED in hbase:meta 2024-02-21 09:54:44,522 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_POST_OPERATION 2024-02-21 09:54:44,525 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:quota in 474 msec 2024-02-21 09:54:44,578 DEBUG [Listener at localhost/32959] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-02-21 09:54:44,581 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40764, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2024-02-21 09:54:44,615 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-02-21 09:54:44,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] procedure2.ProcedureExecutor(1075): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin0 2024-02-21 09:54:44,621 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_PRE_OPERATION 2024-02-21 09:54:44,623 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-02-21 09:54:44,625 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/default/TestQuotaAdmin0/f97a621c5a71963a0e03c57d6b687f57 2024-02-21 09:54:44,626 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/default/TestQuotaAdmin0/f97a621c5a71963a0e03c57d6b687f57 empty. 2024-02-21 09:54:44,627 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin0" procId is: 12 2024-02-21 09:54:44,627 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/default/TestQuotaAdmin0/f97a621c5a71963a0e03c57d6b687f57 2024-02-21 09:54:44,627 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-02-21 09:54:44,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-02-21 09:54:44,648 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/default/TestQuotaAdmin0/.tabledesc/.tableinfo.0000000001 2024-02-21 09:54:44,650 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(7675): creating {ENCODED => f97a621c5a71963a0e03c57d6b687f57, NAME => 'TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp 2024-02-21 09:54:44,667 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-21 09:54:44,667 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1604): Closing f97a621c5a71963a0e03c57d6b687f57, disabling compactions & flushes 2024-02-21 09:54:44,667 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57. 2024-02-21 09:54:44,667 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57. 2024-02-21 09:54:44,667 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57. after waiting 0 ms 2024-02-21 09:54:44,667 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57. 2024-02-21 09:54:44,667 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57. 2024-02-21 09:54:44,667 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1558): Region close journal for f97a621c5a71963a0e03c57d6b687f57: 2024-02-21 09:54:44,672 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ADD_TO_META 2024-02-21 09:54:44,674 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708509284674"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1708509284674"}]},"ts":"1708509284674"} 2024-02-21 09:54:44,676 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-02-21 09:54:44,678 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-02-21 09:54:44,678 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708509284678"}]},"ts":"1708509284678"} 2024-02-21 09:54:44,680 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLING in hbase:meta 2024-02-21 09:54:44,685 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-02-21 09:54:44,687 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-02-21 09:54:44,687 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-02-21 09:54:44,687 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-02-21 09:54:44,687 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=f97a621c5a71963a0e03c57d6b687f57, ASSIGN}] 2024-02-21 09:54:44,689 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=f97a621c5a71963a0e03c57d6b687f57, ASSIGN 2024-02-21 09:54:44,690 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin0, region=f97a621c5a71963a0e03c57d6b687f57, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42163,1708509281284; forceNewPlan=false, retain=false 2024-02-21 09:54:44,841 INFO [jenkins-hbase4:39319] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-02-21 09:54:44,842 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f97a621c5a71963a0e03c57d6b687f57, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42163,1708509281284 2024-02-21 09:54:44,842 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708509284841"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1708509284841"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1708509284841"}]},"ts":"1708509284841"} 2024-02-21 09:54:44,845 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; OpenRegionProcedure f97a621c5a71963a0e03c57d6b687f57, server=jenkins-hbase4.apache.org,42163,1708509281284}] 2024-02-21 09:54:44,896 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-02-21 09:54:44,998 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42163,1708509281284 2024-02-21 09:54:45,006 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57. 2024-02-21 09:54:45,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f97a621c5a71963a0e03c57d6b687f57, NAME => 'TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57.', STARTKEY => '', ENDKEY => ''} 2024-02-21 09:54:45,006 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin0 f97a621c5a71963a0e03c57d6b687f57 2024-02-21 09:54:45,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-21 09:54:45,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f97a621c5a71963a0e03c57d6b687f57 2024-02-21 09:54:45,007 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f97a621c5a71963a0e03c57d6b687f57 2024-02-21 09:54:45,009 INFO [StoreOpener-f97a621c5a71963a0e03c57d6b687f57-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f97a621c5a71963a0e03c57d6b687f57 2024-02-21 09:54:45,011 DEBUG [StoreOpener-f97a621c5a71963a0e03c57d6b687f57-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/default/TestQuotaAdmin0/f97a621c5a71963a0e03c57d6b687f57/cf 2024-02-21 09:54:45,011 DEBUG [StoreOpener-f97a621c5a71963a0e03c57d6b687f57-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/default/TestQuotaAdmin0/f97a621c5a71963a0e03c57d6b687f57/cf 2024-02-21 09:54:45,011 INFO [StoreOpener-f97a621c5a71963a0e03c57d6b687f57-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f97a621c5a71963a0e03c57d6b687f57 columnFamilyName cf 2024-02-21 09:54:45,012 INFO [StoreOpener-f97a621c5a71963a0e03c57d6b687f57-1] regionserver.HStore(310): Store=f97a621c5a71963a0e03c57d6b687f57/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-21 09:54:45,016 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/default/TestQuotaAdmin0/f97a621c5a71963a0e03c57d6b687f57 2024-02-21 09:54:45,017 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/default/TestQuotaAdmin0/f97a621c5a71963a0e03c57d6b687f57 2024-02-21 09:54:45,022 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f97a621c5a71963a0e03c57d6b687f57 2024-02-21 09:54:45,025 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/default/TestQuotaAdmin0/f97a621c5a71963a0e03c57d6b687f57/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-21 09:54:45,026 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f97a621c5a71963a0e03c57d6b687f57; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75468999, jitterRate=0.12457571923732758}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-02-21 09:54:45,026 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f97a621c5a71963a0e03c57d6b687f57: 2024-02-21 09:54:45,027 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57., pid=14, masterSystemTime=1708509284998 2024-02-21 09:54:45,030 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57. 2024-02-21 09:54:45,030 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57. 2024-02-21 09:54:45,031 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=f97a621c5a71963a0e03c57d6b687f57, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42163,1708509281284 2024-02-21 09:54:45,031 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708509285031"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1708509285031"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1708509285031"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1708509285031"}]},"ts":"1708509285031"} 2024-02-21 09:54:45,037 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=14, resume processing ppid=13 2024-02-21 09:54:45,039 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=14, ppid=13, state=SUCCESS; OpenRegionProcedure f97a621c5a71963a0e03c57d6b687f57, server=jenkins-hbase4.apache.org,42163,1708509281284 in 189 msec 2024-02-21 09:54:45,041 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=13, resume processing ppid=12 2024-02-21 09:54:45,042 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=f97a621c5a71963a0e03c57d6b687f57, ASSIGN in 350 msec 2024-02-21 09:54:45,043 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-02-21 09:54:45,044 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708509285043"}]},"ts":"1708509285043"} 2024-02-21 09:54:45,046 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLED in hbase:meta 2024-02-21 09:54:45,050 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_POST_OPERATION 2024-02-21 09:54:45,052 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=12, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin0 in 435 msec 2024-02-21 09:54:45,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-02-21 09:54:45,399 INFO [Listener at localhost/32959] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin0, procId: 12 completed 2024-02-21 09:54:45,399 DEBUG [Listener at localhost/32959] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin0 get assigned. Timeout = 60000ms 2024-02-21 09:54:45,400 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:54:45,404 INFO [Listener at localhost/32959] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin0 assigned to meta. Checking AM states. 2024-02-21 09:54:45,405 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:54:45,405 INFO [Listener at localhost/32959] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin0 assigned. 2024-02-21 09:54:45,405 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:54:45,413 DEBUG [hconnection-0x5890d9fb-shared-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-02-21 09:54:45,416 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57968, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-02-21 09:54:45,421 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-02-21 09:54:45,423 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40772, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService 2024-02-21 09:54:45,424 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-02-21 09:54:45,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] procedure2.ProcedureExecutor(1075): Stored pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin1 2024-02-21 09:54:45,429 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_PRE_OPERATION 2024-02-21 09:54:45,429 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin1" procId is: 15 2024-02-21 09:54:45,430 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-02-21 09:54:45,431 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-02-21 09:54:45,436 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/default/TestQuotaAdmin1/d19b68d185ede7ded0c9f2612bfc98b6 2024-02-21 09:54:45,437 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/default/TestQuotaAdmin1/d19b68d185ede7ded0c9f2612bfc98b6 empty. 2024-02-21 09:54:45,438 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/default/TestQuotaAdmin1/d19b68d185ede7ded0c9f2612bfc98b6 2024-02-21 09:54:45,438 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-02-21 09:54:45,460 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/default/TestQuotaAdmin1/.tabledesc/.tableinfo.0000000001 2024-02-21 09:54:45,464 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(7675): creating {ENCODED => d19b68d185ede7ded0c9f2612bfc98b6, NAME => 'TestQuotaAdmin1,,1708509285424.d19b68d185ede7ded0c9f2612bfc98b6.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp 2024-02-21 09:54:45,471 DEBUG [hconnection-0xad0e050-metaLookup-shared--pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-02-21 09:54:45,476 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43432, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2024-02-21 09:54:45,486 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1708509285424.d19b68d185ede7ded0c9f2612bfc98b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-21 09:54:45,487 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1604): Closing d19b68d185ede7ded0c9f2612bfc98b6, disabling compactions & flushes 2024-02-21 09:54:45,487 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1708509285424.d19b68d185ede7ded0c9f2612bfc98b6. 2024-02-21 09:54:45,487 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1708509285424.d19b68d185ede7ded0c9f2612bfc98b6. 2024-02-21 09:54:45,487 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1708509285424.d19b68d185ede7ded0c9f2612bfc98b6. after waiting 0 ms 2024-02-21 09:54:45,487 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1708509285424.d19b68d185ede7ded0c9f2612bfc98b6. 2024-02-21 09:54:45,487 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1708509285424.d19b68d185ede7ded0c9f2612bfc98b6. 2024-02-21 09:54:45,487 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1558): Region close journal for d19b68d185ede7ded0c9f2612bfc98b6: 2024-02-21 09:54:45,493 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ADD_TO_META 2024-02-21 09:54:45,495 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1708509285424.d19b68d185ede7ded0c9f2612bfc98b6.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708509285494"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1708509285494"}]},"ts":"1708509285494"} 2024-02-21 09:54:45,498 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-02-21 09:54:45,499 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-02-21 09:54:45,499 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708509285499"}]},"ts":"1708509285499"} 2024-02-21 09:54:45,501 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLING in hbase:meta 2024-02-21 09:54:45,507 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-02-21 09:54:45,508 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-02-21 09:54:45,508 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-02-21 09:54:45,508 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-02-21 09:54:45,508 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=d19b68d185ede7ded0c9f2612bfc98b6, ASSIGN}] 2024-02-21 09:54:45,510 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=d19b68d185ede7ded0c9f2612bfc98b6, ASSIGN 2024-02-21 09:54:45,511 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin1, region=d19b68d185ede7ded0c9f2612bfc98b6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42163,1708509281284; forceNewPlan=false, retain=false 2024-02-21 09:54:45,661 INFO [jenkins-hbase4:39319] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-02-21 09:54:45,662 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d19b68d185ede7ded0c9f2612bfc98b6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42163,1708509281284 2024-02-21 09:54:45,663 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1708509285424.d19b68d185ede7ded0c9f2612bfc98b6.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708509285662"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1708509285662"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1708509285662"}]},"ts":"1708509285662"} 2024-02-21 09:54:45,666 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure d19b68d185ede7ded0c9f2612bfc98b6, server=jenkins-hbase4.apache.org,42163,1708509281284}] 2024-02-21 09:54:45,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-02-21 09:54:45,819 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42163,1708509281284 2024-02-21 09:54:45,824 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin1,,1708509285424.d19b68d185ede7ded0c9f2612bfc98b6. 2024-02-21 09:54:45,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d19b68d185ede7ded0c9f2612bfc98b6, NAME => 'TestQuotaAdmin1,,1708509285424.d19b68d185ede7ded0c9f2612bfc98b6.', STARTKEY => '', ENDKEY => ''} 2024-02-21 09:54:45,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin1 d19b68d185ede7ded0c9f2612bfc98b6 2024-02-21 09:54:45,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1708509285424.d19b68d185ede7ded0c9f2612bfc98b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-21 09:54:45,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d19b68d185ede7ded0c9f2612bfc98b6 2024-02-21 09:54:45,825 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d19b68d185ede7ded0c9f2612bfc98b6 2024-02-21 09:54:45,827 INFO [StoreOpener-d19b68d185ede7ded0c9f2612bfc98b6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region d19b68d185ede7ded0c9f2612bfc98b6 2024-02-21 09:54:45,829 DEBUG [StoreOpener-d19b68d185ede7ded0c9f2612bfc98b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/default/TestQuotaAdmin1/d19b68d185ede7ded0c9f2612bfc98b6/cf 2024-02-21 09:54:45,829 DEBUG [StoreOpener-d19b68d185ede7ded0c9f2612bfc98b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/default/TestQuotaAdmin1/d19b68d185ede7ded0c9f2612bfc98b6/cf 2024-02-21 09:54:45,830 INFO [StoreOpener-d19b68d185ede7ded0c9f2612bfc98b6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d19b68d185ede7ded0c9f2612bfc98b6 columnFamilyName cf 2024-02-21 09:54:45,830 INFO [StoreOpener-d19b68d185ede7ded0c9f2612bfc98b6-1] regionserver.HStore(310): Store=d19b68d185ede7ded0c9f2612bfc98b6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-21 09:54:45,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/default/TestQuotaAdmin1/d19b68d185ede7ded0c9f2612bfc98b6 2024-02-21 09:54:45,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/default/TestQuotaAdmin1/d19b68d185ede7ded0c9f2612bfc98b6 2024-02-21 09:54:45,839 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d19b68d185ede7ded0c9f2612bfc98b6 2024-02-21 09:54:45,843 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/default/TestQuotaAdmin1/d19b68d185ede7ded0c9f2612bfc98b6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-21 09:54:45,844 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d19b68d185ede7ded0c9f2612bfc98b6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72910562, jitterRate=0.08645203709602356}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-02-21 09:54:45,844 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d19b68d185ede7ded0c9f2612bfc98b6: 2024-02-21 09:54:45,845 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin1,,1708509285424.d19b68d185ede7ded0c9f2612bfc98b6., pid=17, masterSystemTime=1708509285819 2024-02-21 09:54:45,848 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin1,,1708509285424.d19b68d185ede7ded0c9f2612bfc98b6. 2024-02-21 09:54:45,848 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin1,,1708509285424.d19b68d185ede7ded0c9f2612bfc98b6. 2024-02-21 09:54:45,849 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=d19b68d185ede7ded0c9f2612bfc98b6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42163,1708509281284 2024-02-21 09:54:45,849 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin1,,1708509285424.d19b68d185ede7ded0c9f2612bfc98b6.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708509285849"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1708509285849"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1708509285849"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1708509285849"}]},"ts":"1708509285849"} 2024-02-21 09:54:45,855 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=17, resume processing ppid=16 2024-02-21 09:54:45,855 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure d19b68d185ede7ded0c9f2612bfc98b6, server=jenkins-hbase4.apache.org,42163,1708509281284 in 185 msec 2024-02-21 09:54:45,858 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=16, resume processing ppid=15 2024-02-21 09:54:45,859 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=d19b68d185ede7ded0c9f2612bfc98b6, ASSIGN in 347 msec 2024-02-21 09:54:45,859 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-02-21 09:54:45,860 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708509285860"}]},"ts":"1708509285860"} 2024-02-21 09:54:45,862 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLED in hbase:meta 2024-02-21 09:54:45,865 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_POST_OPERATION 2024-02-21 09:54:45,867 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=15, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin1 in 440 msec 2024-02-21 09:54:46,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-02-21 09:54:46,185 INFO [Listener at localhost/32959] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin1, procId: 15 completed 2024-02-21 09:54:46,185 DEBUG [Listener at localhost/32959] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin1 get assigned. Timeout = 60000ms 2024-02-21 09:54:46,186 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:54:46,189 INFO [Listener at localhost/32959] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin1 assigned to meta. Checking AM states. 2024-02-21 09:54:46,190 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:54:46,190 INFO [Listener at localhost/32959] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin1 assigned. 2024-02-21 09:54:46,190 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:54:46,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-02-21 09:54:46,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] procedure2.ProcedureExecutor(1075): Stored pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin2 2024-02-21 09:54:46,206 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_PRE_OPERATION 2024-02-21 09:54:46,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin2" procId is: 18 2024-02-21 09:54:46,208 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-02-21 09:54:46,208 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-02-21 09:54:46,211 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/default/TestQuotaAdmin2/730d49a1c883b1f971bdaa528da8e9ef 2024-02-21 09:54:46,212 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/default/TestQuotaAdmin2/730d49a1c883b1f971bdaa528da8e9ef empty. 2024-02-21 09:54:46,212 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/default/TestQuotaAdmin2/730d49a1c883b1f971bdaa528da8e9ef 2024-02-21 09:54:46,213 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-02-21 09:54:46,238 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/default/TestQuotaAdmin2/.tabledesc/.tableinfo.0000000001 2024-02-21 09:54:46,239 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(7675): creating {ENCODED => 730d49a1c883b1f971bdaa528da8e9ef, NAME => 'TestQuotaAdmin2,,1708509286201.730d49a1c883b1f971bdaa528da8e9ef.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp 2024-02-21 09:54:46,259 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1708509286201.730d49a1c883b1f971bdaa528da8e9ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-21 09:54:46,259 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1604): Closing 730d49a1c883b1f971bdaa528da8e9ef, disabling compactions & flushes 2024-02-21 09:54:46,259 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1708509286201.730d49a1c883b1f971bdaa528da8e9ef. 2024-02-21 09:54:46,259 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1708509286201.730d49a1c883b1f971bdaa528da8e9ef. 2024-02-21 09:54:46,259 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1708509286201.730d49a1c883b1f971bdaa528da8e9ef. after waiting 0 ms 2024-02-21 09:54:46,259 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1708509286201.730d49a1c883b1f971bdaa528da8e9ef. 2024-02-21 09:54:46,259 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1708509286201.730d49a1c883b1f971bdaa528da8e9ef. 2024-02-21 09:54:46,260 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1558): Region close journal for 730d49a1c883b1f971bdaa528da8e9ef: 2024-02-21 09:54:46,265 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ADD_TO_META 2024-02-21 09:54:46,267 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1708509286201.730d49a1c883b1f971bdaa528da8e9ef.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708509286267"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1708509286267"}]},"ts":"1708509286267"} 2024-02-21 09:54:46,269 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-02-21 09:54:46,271 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-02-21 09:54:46,271 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708509286271"}]},"ts":"1708509286271"} 2024-02-21 09:54:46,273 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLING in hbase:meta 2024-02-21 09:54:46,280 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-02-21 09:54:46,281 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-02-21 09:54:46,281 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-02-21 09:54:46,281 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-02-21 09:54:46,282 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=730d49a1c883b1f971bdaa528da8e9ef, ASSIGN}] 2024-02-21 09:54:46,283 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=730d49a1c883b1f971bdaa528da8e9ef, ASSIGN 2024-02-21 09:54:46,284 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin2, region=730d49a1c883b1f971bdaa528da8e9ef, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34401,1708509281333; forceNewPlan=false, retain=false 2024-02-21 09:54:46,435 INFO [jenkins-hbase4:39319] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-02-21 09:54:46,436 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=730d49a1c883b1f971bdaa528da8e9ef, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34401,1708509281333 2024-02-21 09:54:46,436 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1708509286201.730d49a1c883b1f971bdaa528da8e9ef.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708509286435"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1708509286435"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1708509286435"}]},"ts":"1708509286435"} 2024-02-21 09:54:46,439 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE; OpenRegionProcedure 730d49a1c883b1f971bdaa528da8e9ef, server=jenkins-hbase4.apache.org,34401,1708509281333}] 2024-02-21 09:54:46,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-02-21 09:54:46,592 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,34401,1708509281333 2024-02-21 09:54:46,599 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin2,,1708509286201.730d49a1c883b1f971bdaa528da8e9ef. 2024-02-21 09:54:46,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 730d49a1c883b1f971bdaa528da8e9ef, NAME => 'TestQuotaAdmin2,,1708509286201.730d49a1c883b1f971bdaa528da8e9ef.', STARTKEY => '', ENDKEY => ''} 2024-02-21 09:54:46,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin2 730d49a1c883b1f971bdaa528da8e9ef 2024-02-21 09:54:46,599 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1708509286201.730d49a1c883b1f971bdaa528da8e9ef.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-21 09:54:46,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 730d49a1c883b1f971bdaa528da8e9ef 2024-02-21 09:54:46,600 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 730d49a1c883b1f971bdaa528da8e9ef 2024-02-21 09:54:46,601 INFO [StoreOpener-730d49a1c883b1f971bdaa528da8e9ef-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 730d49a1c883b1f971bdaa528da8e9ef 2024-02-21 09:54:46,604 DEBUG [StoreOpener-730d49a1c883b1f971bdaa528da8e9ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/default/TestQuotaAdmin2/730d49a1c883b1f971bdaa528da8e9ef/cf 2024-02-21 09:54:46,604 DEBUG [StoreOpener-730d49a1c883b1f971bdaa528da8e9ef-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/default/TestQuotaAdmin2/730d49a1c883b1f971bdaa528da8e9ef/cf 2024-02-21 09:54:46,604 INFO [StoreOpener-730d49a1c883b1f971bdaa528da8e9ef-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 730d49a1c883b1f971bdaa528da8e9ef columnFamilyName cf 2024-02-21 09:54:46,605 INFO [StoreOpener-730d49a1c883b1f971bdaa528da8e9ef-1] regionserver.HStore(310): Store=730d49a1c883b1f971bdaa528da8e9ef/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-21 09:54:46,607 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/default/TestQuotaAdmin2/730d49a1c883b1f971bdaa528da8e9ef 2024-02-21 09:54:46,608 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/default/TestQuotaAdmin2/730d49a1c883b1f971bdaa528da8e9ef 2024-02-21 09:54:46,613 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 730d49a1c883b1f971bdaa528da8e9ef 2024-02-21 09:54:46,617 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/default/TestQuotaAdmin2/730d49a1c883b1f971bdaa528da8e9ef/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-21 09:54:46,617 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 730d49a1c883b1f971bdaa528da8e9ef; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72778422, jitterRate=0.08448299765586853}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-02-21 09:54:46,618 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 730d49a1c883b1f971bdaa528da8e9ef: 2024-02-21 09:54:46,619 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin2,,1708509286201.730d49a1c883b1f971bdaa528da8e9ef., pid=20, masterSystemTime=1708509286592 2024-02-21 09:54:46,621 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin2,,1708509286201.730d49a1c883b1f971bdaa528da8e9ef. 2024-02-21 09:54:46,621 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin2,,1708509286201.730d49a1c883b1f971bdaa528da8e9ef. 2024-02-21 09:54:46,622 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=730d49a1c883b1f971bdaa528da8e9ef, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34401,1708509281333 2024-02-21 09:54:46,623 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin2,,1708509286201.730d49a1c883b1f971bdaa528da8e9ef.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708509286622"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1708509286622"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1708509286622"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1708509286622"}]},"ts":"1708509286622"} 2024-02-21 09:54:46,628 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=20, resume processing ppid=19 2024-02-21 09:54:46,628 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=20, ppid=19, state=SUCCESS; OpenRegionProcedure 730d49a1c883b1f971bdaa528da8e9ef, server=jenkins-hbase4.apache.org,34401,1708509281333 in 186 msec 2024-02-21 09:54:46,632 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=19, resume processing ppid=18 2024-02-21 09:54:46,632 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=19, ppid=18, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=730d49a1c883b1f971bdaa528da8e9ef, ASSIGN in 346 msec 2024-02-21 09:54:46,633 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-02-21 09:54:46,634 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708509286633"}]},"ts":"1708509286633"} 2024-02-21 09:54:46,636 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLED in hbase:meta 2024-02-21 09:54:46,639 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_POST_OPERATION 2024-02-21 09:54:46,641 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=18, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin2 in 437 msec 2024-02-21 09:54:46,963 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-02-21 09:54:46,963 INFO [Listener at localhost/32959] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin2, procId: 18 completed 2024-02-21 09:54:46,963 DEBUG [Listener at localhost/32959] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin2 get assigned. Timeout = 60000ms 2024-02-21 09:54:46,963 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:54:46,967 INFO [Listener at localhost/32959] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin2 assigned to meta. Checking AM states. 2024-02-21 09:54:46,967 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:54:46,967 INFO [Listener at localhost/32959] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin2 assigned. 2024-02-21 09:54:46,967 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:54:46,977 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-02-21 09:54:46,985 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40782, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=MasterService 2024-02-21 09:54:46,985 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.HMaster$15(3020): Client=jenkins//172.31.14.131 creating {NAME => 'TestNs'} 2024-02-21 09:54:46,988 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] procedure2.ProcedureExecutor(1075): Stored pid=21, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=TestNs 2024-02-21 09:54:46,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-02-21 09:54:47,003 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-02-21 09:54:47,009 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=21, state=SUCCESS; CreateNamespaceProcedure, namespace=TestNs in 20 msec 2024-02-21 09:54:47,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-02-21 09:54:47,252 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-02-21 09:54:47,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] procedure2.ProcedureExecutor(1075): Stored pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestNs:TestTable 2024-02-21 09:54:47,256 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_PRE_OPERATION 2024-02-21 09:54:47,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "TestNs" qualifier: "TestTable" procId is: 22 2024-02-21 09:54:47,257 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-02-21 09:54:47,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-02-21 09:54:47,261 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/TestNs/TestTable/8b329c448d0dff0987d3c57e75ee1f08 2024-02-21 09:54:47,261 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/TestNs/TestTable/800362be1f7b1ce384b2b36967c302f9 2024-02-21 09:54:47,262 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/TestNs/TestTable/8b329c448d0dff0987d3c57e75ee1f08 empty. 2024-02-21 09:54:47,262 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/TestNs/TestTable/800362be1f7b1ce384b2b36967c302f9 empty. 2024-02-21 09:54:47,262 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/TestNs/TestTable/8b329c448d0dff0987d3c57e75ee1f08 2024-02-21 09:54:47,263 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/TestNs/TestTable/800362be1f7b1ce384b2b36967c302f9 2024-02-21 09:54:47,263 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-02-21 09:54:47,282 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/TestNs/TestTable/.tabledesc/.tableinfo.0000000001 2024-02-21 09:54:47,284 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8b329c448d0dff0987d3c57e75ee1f08, NAME => 'TestNs:TestTable,,1708509287251.8b329c448d0dff0987d3c57e75ee1f08.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp 2024-02-21 09:54:47,284 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(7675): creating {ENCODED => 800362be1f7b1ce384b2b36967c302f9, NAME => 'TestNs:TestTable,1,1708509287251.800362be1f7b1ce384b2b36967c302f9.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp 2024-02-21 09:54:47,313 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1708509287251.8b329c448d0dff0987d3c57e75ee1f08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-21 09:54:47,313 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1604): Closing 8b329c448d0dff0987d3c57e75ee1f08, disabling compactions & flushes 2024-02-21 09:54:47,313 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1708509287251.8b329c448d0dff0987d3c57e75ee1f08. 2024-02-21 09:54:47,313 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1708509287251.8b329c448d0dff0987d3c57e75ee1f08. 2024-02-21 09:54:47,313 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1708509287251.8b329c448d0dff0987d3c57e75ee1f08. after waiting 0 ms 2024-02-21 09:54:47,313 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1708509287251.8b329c448d0dff0987d3c57e75ee1f08. 2024-02-21 09:54:47,313 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1708509287251.8b329c448d0dff0987d3c57e75ee1f08. 2024-02-21 09:54:47,314 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1708509287251.800362be1f7b1ce384b2b36967c302f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-21 09:54:47,314 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1558): Region close journal for 8b329c448d0dff0987d3c57e75ee1f08: 2024-02-21 09:54:47,314 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1604): Closing 800362be1f7b1ce384b2b36967c302f9, disabling compactions & flushes 2024-02-21 09:54:47,314 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1708509287251.800362be1f7b1ce384b2b36967c302f9. 2024-02-21 09:54:47,314 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1708509287251.800362be1f7b1ce384b2b36967c302f9. 2024-02-21 09:54:47,314 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1708509287251.800362be1f7b1ce384b2b36967c302f9. after waiting 0 ms 2024-02-21 09:54:47,314 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1708509287251.800362be1f7b1ce384b2b36967c302f9. 2024-02-21 09:54:47,314 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1708509287251.800362be1f7b1ce384b2b36967c302f9. 2024-02-21 09:54:47,314 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1558): Region close journal for 800362be1f7b1ce384b2b36967c302f9: 2024-02-21 09:54:47,320 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ADD_TO_META 2024-02-21 09:54:47,322 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,,1708509287251.8b329c448d0dff0987d3c57e75ee1f08.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1708509287322"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1708509287322"}]},"ts":"1708509287322"} 2024-02-21 09:54:47,322 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1708509287251.800362be1f7b1ce384b2b36967c302f9.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1708509287322"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1708509287322"}]},"ts":"1708509287322"} 2024-02-21 09:54:47,326 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2024-02-21 09:54:47,327 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-02-21 09:54:47,328 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708509287328"}]},"ts":"1708509287328"} 2024-02-21 09:54:47,330 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLING in hbase:meta 2024-02-21 09:54:47,335 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-02-21 09:54:47,337 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-02-21 09:54:47,337 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-02-21 09:54:47,337 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-02-21 09:54:47,338 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=8b329c448d0dff0987d3c57e75ee1f08, ASSIGN}, {pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=800362be1f7b1ce384b2b36967c302f9, ASSIGN}] 2024-02-21 09:54:47,340 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=800362be1f7b1ce384b2b36967c302f9, ASSIGN 2024-02-21 09:54:47,340 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=8b329c448d0dff0987d3c57e75ee1f08, ASSIGN 2024-02-21 09:54:47,342 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=800362be1f7b1ce384b2b36967c302f9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,34401,1708509281333; forceNewPlan=false, retain=false 2024-02-21 09:54:47,342 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=8b329c448d0dff0987d3c57e75ee1f08, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,42163,1708509281284; forceNewPlan=false, retain=false 2024-02-21 09:54:47,492 INFO [jenkins-hbase4:39319] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2024-02-21 09:54:47,493 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=800362be1f7b1ce384b2b36967c302f9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,34401,1708509281333 2024-02-21 09:54:47,493 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=8b329c448d0dff0987d3c57e75ee1f08, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,42163,1708509281284 2024-02-21 09:54:47,494 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1708509287251.8b329c448d0dff0987d3c57e75ee1f08.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1708509287493"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1708509287493"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1708509287493"}]},"ts":"1708509287493"} 2024-02-21 09:54:47,494 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1708509287251.800362be1f7b1ce384b2b36967c302f9.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1708509287493"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1708509287493"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1708509287493"}]},"ts":"1708509287493"} 2024-02-21 09:54:47,497 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 800362be1f7b1ce384b2b36967c302f9, server=jenkins-hbase4.apache.org,34401,1708509281333}] 2024-02-21 09:54:47,499 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=26, ppid=23, state=RUNNABLE; OpenRegionProcedure 8b329c448d0dff0987d3c57e75ee1f08, server=jenkins-hbase4.apache.org,42163,1708509281284}] 2024-02-21 09:54:47,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-02-21 09:54:47,650 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,34401,1708509281333 2024-02-21 09:54:47,652 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42163,1708509281284 2024-02-21 09:54:47,656 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,1,1708509287251.800362be1f7b1ce384b2b36967c302f9. 2024-02-21 09:54:47,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 800362be1f7b1ce384b2b36967c302f9, NAME => 'TestNs:TestTable,1,1708509287251.800362be1f7b1ce384b2b36967c302f9.', STARTKEY => '1', ENDKEY => ''} 2024-02-21 09:54:47,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable 800362be1f7b1ce384b2b36967c302f9 2024-02-21 09:54:47,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1708509287251.800362be1f7b1ce384b2b36967c302f9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-21 09:54:47,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 800362be1f7b1ce384b2b36967c302f9 2024-02-21 09:54:47,657 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 800362be1f7b1ce384b2b36967c302f9 2024-02-21 09:54:47,658 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,,1708509287251.8b329c448d0dff0987d3c57e75ee1f08. 2024-02-21 09:54:47,658 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8b329c448d0dff0987d3c57e75ee1f08, NAME => 'TestNs:TestTable,,1708509287251.8b329c448d0dff0987d3c57e75ee1f08.', STARTKEY => '', ENDKEY => '1'} 2024-02-21 09:54:47,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable 8b329c448d0dff0987d3c57e75ee1f08 2024-02-21 09:54:47,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1708509287251.8b329c448d0dff0987d3c57e75ee1f08.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-21 09:54:47,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8b329c448d0dff0987d3c57e75ee1f08 2024-02-21 09:54:47,659 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8b329c448d0dff0987d3c57e75ee1f08 2024-02-21 09:54:47,659 INFO [StoreOpener-800362be1f7b1ce384b2b36967c302f9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 800362be1f7b1ce384b2b36967c302f9 2024-02-21 09:54:47,660 INFO [StoreOpener-8b329c448d0dff0987d3c57e75ee1f08-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8b329c448d0dff0987d3c57e75ee1f08 2024-02-21 09:54:47,661 DEBUG [StoreOpener-800362be1f7b1ce384b2b36967c302f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/TestNs/TestTable/800362be1f7b1ce384b2b36967c302f9/cf 2024-02-21 09:54:47,661 DEBUG [StoreOpener-800362be1f7b1ce384b2b36967c302f9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/TestNs/TestTable/800362be1f7b1ce384b2b36967c302f9/cf 2024-02-21 09:54:47,662 INFO [StoreOpener-800362be1f7b1ce384b2b36967c302f9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 800362be1f7b1ce384b2b36967c302f9 columnFamilyName cf 2024-02-21 09:54:47,662 INFO [StoreOpener-800362be1f7b1ce384b2b36967c302f9-1] regionserver.HStore(310): Store=800362be1f7b1ce384b2b36967c302f9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-21 09:54:47,664 DEBUG [StoreOpener-8b329c448d0dff0987d3c57e75ee1f08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/TestNs/TestTable/8b329c448d0dff0987d3c57e75ee1f08/cf 2024-02-21 09:54:47,664 DEBUG [StoreOpener-8b329c448d0dff0987d3c57e75ee1f08-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/TestNs/TestTable/8b329c448d0dff0987d3c57e75ee1f08/cf 2024-02-21 09:54:47,665 INFO [StoreOpener-8b329c448d0dff0987d3c57e75ee1f08-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8b329c448d0dff0987d3c57e75ee1f08 columnFamilyName cf 2024-02-21 09:54:47,665 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/TestNs/TestTable/800362be1f7b1ce384b2b36967c302f9 2024-02-21 09:54:47,666 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/TestNs/TestTable/800362be1f7b1ce384b2b36967c302f9 2024-02-21 09:54:47,667 INFO [StoreOpener-8b329c448d0dff0987d3c57e75ee1f08-1] regionserver.HStore(310): Store=8b329c448d0dff0987d3c57e75ee1f08/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-21 09:54:47,669 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/TestNs/TestTable/8b329c448d0dff0987d3c57e75ee1f08 2024-02-21 09:54:47,670 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/TestNs/TestTable/8b329c448d0dff0987d3c57e75ee1f08 2024-02-21 09:54:47,671 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 800362be1f7b1ce384b2b36967c302f9 2024-02-21 09:54:47,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8b329c448d0dff0987d3c57e75ee1f08 2024-02-21 09:54:47,676 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/TestNs/TestTable/800362be1f7b1ce384b2b36967c302f9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-21 09:54:47,677 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 800362be1f7b1ce384b2b36967c302f9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68886776, jitterRate=0.026492953300476074}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-02-21 09:54:47,677 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 800362be1f7b1ce384b2b36967c302f9: 2024-02-21 09:54:47,679 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestNs:TestTable,1,1708509287251.800362be1f7b1ce384b2b36967c302f9., pid=25, masterSystemTime=1708509287650 2024-02-21 09:54:47,680 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/TestNs/TestTable/8b329c448d0dff0987d3c57e75ee1f08/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-21 09:54:47,681 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8b329c448d0dff0987d3c57e75ee1f08; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73707732, jitterRate=0.0983307957649231}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-02-21 09:54:47,681 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8b329c448d0dff0987d3c57e75ee1f08: 2024-02-21 09:54:47,682 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestNs:TestTable,1,1708509287251.800362be1f7b1ce384b2b36967c302f9. 2024-02-21 09:54:47,682 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,1,1708509287251.800362be1f7b1ce384b2b36967c302f9. 2024-02-21 09:54:47,682 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestNs:TestTable,,1708509287251.8b329c448d0dff0987d3c57e75ee1f08., pid=26, masterSystemTime=1708509287652 2024-02-21 09:54:47,682 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=800362be1f7b1ce384b2b36967c302f9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,34401,1708509281333 2024-02-21 09:54:47,683 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,1,1708509287251.800362be1f7b1ce384b2b36967c302f9.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1708509287682"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1708509287682"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1708509287682"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1708509287682"}]},"ts":"1708509287682"} 2024-02-21 09:54:47,685 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestNs:TestTable,,1708509287251.8b329c448d0dff0987d3c57e75ee1f08. 2024-02-21 09:54:47,685 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,,1708509287251.8b329c448d0dff0987d3c57e75ee1f08. 2024-02-21 09:54:47,686 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=8b329c448d0dff0987d3c57e75ee1f08, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,42163,1708509281284 2024-02-21 09:54:47,687 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,,1708509287251.8b329c448d0dff0987d3c57e75ee1f08.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1708509287686"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1708509287686"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1708509287686"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1708509287686"}]},"ts":"1708509287686"} 2024-02-21 09:54:47,690 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=25, resume processing ppid=24 2024-02-21 09:54:47,690 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 800362be1f7b1ce384b2b36967c302f9, server=jenkins-hbase4.apache.org,34401,1708509281333 in 188 msec 2024-02-21 09:54:47,693 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=26, resume processing ppid=23 2024-02-21 09:54:47,694 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=26, ppid=23, state=SUCCESS; OpenRegionProcedure 8b329c448d0dff0987d3c57e75ee1f08, server=jenkins-hbase4.apache.org,42163,1708509281284 in 191 msec 2024-02-21 09:54:47,694 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=24, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=800362be1f7b1ce384b2b36967c302f9, ASSIGN in 352 msec 2024-02-21 09:54:47,697 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=23, resume processing ppid=22 2024-02-21 09:54:47,697 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=23, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=8b329c448d0dff0987d3c57e75ee1f08, ASSIGN in 356 msec 2024-02-21 09:54:47,699 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-02-21 09:54:47,699 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708509287699"}]},"ts":"1708509287699"} 2024-02-21 09:54:47,702 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLED in hbase:meta 2024-02-21 09:54:47,705 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_POST_OPERATION 2024-02-21 09:54:47,708 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=22, state=SUCCESS; CreateTableProcedure table=TestNs:TestTable in 454 msec 2024-02-21 09:54:48,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-02-21 09:54:48,013 INFO [Listener at localhost/32959] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: TestNs:TestTable, procId: 22 completed 2024-02-21 09:54:48,013 DEBUG [Listener at localhost/32959] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestNs:TestTable get assigned. Timeout = 60000ms 2024-02-21 09:54:48,013 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:54:48,018 INFO [Listener at localhost/32959] hbase.HBaseTestingUtility(3484): All regions for table TestNs:TestTable assigned to meta. Checking AM states. 2024-02-21 09:54:48,018 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:54:48,018 INFO [Listener at localhost/32959] hbase.HBaseTestingUtility(3504): All regions for table TestNs:TestTable assigned. 2024-02-21 09:54:48,018 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:54:48,070 INFO [Listener at localhost/32959] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=308, OpenFileDescriptor=629, MaxFileDescriptor=60000, SystemLoadAverage=305, ProcessCount=167, AvailableMemoryMB=8091 2024-02-21 09:54:48,371 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:54:48,371 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-21 09:54:48,371 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708512888119 bypass), TestNs=QuotaState(ts=1708512888119 bypass)} 2024-02-21 09:54:48,371 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1708512888119 bypass), TestNs:TestTable=QuotaState(ts=1708512888119 bypass), TestQuotaAdmin1=QuotaState(ts=1708512888119 bypass)} 2024-02-21 09:54:48,372 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1708512888119 [ TestNs:TestTable ])} 2024-02-21 09:54:48,372 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708512888119 bypass)} 2024-02-21 09:54:48,622 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:54:48,622 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-21 09:54:48,622 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708512888119 bypass), TestNs=QuotaState(ts=1708512888119 bypass)} 2024-02-21 09:54:48,622 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1708512888119 bypass), TestQuotaAdmin2=QuotaState(ts=1708512888119 bypass)} 2024-02-21 09:54:48,622 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1708512888119 [ TestNs:TestTable ])} 2024-02-21 09:54:48,622 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708512888119 bypass)} 2024-02-21 09:54:48,629 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2024-02-21 09:54:48,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:54:48,642 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] ipc.CallRunner(144): callId: 90 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:43426 deadline: 1708509298641, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:54:48,689 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin0' 2024-02-21 09:54:48,690 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2024-02-21 09:54:48,690 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestNs:TestTable' 2024-02-21 09:54:48,690 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin1' 2024-02-21 09:54:48,691 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2024-02-21 09:54:48,691 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin2' 2024-02-21 09:54:48,692 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:quota' 2024-02-21 09:54:48,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:54:48,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] ipc.CallRunner(144): callId: 92 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:43426 deadline: 1708509298640, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:54:49,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:54:49,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] ipc.CallRunner(144): callId: 94 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:43426 deadline: 1708509298641, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:54:50,182 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:54:50,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] ipc.CallRunner(144): callId: 96 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:43426 deadline: 1708509298640, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:54:50,232 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-02-21 09:54:50,233 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver Metrics about HBase MasterObservers 2024-02-21 09:54:50,233 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-02-21 09:54:50,234 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2024-02-21 09:54:51,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:54:51,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] ipc.CallRunner(144): callId: 98 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:43426 deadline: 1708509298641, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:54:53,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:54:53,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] ipc.CallRunner(144): callId: 100 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:43426 deadline: 1708509298641, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:54:53,957 ERROR [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10354: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1708509287251.800362be1f7b1ce384b2b36967c302f9., hostname=jenkins-hbase4.apache.org,34401,1708509281333, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-21 09:54:53,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:54:53,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] ipc.CallRunner(144): callId: 101 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:43426 deadline: 1708509303960, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:54:54,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:54:54,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] ipc.CallRunner(144): callId: 103 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:43426 deadline: 1708509303960, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:54:54,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:54:54,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] ipc.CallRunner(144): callId: 105 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:43426 deadline: 1708509303961, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:54:55,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:54:55,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] ipc.CallRunner(144): callId: 107 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:43426 deadline: 1708509303961, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:54:56,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:54:56,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] ipc.CallRunner(144): callId: 109 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:43426 deadline: 1708509303961, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:54:59,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:54:59,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] ipc.CallRunner(144): callId: 111 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:43426 deadline: 1708509303960, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:54:59,257 ERROR [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10328: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1708509287251.800362be1f7b1ce384b2b36967c302f9., hostname=jenkins-hbase4.apache.org,34401,1708509281333, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-21 09:54:59,519 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:54:59,519 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-21 09:54:59,519 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708516488119 bypass), TestNs=QuotaState(ts=1708516488119 bypass)} 2024-02-21 09:54:59,519 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1708516488119 bypass), TestNs:TestTable=QuotaState(ts=1708516488119 bypass), TestQuotaAdmin1=QuotaState(ts=1708516488119 bypass)} 2024-02-21 09:54:59,519 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1708516488119 bypass)} 2024-02-21 09:54:59,519 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708516488119 bypass)} 2024-02-21 09:54:59,769 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:54:59,770 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-21 09:54:59,770 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708516488119 bypass), TestNs=QuotaState(ts=1708516488119 bypass)} 2024-02-21 09:54:59,770 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1708516488119 bypass), TestQuotaAdmin2=QuotaState(ts=1708516488119 bypass)} 2024-02-21 09:54:59,770 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1708516488119 bypass)} 2024-02-21 09:54:59,770 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708516488119 bypass)} 2024-02-21 09:54:59,785 INFO [Listener at localhost/32959] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=291 (was 308), OpenFileDescriptor=601 (was 629), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=274 (was 305), ProcessCount=167 (was 167), AvailableMemoryMB=8027 (was 8091) 2024-02-21 09:54:59,799 INFO [Listener at localhost/32959] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=291, OpenFileDescriptor=601, MaxFileDescriptor=60000, SystemLoadAverage=274, ProcessCount=167, AvailableMemoryMB=8026 2024-02-21 09:55:00,063 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:55:00,064 INFO [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-02-21 09:55:00,314 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-21 09:55:00,315 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708520088219 bypass), TestNs=QuotaState(ts=1708520088219 bypass)} 2024-02-21 09:55:00,317 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1708520088219 bypass), TestNs:TestTable=QuotaState(ts=1708520088219 bypass), TestQuotaAdmin1=QuotaState(ts=1708520088219 bypass)} 2024-02-21 09:55:00,317 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1708520088219 [ default ])} 2024-02-21 09:55:00,317 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708520088219 bypass)} 2024-02-21 09:55:00,567 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:55:00,568 INFO [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-02-21 09:55:00,818 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-21 09:55:00,819 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708520088319 bypass), TestNs=QuotaState(ts=1708520088319 bypass)} 2024-02-21 09:55:00,820 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1708520088319 bypass), TestQuotaAdmin2=QuotaState(ts=1708520088319 bypass)} 2024-02-21 09:55:00,820 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1708520088319 [ default ])} 2024-02-21 09:55:00,820 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708520088319 bypass)} 2024-02-21 09:55:00,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-02-21 09:55:00,830 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 123 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:57968 deadline: 1708509310830, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-02-21 09:55:01,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-02-21 09:55:01,087 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 125 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:57968 deadline: 1708509310831, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-02-21 09:55:01,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-02-21 09:55:01,596 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 127 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:57968 deadline: 1708509310830, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-02-21 09:55:02,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-02-21 09:55:02,355 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 129 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57968 deadline: 1708509310831, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-02-21 09:55:03,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-02-21 09:55:03,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 131 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57968 deadline: 1708509310831, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-02-21 09:55:06,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-02-21 09:55:06,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 133 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57968 deadline: 1708509310830, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-02-21 09:55:06,133 ERROR [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10310: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57., hostname=jenkins-hbase4.apache.org,42163,1708509281284, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:199) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor37.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-21 09:55:06,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:06,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 140 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57968 deadline: 1708509316149, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:06,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:06,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 142 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57968 deadline: 1708509316149, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:06,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:06,912 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 144 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57968 deadline: 1708509316148, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:07,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:07,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 146 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57968 deadline: 1708509316148, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:08,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:08,931 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 148 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57968 deadline: 1708509316148, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:11,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:11,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 150 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57968 deadline: 1708509316148, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:11,452 ERROR [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10335: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57., hostname=jenkins-hbase4.apache.org,42163,1708509281284, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:200) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor37.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-21 09:55:11,709 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:55:11,709 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-21 09:55:11,709 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708523688319 bypass), TestNs=QuotaState(ts=1708523688319 bypass)} 2024-02-21 09:55:11,709 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1708523688319 bypass), TestNs:TestTable=QuotaState(ts=1708523688319 bypass), TestQuotaAdmin1=QuotaState(ts=1708523688319 bypass)} 2024-02-21 09:55:11,709 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1708523688319 bypass)} 2024-02-21 09:55:11,709 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708523688319 bypass)} 2024-02-21 09:55:11,960 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:55:11,960 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-21 09:55:11,960 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708523688319 bypass), TestNs=QuotaState(ts=1708523688319 bypass)} 2024-02-21 09:55:11,960 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1708523688319 bypass), TestQuotaAdmin2=QuotaState(ts=1708523688319 bypass)} 2024-02-21 09:55:11,960 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1708523688319 bypass)} 2024-02-21 09:55:11,960 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708523688319 bypass)} 2024-02-21 09:55:11,974 INFO [Listener at localhost/32959] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=291 (was 291), OpenFileDescriptor=597 (was 601), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=235 (was 274), ProcessCount=167 (was 167), AvailableMemoryMB=8031 (was 8026) - AvailableMemoryMB LEAK? - 2024-02-21 09:55:11,989 INFO [Listener at localhost/32959] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=291, OpenFileDescriptor=597, MaxFileDescriptor=60000, SystemLoadAverage=235, ProcessCount=167, AvailableMemoryMB=8030 2024-02-21 09:55:12,252 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:55:12,252 INFO [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-02-21 09:55:12,503 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-21 09:55:12,504 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708527288419 bypass), TestNs=QuotaState(ts=1708527288419 bypass)} 2024-02-21 09:55:12,504 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1708527288419 bypass), TestNs:TestTable=QuotaState(ts=1708527288419 bypass), TestQuotaAdmin1=QuotaState(ts=1708527288419 bypass)} 2024-02-21 09:55:12,504 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1708527288419 global-limiter)} 2024-02-21 09:55:12,505 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708527288419 bypass)} 2024-02-21 09:55:12,755 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:55:12,755 INFO [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-02-21 09:55:13,006 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-21 09:55:13,007 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708527288519 bypass), TestNs=QuotaState(ts=1708527288519 bypass)} 2024-02-21 09:55:13,008 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1708527288519 bypass), TestQuotaAdmin2=QuotaState(ts=1708527288519 bypass)} 2024-02-21 09:55:13,008 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1708527288519 global-limiter)} 2024-02-21 09:55:13,008 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708527288519 bypass)} 2024-02-21 09:55:13,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:13,026 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 163 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57968 deadline: 1708509323026, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:13,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:13,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 165 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57968 deadline: 1708509323026, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:13,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:13,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 167 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57968 deadline: 1708509323026, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:14,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:14,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 169 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57968 deadline: 1708509323025, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:15,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:15,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 171 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57968 deadline: 1708509323025, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:18,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:18,312 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 173 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57968 deadline: 1708509323026, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:18,313 ERROR [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10313: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57., hostname=jenkins-hbase4.apache.org,42163,1708509281284, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:178) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor37.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-21 09:55:18,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-02-21 09:55:18,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 177 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57968 deadline: 1708509328319, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-02-21 09:55:18,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-02-21 09:55:18,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 179 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57968 deadline: 1708509328319, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-02-21 09:55:19,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-02-21 09:55:19,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 181 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57968 deadline: 1708509328320, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-02-21 09:55:19,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-02-21 09:55:19,844 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 183 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57968 deadline: 1708509328319, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-02-21 09:55:21,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-02-21 09:55:21,100 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 185 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57968 deadline: 1708509328319, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-02-21 09:55:23,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-02-21 09:55:23,608 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 187 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57968 deadline: 1708509328320, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-02-21 09:55:23,609 ERROR [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=3 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10296: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-3' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57., hostname=jenkins-hbase4.apache.org,42163,1708509281284, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor37.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-21 09:55:23,865 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:55:23,866 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-21 09:55:23,866 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708530888519 bypass), TestNs=QuotaState(ts=1708530888519 bypass)} 2024-02-21 09:55:23,866 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1708530888519 bypass), TestNs:TestTable=QuotaState(ts=1708530888519 bypass), TestQuotaAdmin1=QuotaState(ts=1708530888519 bypass)} 2024-02-21 09:55:23,866 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1708530888519 bypass)} 2024-02-21 09:55:23,866 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708530888519 bypass)} 2024-02-21 09:55:24,116 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:55:24,116 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-21 09:55:24,116 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708530888519 bypass), TestNs=QuotaState(ts=1708530888519 bypass)} 2024-02-21 09:55:24,116 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1708530888519 bypass), TestQuotaAdmin2=QuotaState(ts=1708530888519 bypass)} 2024-02-21 09:55:24,116 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1708530888519 bypass)} 2024-02-21 09:55:24,117 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708530888519 bypass)} 2024-02-21 09:55:24,130 INFO [Listener at localhost/32959] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=282 (was 291), OpenFileDescriptor=595 (was 597), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=229 (was 235), ProcessCount=167 (was 167), AvailableMemoryMB=8437 (was 8030) - AvailableMemoryMB LEAK? - 2024-02-21 09:55:24,143 INFO [Listener at localhost/32959] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=282, OpenFileDescriptor=595, MaxFileDescriptor=60000, SystemLoadAverage=229, ProcessCount=167, AvailableMemoryMB=8437 2024-02-21 09:55:24,400 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:55:24,401 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-21 09:55:24,402 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708534488519 bypass), TestNs=QuotaState(ts=1708534488519 bypass)} 2024-02-21 09:55:24,403 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1708534488519 bypass), TestNs:TestTable=QuotaState(ts=1708534488519 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin1=QuotaState(ts=1708534488519 bypass)} 2024-02-21 09:55:24,403 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(218): {} 2024-02-21 09:55:24,404 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708534488519 bypass)} 2024-02-21 09:55:24,655 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:55:24,655 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-21 09:55:24,655 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708534488519 bypass), TestNs=QuotaState(ts=1708534488519 bypass)} 2024-02-21 09:55:24,656 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1708534488519 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin2=QuotaState(ts=1708534488519 bypass)} 2024-02-21 09:55:24,656 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(218): {} 2024-02-21 09:55:24,656 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708534488519 bypass)} 2024-02-21 09:55:24,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:55:24,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] ipc.CallRunner(144): callId: 202 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:43426 deadline: 1708509334671, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:55:24,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:55:24,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] ipc.CallRunner(144): callId: 204 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:43426 deadline: 1708509334672, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:55:25,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:55:25,432 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] ipc.CallRunner(144): callId: 206 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:43426 deadline: 1708509334671, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:55:26,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:55:26,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] ipc.CallRunner(144): callId: 208 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:43426 deadline: 1708509334672, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:55:27,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:55:27,450 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] ipc.CallRunner(144): callId: 210 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:43426 deadline: 1708509334672, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:55:29,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:55:29,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] ipc.CallRunner(144): callId: 212 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:43426 deadline: 1708509334672, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:55:29,959 ERROR [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10331: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1708509287251.800362be1f7b1ce384b2b36967c302f9., hostname=jenkins-hbase4.apache.org,34401,1708509281333, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor37.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-21 09:55:29,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:55:29,960 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] ipc.CallRunner(144): callId: 213 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:43426 deadline: 1708509339960, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:55:30,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:55:30,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] ipc.CallRunner(144): callId: 215 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:43426 deadline: 1708509339960, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:55:30,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:55:30,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] ipc.CallRunner(144): callId: 217 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:43426 deadline: 1708509339960, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:55:31,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:55:31,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] ipc.CallRunner(144): callId: 219 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:43426 deadline: 1708509339960, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:55:32,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:55:32,738 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] ipc.CallRunner(144): callId: 221 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:43426 deadline: 1708509339961, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:55:35,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:55:35,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=34401] ipc.CallRunner(144): callId: 223 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:43426 deadline: 1708509339960, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-21 09:55:35,256 ERROR [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10309: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1708509287251.800362be1f7b1ce384b2b36967c302f9., hostname=jenkins-hbase4.apache.org,34401,1708509281333, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor37.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-21 09:55:35,515 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:55:35,515 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-21 09:55:35,515 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708538088519 bypass), TestNs=QuotaState(ts=1708538088519 bypass)} 2024-02-21 09:55:35,515 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1708538088519 bypass), TestNs:TestTable=QuotaState(ts=1708538088519 bypass), TestQuotaAdmin1=QuotaState(ts=1708538088519 bypass)} 2024-02-21 09:55:35,515 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(218): {} 2024-02-21 09:55:35,515 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708538088519 bypass)} 2024-02-21 09:55:35,766 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:55:35,766 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-21 09:55:35,766 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708538088519 bypass), TestNs=QuotaState(ts=1708538088519 bypass)} 2024-02-21 09:55:35,766 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1708538088519 bypass), TestQuotaAdmin2=QuotaState(ts=1708538088519 bypass)} 2024-02-21 09:55:35,766 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1708538088519 bypass)} 2024-02-21 09:55:35,766 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708538088519 bypass)} 2024-02-21 09:55:35,781 INFO [Listener at localhost/32959] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=281 (was 282), OpenFileDescriptor=595 (was 595), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=195 (was 229), ProcessCount=167 (was 167), AvailableMemoryMB=8214 (was 8437) 2024-02-21 09:55:35,796 INFO [Listener at localhost/32959] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=281, OpenFileDescriptor=595, MaxFileDescriptor=60000, SystemLoadAverage=195, ProcessCount=167, AvailableMemoryMB=8211 2024-02-21 09:55:36,058 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:55:36,058 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-21 09:55:36,059 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708541688519 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1708541688519 bypass)} 2024-02-21 09:55:36,059 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1708541688519 bypass), TestNs:TestTable=QuotaState(ts=1708541688519 bypass), TestQuotaAdmin1=QuotaState(ts=1708541688519 bypass)} 2024-02-21 09:55:36,059 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(218): {} 2024-02-21 09:55:36,059 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708541688519 bypass)} 2024-02-21 09:55:36,310 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:55:36,310 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-21 09:55:36,312 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708541688519 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1708541688519 bypass)} 2024-02-21 09:55:36,312 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1708541688519 bypass), TestQuotaAdmin2=QuotaState(ts=1708541688519 bypass)} 2024-02-21 09:55:36,312 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(218): {} 2024-02-21 09:55:36,312 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708541688519 bypass)} 2024-02-21 09:55:36,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-02-21 09:55:36,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 235 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57968 deadline: 1708509346336, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-02-21 09:55:36,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-02-21 09:55:36,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 237 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57968 deadline: 1708509346336, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-02-21 09:55:37,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-02-21 09:55:37,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 239 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57968 deadline: 1708509346335, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-02-21 09:55:37,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-02-21 09:55:37,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 241 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57968 deadline: 1708509346336, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-02-21 09:55:39,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-02-21 09:55:39,113 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 243 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57968 deadline: 1708509346336, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-02-21 09:55:41,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-02-21 09:55:41,626 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 245 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:57968 deadline: 1708509346336, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-02-21 09:55:41,627 ERROR [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10338: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57., hostname=jenkins-hbase4.apache.org,42163,1708509281284, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:128) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor37.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-21 09:55:41,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:41,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 252 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57968 deadline: 1708509351637, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:41,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:41,892 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 254 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57968 deadline: 1708509351638, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:42,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:42,398 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 256 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57968 deadline: 1708509351638, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:43,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:43,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 258 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57968 deadline: 1708509351638, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:44,415 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:44,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 260 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57968 deadline: 1708509351637, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:46,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:46,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=42163] ipc.CallRunner(144): callId: 262 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:57968 deadline: 1708509351637, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-02-21 09:55:46,936 ERROR [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10342: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57., hostname=jenkins-hbase4.apache.org,42163,1708509281284, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor37.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-21 09:55:47,194 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:55:47,194 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-21 09:55:47,194 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708545288519 bypass), TestNs=QuotaState(ts=1708545288519 bypass)} 2024-02-21 09:55:47,195 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1708545288519 bypass), TestNs:TestTable=QuotaState(ts=1708545288519 bypass), TestQuotaAdmin1=QuotaState(ts=1708545288519 bypass)} 2024-02-21 09:55:47,195 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1708545288519 bypass)} 2024-02-21 09:55:47,195 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708545288519 bypass)} 2024-02-21 09:55:47,445 INFO [Listener at localhost/32959] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-21 09:55:47,445 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-21 09:55:47,445 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708545288519 bypass), TestNs=QuotaState(ts=1708545288519 bypass)} 2024-02-21 09:55:47,445 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1708545288519 bypass), TestQuotaAdmin2=QuotaState(ts=1708545288519 bypass)} 2024-02-21 09:55:47,445 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(218): {} 2024-02-21 09:55:47,445 DEBUG [Listener at localhost/32959] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708545288519 bypass)} 2024-02-21 09:55:47,459 INFO [Listener at localhost/32959] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=267 (was 281), OpenFileDescriptor=583 (was 595), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=229 (was 195) - SystemLoadAverage LEAK? -, ProcessCount=167 (was 167), AvailableMemoryMB=7869 (was 8211) 2024-02-21 09:55:47,462 INFO [Listener at localhost/32959] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin0 2024-02-21 09:55:47,467 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin0 2024-02-21 09:55:47,473 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] procedure2.ProcedureExecutor(1075): Stored pid=27, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin0 2024-02-21 09:55:47,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-02-21 09:55:47,483 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708509347483"}]},"ts":"1708509347483"} 2024-02-21 09:55:47,486 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLING in hbase:meta 2024-02-21 09:55:47,489 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set TestQuotaAdmin0 to state=DISABLING 2024-02-21 09:55:47,492 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=f97a621c5a71963a0e03c57d6b687f57, UNASSIGN}] 2024-02-21 09:55:47,493 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=f97a621c5a71963a0e03c57d6b687f57, UNASSIGN 2024-02-21 09:55:47,495 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=f97a621c5a71963a0e03c57d6b687f57, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42163,1708509281284 2024-02-21 09:55:47,495 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708509347494"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1708509347494"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1708509347494"}]},"ts":"1708509347494"} 2024-02-21 09:55:47,497 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure f97a621c5a71963a0e03c57d6b687f57, server=jenkins-hbase4.apache.org,42163,1708509281284}] 2024-02-21 09:55:47,653 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase4.apache.org,42163,1708509281284, timeout=1708509347655, delay=2, operations=[pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure f97a621c5a71963a0e03c57d6b687f57, server=jenkins-hbase4.apache.org,42163,1708509281284]] 2024-02-21 09:55:47,658 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42163,1708509281284 2024-02-21 09:55:47,660 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f97a621c5a71963a0e03c57d6b687f57 2024-02-21 09:55:47,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f97a621c5a71963a0e03c57d6b687f57, disabling compactions & flushes 2024-02-21 09:55:47,662 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57. 2024-02-21 09:55:47,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57. 2024-02-21 09:55:47,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57. after waiting 0 ms 2024-02-21 09:55:47,662 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57. 2024-02-21 09:55:47,662 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f97a621c5a71963a0e03c57d6b687f57 1/1 column families, dataSize=578 B heapSize=2.11 KB 2024-02-21 09:55:47,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-02-21 09:55:47,739 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=578 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/default/TestQuotaAdmin0/f97a621c5a71963a0e03c57d6b687f57/.tmp/cf/0c629babeaf1449fbf04fc6766b68691 2024-02-21 09:55:47,786 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/default/TestQuotaAdmin0/f97a621c5a71963a0e03c57d6b687f57/.tmp/cf/0c629babeaf1449fbf04fc6766b68691 as hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/default/TestQuotaAdmin0/f97a621c5a71963a0e03c57d6b687f57/cf/0c629babeaf1449fbf04fc6766b68691 2024-02-21 09:55:47,796 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/default/TestQuotaAdmin0/f97a621c5a71963a0e03c57d6b687f57/cf/0c629babeaf1449fbf04fc6766b68691, entries=6, sequenceid=21, filesize=4.7 K 2024-02-21 09:55:47,799 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~578 B/578, heapSize ~2.09 KB/2144, currentSize=0 B/0 for f97a621c5a71963a0e03c57d6b687f57 in 137ms, sequenceid=21, compaction requested=false 2024-02-21 09:55:47,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/default/TestQuotaAdmin0/f97a621c5a71963a0e03c57d6b687f57/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2024-02-21 09:55:47,810 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57. 2024-02-21 09:55:47,810 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f97a621c5a71963a0e03c57d6b687f57: 2024-02-21 09:55:47,812 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f97a621c5a71963a0e03c57d6b687f57 2024-02-21 09:55:47,812 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=f97a621c5a71963a0e03c57d6b687f57, regionState=CLOSED 2024-02-21 09:55:47,812 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708509347812"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1708509347812"}]},"ts":"1708509347812"} 2024-02-21 09:55:47,816 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=29, resume processing ppid=28 2024-02-21 09:55:47,816 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=29, ppid=28, state=SUCCESS; CloseRegionProcedure f97a621c5a71963a0e03c57d6b687f57, server=jenkins-hbase4.apache.org,42163,1708509281284 in 317 msec 2024-02-21 09:55:47,818 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=28, resume processing ppid=27 2024-02-21 09:55:47,818 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=f97a621c5a71963a0e03c57d6b687f57, UNASSIGN in 324 msec 2024-02-21 09:55:47,819 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708509347819"}]},"ts":"1708509347819"} 2024-02-21 09:55:47,821 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLED in hbase:meta 2024-02-21 09:55:47,823 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set TestQuotaAdmin0 to state=DISABLED 2024-02-21 09:55:47,825 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=27, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin0 in 356 msec 2024-02-21 09:55:48,236 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-02-21 09:55:48,237 INFO [Listener at localhost/32959] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin0, procId: 27 completed 2024-02-21 09:55:48,242 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin0 2024-02-21 09:55:48,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] procedure2.ProcedureExecutor(1075): Stored pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin0 2024-02-21 09:55:48,251 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-02-21 09:55:48,254 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=30, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-02-21 09:55:48,257 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-02-21 09:55:48,261 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/default/TestQuotaAdmin0/f97a621c5a71963a0e03c57d6b687f57 2024-02-21 09:55:48,266 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/default/TestQuotaAdmin0/f97a621c5a71963a0e03c57d6b687f57/cf, FileablePath, hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/default/TestQuotaAdmin0/f97a621c5a71963a0e03c57d6b687f57/recovered.edits] 2024-02-21 09:55:48,277 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/default/TestQuotaAdmin0/f97a621c5a71963a0e03c57d6b687f57/cf/0c629babeaf1449fbf04fc6766b68691 to hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/archive/data/default/TestQuotaAdmin0/f97a621c5a71963a0e03c57d6b687f57/cf/0c629babeaf1449fbf04fc6766b68691 2024-02-21 09:55:48,283 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/default/TestQuotaAdmin0/f97a621c5a71963a0e03c57d6b687f57/recovered.edits/24.seqid to hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/archive/data/default/TestQuotaAdmin0/f97a621c5a71963a0e03c57d6b687f57/recovered.edits/24.seqid 2024-02-21 09:55:48,284 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/default/TestQuotaAdmin0/f97a621c5a71963a0e03c57d6b687f57 2024-02-21 09:55:48,284 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-02-21 09:55:48,288 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=30, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-02-21 09:55:48,314 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin0 from hbase:meta 2024-02-21 09:55:48,317 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin0' descriptor. 2024-02-21 09:55:48,319 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=30, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-02-21 09:55:48,319 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin0' from region states. 2024-02-21 09:55:48,319 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1708509348319"}]},"ts":"9223372036854775807"} 2024-02-21 09:55:48,322 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-02-21 09:55:48,322 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => f97a621c5a71963a0e03c57d6b687f57, NAME => 'TestQuotaAdmin0,,1708509284609.f97a621c5a71963a0e03c57d6b687f57.', STARTKEY => '', ENDKEY => ''}] 2024-02-21 09:55:48,322 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin0' as deleted. 2024-02-21 09:55:48,322 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1708509348322"}]},"ts":"9223372036854775807"} 2024-02-21 09:55:48,324 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin0 state from META 2024-02-21 09:55:48,327 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=30, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-02-21 09:55:48,328 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=30, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin0 in 84 msec 2024-02-21 09:55:48,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-02-21 09:55:48,509 INFO [Listener at localhost/32959] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin0, procId: 30 completed 2024-02-21 09:55:48,509 INFO [Listener at localhost/32959] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin1 2024-02-21 09:55:48,509 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin1 2024-02-21 09:55:48,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] procedure2.ProcedureExecutor(1075): Stored pid=31, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin1 2024-02-21 09:55:48,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-02-21 09:55:48,515 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708509348514"}]},"ts":"1708509348514"} 2024-02-21 09:55:48,516 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLING in hbase:meta 2024-02-21 09:55:48,518 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set TestQuotaAdmin1 to state=DISABLING 2024-02-21 09:55:48,519 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=d19b68d185ede7ded0c9f2612bfc98b6, UNASSIGN}] 2024-02-21 09:55:48,520 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=d19b68d185ede7ded0c9f2612bfc98b6, UNASSIGN 2024-02-21 09:55:48,521 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=d19b68d185ede7ded0c9f2612bfc98b6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42163,1708509281284 2024-02-21 09:55:48,522 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1708509285424.d19b68d185ede7ded0c9f2612bfc98b6.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708509348521"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1708509348521"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1708509348521"}]},"ts":"1708509348521"} 2024-02-21 09:55:48,523 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=33, ppid=32, state=RUNNABLE; CloseRegionProcedure d19b68d185ede7ded0c9f2612bfc98b6, server=jenkins-hbase4.apache.org,42163,1708509281284}] 2024-02-21 09:55:48,675 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42163,1708509281284 2024-02-21 09:55:48,676 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close d19b68d185ede7ded0c9f2612bfc98b6 2024-02-21 09:55:48,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d19b68d185ede7ded0c9f2612bfc98b6, disabling compactions & flushes 2024-02-21 09:55:48,677 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1708509285424.d19b68d185ede7ded0c9f2612bfc98b6. 2024-02-21 09:55:48,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1708509285424.d19b68d185ede7ded0c9f2612bfc98b6. 2024-02-21 09:55:48,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1708509285424.d19b68d185ede7ded0c9f2612bfc98b6. after waiting 0 ms 2024-02-21 09:55:48,677 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1708509285424.d19b68d185ede7ded0c9f2612bfc98b6. 2024-02-21 09:55:48,682 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/default/TestQuotaAdmin1/d19b68d185ede7ded0c9f2612bfc98b6/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-02-21 09:55:48,683 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1708509285424.d19b68d185ede7ded0c9f2612bfc98b6. 2024-02-21 09:55:48,683 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d19b68d185ede7ded0c9f2612bfc98b6: 2024-02-21 09:55:48,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed d19b68d185ede7ded0c9f2612bfc98b6 2024-02-21 09:55:48,686 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=d19b68d185ede7ded0c9f2612bfc98b6, regionState=CLOSED 2024-02-21 09:55:48,686 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1708509285424.d19b68d185ede7ded0c9f2612bfc98b6.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708509348686"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1708509348686"}]},"ts":"1708509348686"} 2024-02-21 09:55:48,690 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=33, resume processing ppid=32 2024-02-21 09:55:48,690 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=33, ppid=32, state=SUCCESS; CloseRegionProcedure d19b68d185ede7ded0c9f2612bfc98b6, server=jenkins-hbase4.apache.org,42163,1708509281284 in 165 msec 2024-02-21 09:55:48,692 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=32, resume processing ppid=31 2024-02-21 09:55:48,692 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=32, ppid=31, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=d19b68d185ede7ded0c9f2612bfc98b6, UNASSIGN in 171 msec 2024-02-21 09:55:48,693 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708509348693"}]},"ts":"1708509348693"} 2024-02-21 09:55:48,694 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLED in hbase:meta 2024-02-21 09:55:48,697 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set TestQuotaAdmin1 to state=DISABLED 2024-02-21 09:55:48,699 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=31, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin1 in 187 msec 2024-02-21 09:55:48,765 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-02-21 09:55:48,766 INFO [Listener at localhost/32959] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin1, procId: 31 completed 2024-02-21 09:55:48,766 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin1 2024-02-21 09:55:48,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] procedure2.ProcedureExecutor(1075): Stored pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin1 2024-02-21 09:55:48,770 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-02-21 09:55:48,771 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=34, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-02-21 09:55:48,772 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-02-21 09:55:48,776 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/default/TestQuotaAdmin1/d19b68d185ede7ded0c9f2612bfc98b6 2024-02-21 09:55:48,778 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/default/TestQuotaAdmin1/d19b68d185ede7ded0c9f2612bfc98b6/cf, FileablePath, hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/default/TestQuotaAdmin1/d19b68d185ede7ded0c9f2612bfc98b6/recovered.edits] 2024-02-21 09:55:48,787 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/default/TestQuotaAdmin1/d19b68d185ede7ded0c9f2612bfc98b6/recovered.edits/4.seqid to hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/archive/data/default/TestQuotaAdmin1/d19b68d185ede7ded0c9f2612bfc98b6/recovered.edits/4.seqid 2024-02-21 09:55:48,788 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/default/TestQuotaAdmin1/d19b68d185ede7ded0c9f2612bfc98b6 2024-02-21 09:55:48,788 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-02-21 09:55:48,791 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=34, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-02-21 09:55:48,793 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin1 from hbase:meta 2024-02-21 09:55:48,795 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin1' descriptor. 2024-02-21 09:55:48,797 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=34, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-02-21 09:55:48,797 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin1' from region states. 2024-02-21 09:55:48,797 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1,,1708509285424.d19b68d185ede7ded0c9f2612bfc98b6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1708509348797"}]},"ts":"9223372036854775807"} 2024-02-21 09:55:48,799 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-02-21 09:55:48,799 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => d19b68d185ede7ded0c9f2612bfc98b6, NAME => 'TestQuotaAdmin1,,1708509285424.d19b68d185ede7ded0c9f2612bfc98b6.', STARTKEY => '', ENDKEY => ''}] 2024-02-21 09:55:48,799 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin1' as deleted. 2024-02-21 09:55:48,799 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1708509348799"}]},"ts":"9223372036854775807"} 2024-02-21 09:55:48,801 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin1 state from META 2024-02-21 09:55:48,803 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=34, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-02-21 09:55:48,805 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=34, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin1 in 37 msec 2024-02-21 09:55:49,024 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-02-21 09:55:49,024 INFO [Listener at localhost/32959] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin1, procId: 34 completed 2024-02-21 09:55:49,025 INFO [Listener at localhost/32959] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin2 2024-02-21 09:55:49,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin2 2024-02-21 09:55:49,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] procedure2.ProcedureExecutor(1075): Stored pid=35, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin2 2024-02-21 09:55:49,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-02-21 09:55:49,031 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708509349030"}]},"ts":"1708509349030"} 2024-02-21 09:55:49,032 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLING in hbase:meta 2024-02-21 09:55:49,034 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set TestQuotaAdmin2 to state=DISABLING 2024-02-21 09:55:49,035 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=730d49a1c883b1f971bdaa528da8e9ef, UNASSIGN}] 2024-02-21 09:55:49,036 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=730d49a1c883b1f971bdaa528da8e9ef, UNASSIGN 2024-02-21 09:55:49,037 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=730d49a1c883b1f971bdaa528da8e9ef, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34401,1708509281333 2024-02-21 09:55:49,037 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1708509286201.730d49a1c883b1f971bdaa528da8e9ef.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708509349037"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1708509349037"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1708509349037"}]},"ts":"1708509349037"} 2024-02-21 09:55:49,039 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; CloseRegionProcedure 730d49a1c883b1f971bdaa528da8e9ef, server=jenkins-hbase4.apache.org,34401,1708509281333}] 2024-02-21 09:55:49,191 DEBUG [RSProcedureDispatcher-pool-5] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,34401,1708509281333 2024-02-21 09:55:49,192 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 730d49a1c883b1f971bdaa528da8e9ef 2024-02-21 09:55:49,192 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 730d49a1c883b1f971bdaa528da8e9ef, disabling compactions & flushes 2024-02-21 09:55:49,192 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1708509286201.730d49a1c883b1f971bdaa528da8e9ef. 2024-02-21 09:55:49,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1708509286201.730d49a1c883b1f971bdaa528da8e9ef. 2024-02-21 09:55:49,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1708509286201.730d49a1c883b1f971bdaa528da8e9ef. after waiting 0 ms 2024-02-21 09:55:49,193 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1708509286201.730d49a1c883b1f971bdaa528da8e9ef. 2024-02-21 09:55:49,200 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/default/TestQuotaAdmin2/730d49a1c883b1f971bdaa528da8e9ef/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-02-21 09:55:49,201 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1708509286201.730d49a1c883b1f971bdaa528da8e9ef. 2024-02-21 09:55:49,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 730d49a1c883b1f971bdaa528da8e9ef: 2024-02-21 09:55:49,203 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 730d49a1c883b1f971bdaa528da8e9ef 2024-02-21 09:55:49,204 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=730d49a1c883b1f971bdaa528da8e9ef, regionState=CLOSED 2024-02-21 09:55:49,204 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1708509286201.730d49a1c883b1f971bdaa528da8e9ef.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708509349204"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1708509349204"}]},"ts":"1708509349204"} 2024-02-21 09:55:49,208 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=37, resume processing ppid=36 2024-02-21 09:55:49,208 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=37, ppid=36, state=SUCCESS; CloseRegionProcedure 730d49a1c883b1f971bdaa528da8e9ef, server=jenkins-hbase4.apache.org,34401,1708509281333 in 167 msec 2024-02-21 09:55:49,210 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=36, resume processing ppid=35 2024-02-21 09:55:49,210 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=730d49a1c883b1f971bdaa528da8e9ef, UNASSIGN in 173 msec 2024-02-21 09:55:49,211 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708509349211"}]},"ts":"1708509349211"} 2024-02-21 09:55:49,212 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLED in hbase:meta 2024-02-21 09:55:49,214 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set TestQuotaAdmin2 to state=DISABLED 2024-02-21 09:55:49,217 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=35, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin2 in 189 msec 2024-02-21 09:55:49,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-02-21 09:55:49,282 INFO [Listener at localhost/32959] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin2, procId: 35 completed 2024-02-21 09:55:49,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin2 2024-02-21 09:55:49,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] procedure2.ProcedureExecutor(1075): Stored pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin2 2024-02-21 09:55:49,286 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-02-21 09:55:49,287 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=38, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-02-21 09:55:49,289 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-02-21 09:55:49,291 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/default/TestQuotaAdmin2/730d49a1c883b1f971bdaa528da8e9ef 2024-02-21 09:55:49,294 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/default/TestQuotaAdmin2/730d49a1c883b1f971bdaa528da8e9ef/cf, FileablePath, hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/default/TestQuotaAdmin2/730d49a1c883b1f971bdaa528da8e9ef/recovered.edits] 2024-02-21 09:55:49,303 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/default/TestQuotaAdmin2/730d49a1c883b1f971bdaa528da8e9ef/recovered.edits/4.seqid to hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/archive/data/default/TestQuotaAdmin2/730d49a1c883b1f971bdaa528da8e9ef/recovered.edits/4.seqid 2024-02-21 09:55:49,303 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/default/TestQuotaAdmin2/730d49a1c883b1f971bdaa528da8e9ef 2024-02-21 09:55:49,303 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-02-21 09:55:49,306 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=38, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-02-21 09:55:49,308 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin2 from hbase:meta 2024-02-21 09:55:49,310 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin2' descriptor. 2024-02-21 09:55:49,311 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=38, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-02-21 09:55:49,311 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin2' from region states. 2024-02-21 09:55:49,311 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2,,1708509286201.730d49a1c883b1f971bdaa528da8e9ef.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1708509349311"}]},"ts":"9223372036854775807"} 2024-02-21 09:55:49,313 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-02-21 09:55:49,313 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 730d49a1c883b1f971bdaa528da8e9ef, NAME => 'TestQuotaAdmin2,,1708509286201.730d49a1c883b1f971bdaa528da8e9ef.', STARTKEY => '', ENDKEY => ''}] 2024-02-21 09:55:49,313 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin2' as deleted. 2024-02-21 09:55:49,313 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1708509349313"}]},"ts":"9223372036854775807"} 2024-02-21 09:55:49,315 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin2 state from META 2024-02-21 09:55:49,317 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=38, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-02-21 09:55:49,319 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=38, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin2 in 34 msec 2024-02-21 09:55:49,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-02-21 09:55:49,540 INFO [Listener at localhost/32959] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin2, procId: 38 completed 2024-02-21 09:55:49,541 INFO [Listener at localhost/32959] client.HBaseAdmin$15(890): Started disable of TestNs:TestTable 2024-02-21 09:55:49,541 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestNs:TestTable 2024-02-21 09:55:49,542 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] procedure2.ProcedureExecutor(1075): Stored pid=39, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestNs:TestTable 2024-02-21 09:55:49,545 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-02-21 09:55:49,545 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708509349545"}]},"ts":"1708509349545"} 2024-02-21 09:55:49,547 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLING in hbase:meta 2024-02-21 09:55:49,549 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set TestNs:TestTable to state=DISABLING 2024-02-21 09:55:49,550 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=8b329c448d0dff0987d3c57e75ee1f08, UNASSIGN}, {pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=800362be1f7b1ce384b2b36967c302f9, UNASSIGN}] 2024-02-21 09:55:49,551 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=800362be1f7b1ce384b2b36967c302f9, UNASSIGN 2024-02-21 09:55:49,551 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=8b329c448d0dff0987d3c57e75ee1f08, UNASSIGN 2024-02-21 09:55:49,552 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=800362be1f7b1ce384b2b36967c302f9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,34401,1708509281333 2024-02-21 09:55:49,552 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=8b329c448d0dff0987d3c57e75ee1f08, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,42163,1708509281284 2024-02-21 09:55:49,552 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1708509287251.800362be1f7b1ce384b2b36967c302f9.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1708509349552"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1708509349552"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1708509349552"}]},"ts":"1708509349552"} 2024-02-21 09:55:49,552 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1708509287251.8b329c448d0dff0987d3c57e75ee1f08.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1708509349552"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1708509349552"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1708509349552"}]},"ts":"1708509349552"} 2024-02-21 09:55:49,554 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=42, ppid=41, state=RUNNABLE; CloseRegionProcedure 800362be1f7b1ce384b2b36967c302f9, server=jenkins-hbase4.apache.org,34401,1708509281333}] 2024-02-21 09:55:49,555 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=43, ppid=40, state=RUNNABLE; CloseRegionProcedure 8b329c448d0dff0987d3c57e75ee1f08, server=jenkins-hbase4.apache.org,42163,1708509281284}] 2024-02-21 09:55:49,705 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,34401,1708509281333 2024-02-21 09:55:49,706 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 800362be1f7b1ce384b2b36967c302f9 2024-02-21 09:55:49,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 800362be1f7b1ce384b2b36967c302f9, disabling compactions & flushes 2024-02-21 09:55:49,707 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1708509287251.800362be1f7b1ce384b2b36967c302f9. 2024-02-21 09:55:49,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1708509287251.800362be1f7b1ce384b2b36967c302f9. 2024-02-21 09:55:49,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1708509287251.800362be1f7b1ce384b2b36967c302f9. after waiting 0 ms 2024-02-21 09:55:49,707 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1708509287251.800362be1f7b1ce384b2b36967c302f9. 2024-02-21 09:55:49,708 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,42163,1708509281284 2024-02-21 09:55:49,708 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8b329c448d0dff0987d3c57e75ee1f08 2024-02-21 09:55:49,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8b329c448d0dff0987d3c57e75ee1f08, disabling compactions & flushes 2024-02-21 09:55:49,709 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1708509287251.8b329c448d0dff0987d3c57e75ee1f08. 2024-02-21 09:55:49,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1708509287251.8b329c448d0dff0987d3c57e75ee1f08. 2024-02-21 09:55:49,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1708509287251.8b329c448d0dff0987d3c57e75ee1f08. after waiting 0 ms 2024-02-21 09:55:49,709 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1708509287251.8b329c448d0dff0987d3c57e75ee1f08. 2024-02-21 09:55:49,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/TestNs/TestTable/800362be1f7b1ce384b2b36967c302f9/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-02-21 09:55:49,714 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/TestNs/TestTable/8b329c448d0dff0987d3c57e75ee1f08/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-02-21 09:55:49,715 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1708509287251.800362be1f7b1ce384b2b36967c302f9. 2024-02-21 09:55:49,715 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 800362be1f7b1ce384b2b36967c302f9: 2024-02-21 09:55:49,716 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1708509287251.8b329c448d0dff0987d3c57e75ee1f08. 2024-02-21 09:55:49,716 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8b329c448d0dff0987d3c57e75ee1f08: 2024-02-21 09:55:49,717 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 800362be1f7b1ce384b2b36967c302f9 2024-02-21 09:55:49,718 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=800362be1f7b1ce384b2b36967c302f9, regionState=CLOSED 2024-02-21 09:55:49,718 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1708509287251.800362be1f7b1ce384b2b36967c302f9.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1708509349718"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1708509349718"}]},"ts":"1708509349718"} 2024-02-21 09:55:49,718 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8b329c448d0dff0987d3c57e75ee1f08 2024-02-21 09:55:49,719 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=8b329c448d0dff0987d3c57e75ee1f08, regionState=CLOSED 2024-02-21 09:55:49,719 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,,1708509287251.8b329c448d0dff0987d3c57e75ee1f08.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1708509349719"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1708509349719"}]},"ts":"1708509349719"} 2024-02-21 09:55:49,722 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=42, resume processing ppid=41 2024-02-21 09:55:49,722 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=42, ppid=41, state=SUCCESS; CloseRegionProcedure 800362be1f7b1ce384b2b36967c302f9, server=jenkins-hbase4.apache.org,34401,1708509281333 in 166 msec 2024-02-21 09:55:49,723 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=43, resume processing ppid=40 2024-02-21 09:55:49,724 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=41, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=800362be1f7b1ce384b2b36967c302f9, UNASSIGN in 172 msec 2024-02-21 09:55:49,724 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=43, ppid=40, state=SUCCESS; CloseRegionProcedure 8b329c448d0dff0987d3c57e75ee1f08, server=jenkins-hbase4.apache.org,42163,1708509281284 in 167 msec 2024-02-21 09:55:49,725 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=40, resume processing ppid=39 2024-02-21 09:55:49,725 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=8b329c448d0dff0987d3c57e75ee1f08, UNASSIGN in 173 msec 2024-02-21 09:55:49,726 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708509349726"}]},"ts":"1708509349726"} 2024-02-21 09:55:49,727 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLED in hbase:meta 2024-02-21 09:55:49,729 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set TestNs:TestTable to state=DISABLED 2024-02-21 09:55:49,731 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=39, state=SUCCESS; DisableTableProcedure table=TestNs:TestTable in 189 msec 2024-02-21 09:55:49,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-02-21 09:55:49,797 INFO [Listener at localhost/32959] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: TestNs:TestTable, procId: 39 completed 2024-02-21 09:55:49,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestNs:TestTable 2024-02-21 09:55:49,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] procedure2.ProcedureExecutor(1075): Stored pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestNs:TestTable 2024-02-21 09:55:49,800 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-02-21 09:55:49,801 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=44, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-02-21 09:55:49,803 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-02-21 09:55:49,807 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/TestNs/TestTable/8b329c448d0dff0987d3c57e75ee1f08 2024-02-21 09:55:49,807 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/TestNs/TestTable/800362be1f7b1ce384b2b36967c302f9 2024-02-21 09:55:49,810 DEBUG [HFileArchiver-11] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/TestNs/TestTable/8b329c448d0dff0987d3c57e75ee1f08/cf, FileablePath, hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/TestNs/TestTable/8b329c448d0dff0987d3c57e75ee1f08/recovered.edits] 2024-02-21 09:55:49,810 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/TestNs/TestTable/800362be1f7b1ce384b2b36967c302f9/cf, FileablePath, hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/TestNs/TestTable/800362be1f7b1ce384b2b36967c302f9/recovered.edits] 2024-02-21 09:55:49,819 DEBUG [HFileArchiver-11] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/TestNs/TestTable/8b329c448d0dff0987d3c57e75ee1f08/recovered.edits/4.seqid to hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/archive/data/TestNs/TestTable/8b329c448d0dff0987d3c57e75ee1f08/recovered.edits/4.seqid 2024-02-21 09:55:49,819 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/TestNs/TestTable/800362be1f7b1ce384b2b36967c302f9/recovered.edits/4.seqid to hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/archive/data/TestNs/TestTable/800362be1f7b1ce384b2b36967c302f9/recovered.edits/4.seqid 2024-02-21 09:55:49,820 DEBUG [HFileArchiver-11] backup.HFileArchiver(596): Deleted hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/TestNs/TestTable/8b329c448d0dff0987d3c57e75ee1f08 2024-02-21 09:55:49,820 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/.tmp/data/TestNs/TestTable/800362be1f7b1ce384b2b36967c302f9 2024-02-21 09:55:49,820 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-02-21 09:55:49,824 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=44, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-02-21 09:55:49,825 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of TestNs:TestTable from hbase:meta 2024-02-21 09:55:49,827 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'TestNs:TestTable' descriptor. 2024-02-21 09:55:49,829 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=44, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-02-21 09:55:49,829 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'TestNs:TestTable' from region states. 2024-02-21 09:55:49,829 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,,1708509287251.8b329c448d0dff0987d3c57e75ee1f08.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1708509349829"}]},"ts":"9223372036854775807"} 2024-02-21 09:55:49,829 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,1,1708509287251.800362be1f7b1ce384b2b36967c302f9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1708509349829"}]},"ts":"9223372036854775807"} 2024-02-21 09:55:49,831 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2024-02-21 09:55:49,831 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8b329c448d0dff0987d3c57e75ee1f08, NAME => 'TestNs:TestTable,,1708509287251.8b329c448d0dff0987d3c57e75ee1f08.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 800362be1f7b1ce384b2b36967c302f9, NAME => 'TestNs:TestTable,1,1708509287251.800362be1f7b1ce384b2b36967c302f9.', STARTKEY => '1', ENDKEY => ''}] 2024-02-21 09:55:49,831 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'TestNs:TestTable' as deleted. 2024-02-21 09:55:49,831 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1708509349831"}]},"ts":"9223372036854775807"} 2024-02-21 09:55:49,833 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table TestNs:TestTable state from META 2024-02-21 09:55:49,836 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=44, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-02-21 09:55:49,837 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=44, state=SUCCESS; DeleteTableProcedure table=TestNs:TestTable in 39 msec 2024-02-21 09:55:50,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-02-21 09:55:50,055 INFO [Listener at localhost/32959] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: TestNs:TestTable, procId: 44 completed 2024-02-21 09:55:50,059 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.HMaster$17(3092): Client=jenkins//172.31.14.131 delete TestNs 2024-02-21 09:55:50,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] procedure2.ProcedureExecutor(1075): Stored pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE; DeleteNamespaceProcedure, namespace=TestNs 2024-02-21 09:55:50,068 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-02-21 09:55:50,071 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_FROM_NS_TABLE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-02-21 09:55:50,073 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_FROM_ZK, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-02-21 09:55:50,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-02-21 09:55:50,075 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace/TestNs 2024-02-21 09:55:50,075 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-02-21 09:55:50,076 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_DIRECTORIES, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-02-21 09:55:50,078 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_NAMESPACE_QUOTA, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-02-21 09:55:50,080 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=45, state=SUCCESS; DeleteNamespaceProcedure, namespace=TestNs in 18 msec 2024-02-21 09:55:50,325 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39319] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-02-21 09:55:50,325 INFO [Listener at localhost/32959] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2024-02-21 09:55:50,325 INFO [Listener at localhost/32959] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-02-21 09:55:50,326 DEBUG [Listener at localhost/32959] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x281456a0 to 127.0.0.1:64913 2024-02-21 09:55:50,326 DEBUG [Listener at localhost/32959] ipc.AbstractRpcClient(489): Stopping rpc client 2024-02-21 09:55:50,326 DEBUG [Listener at localhost/32959] util.JVMClusterUtil(237): Shutting down HBase Cluster 2024-02-21 09:55:50,327 DEBUG [Listener at localhost/32959] util.JVMClusterUtil(257): Found active master hash=1004221681, stopped=false 2024-02-21 09:55:50,327 DEBUG [Listener at localhost/32959] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-02-21 09:55:50,327 INFO [Listener at localhost/32959] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,39319,1708509280062 2024-02-21 09:55:50,330 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-02-21 09:55:50,330 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): regionserver:34401-0x101e92697c90002, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-02-21 09:55:50,330 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-21 09:55:50,330 INFO [Listener at localhost/32959] procedure2.ProcedureExecutor(675): Stopping 2024-02-21 09:55:50,330 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): regionserver:42163-0x101e92697c90001, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-02-21 09:55:50,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-02-21 09:55:50,331 DEBUG [Listener at localhost/32959] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5db7dbec to 127.0.0.1:64913 2024-02-21 09:55:50,331 DEBUG [Listener at localhost/32959] ipc.AbstractRpcClient(489): Stopping rpc client 2024-02-21 09:55:50,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:42163-0x101e92697c90001, quorum=127.0.0.1:64913, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-02-21 09:55:50,331 INFO [Listener at localhost/32959] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,42163,1708509281284' ***** 2024-02-21 09:55:50,331 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:34401-0x101e92697c90002, quorum=127.0.0.1:64913, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-02-21 09:55:50,332 INFO [Listener at localhost/32959] regionserver.HRegionServer(2313): STOPPED: Shutdown requested 2024-02-21 09:55:50,332 INFO [Listener at localhost/32959] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,34401,1708509281333' ***** 2024-02-21 09:55:50,332 INFO [Listener at localhost/32959] regionserver.HRegionServer(2313): STOPPED: Shutdown requested 2024-02-21 09:55:50,332 INFO [RS:0;jenkins-hbase4:42163] regionserver.HeapMemoryManager(220): Stopping 2024-02-21 09:55:50,332 INFO [RS:1;jenkins-hbase4:34401] regionserver.HeapMemoryManager(220): Stopping 2024-02-21 09:55:50,332 INFO [RS:1;jenkins-hbase4:34401] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-02-21 09:55:50,332 INFO [RS:1;jenkins-hbase4:34401] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-02-21 09:55:50,332 INFO [RS:1;jenkins-hbase4:34401] regionserver.HRegionServer(3307): Received CLOSE for fbb33d9b2d3eec72f85c5982887e2d54 2024-02-21 09:55:50,332 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-02-21 09:55:50,333 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-02-21 09:55:50,333 INFO [RS:0;jenkins-hbase4:42163] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-02-21 09:55:50,333 INFO [RS:1;jenkins-hbase4:34401] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,34401,1708509281333 2024-02-21 09:55:50,333 INFO [RS:0;jenkins-hbase4:42163] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-02-21 09:55:50,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fbb33d9b2d3eec72f85c5982887e2d54, disabling compactions & flushes 2024-02-21 09:55:50,333 INFO [RS:1;jenkins-hbase4:34401] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-02-21 09:55:50,333 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:quota,,1708509284048.fbb33d9b2d3eec72f85c5982887e2d54. 2024-02-21 09:55:50,333 DEBUG [RS:1;jenkins-hbase4:34401] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x21caf8ef to 127.0.0.1:64913 2024-02-21 09:55:50,333 INFO [RS:0;jenkins-hbase4:42163] regionserver.HRegionServer(3307): Received CLOSE for ee363047751be7b53f6d383d4d3054c5 2024-02-21 09:55:50,333 DEBUG [RS:1;jenkins-hbase4:34401] ipc.AbstractRpcClient(489): Stopping rpc client 2024-02-21 09:55:50,333 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1708509284048.fbb33d9b2d3eec72f85c5982887e2d54. 2024-02-21 09:55:50,334 INFO [RS:0;jenkins-hbase4:42163] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,42163,1708509281284 2024-02-21 09:55:50,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ee363047751be7b53f6d383d4d3054c5, disabling compactions & flushes 2024-02-21 09:55:50,334 INFO [RS:1;jenkins-hbase4:34401] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-02-21 09:55:50,335 INFO [RS:1;jenkins-hbase4:34401] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-02-21 09:55:50,334 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1708509284048.fbb33d9b2d3eec72f85c5982887e2d54. after waiting 0 ms 2024-02-21 09:55:50,335 INFO [RS:1;jenkins-hbase4:34401] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-02-21 09:55:50,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1708509283313.ee363047751be7b53f6d383d4d3054c5. 2024-02-21 09:55:50,335 INFO [RS:1;jenkins-hbase4:34401] regionserver.HRegionServer(3307): Received CLOSE for 1588230740 2024-02-21 09:55:50,335 INFO [RS:0;jenkins-hbase4:42163] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-02-21 09:55:50,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1708509283313.ee363047751be7b53f6d383d4d3054c5. 2024-02-21 09:55:50,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1708509284048.fbb33d9b2d3eec72f85c5982887e2d54. 2024-02-21 09:55:50,335 DEBUG [RS:0;jenkins-hbase4:42163] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4e1ecdc5 to 127.0.0.1:64913 2024-02-21 09:55:50,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1708509283313.ee363047751be7b53f6d383d4d3054c5. after waiting 0 ms 2024-02-21 09:55:50,335 INFO [RS:1;jenkins-hbase4:34401] regionserver.HRegionServer(1477): Waiting on 2 regions to close 2024-02-21 09:55:50,335 DEBUG [RS:0;jenkins-hbase4:42163] ipc.AbstractRpcClient(489): Stopping rpc client 2024-02-21 09:55:50,335 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing fbb33d9b2d3eec72f85c5982887e2d54 2/2 column families, dataSize=726 B heapSize=2.44 KB 2024-02-21 09:55:50,335 INFO [RS:0;jenkins-hbase4:42163] regionserver.HRegionServer(1477): Waiting on 1 regions to close 2024-02-21 09:55:50,335 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-02-21 09:55:50,335 DEBUG [RS:1;jenkins-hbase4:34401] regionserver.HRegionServer(1481): Online Regions={1588230740=hbase:meta,,1.1588230740, fbb33d9b2d3eec72f85c5982887e2d54=hbase:quota,,1708509284048.fbb33d9b2d3eec72f85c5982887e2d54.} 2024-02-21 09:55:50,335 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1708509283313.ee363047751be7b53f6d383d4d3054c5. 2024-02-21 09:55:50,336 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-02-21 09:55:50,336 DEBUG [RS:0;jenkins-hbase4:42163] regionserver.HRegionServer(1481): Online Regions={ee363047751be7b53f6d383d4d3054c5=hbase:namespace,,1708509283313.ee363047751be7b53f6d383d4d3054c5.} 2024-02-21 09:55:50,336 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-02-21 09:55:50,336 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing ee363047751be7b53f6d383d4d3054c5 1/1 column families, dataSize=147 B heapSize=704 B 2024-02-21 09:55:50,336 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-02-21 09:55:50,336 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-02-21 09:55:50,336 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=14.15 KB heapSize=25.10 KB 2024-02-21 09:55:50,337 DEBUG [RS:1;jenkins-hbase4:34401] regionserver.HRegionServer(1507): Waiting on 1588230740, fbb33d9b2d3eec72f85c5982887e2d54 2024-02-21 09:55:50,337 DEBUG [RS:0;jenkins-hbase4:42163] regionserver.HRegionServer(1507): Waiting on ee363047751be7b53f6d383d4d3054c5 2024-02-21 09:55:50,346 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-02-21 09:55:50,378 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=12.16 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/meta/1588230740/.tmp/info/1b1abfc71ad4434889dc2cfe3b783a59 2024-02-21 09:55:50,396 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=147 B at sequenceid=8 (bloomFilter=true), to=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/namespace/ee363047751be7b53f6d383d4d3054c5/.tmp/info/af83f4a7476047ce9e7058fa4f608916 2024-02-21 09:55:50,398 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1b1abfc71ad4434889dc2cfe3b783a59 2024-02-21 09:55:50,398 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=597 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/quota/fbb33d9b2d3eec72f85c5982887e2d54/.tmp/q/5e0530b3931e46d4907c4939caa08eb7 2024-02-21 09:55:50,406 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for af83f4a7476047ce9e7058fa4f608916 2024-02-21 09:55:50,407 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/namespace/ee363047751be7b53f6d383d4d3054c5/.tmp/info/af83f4a7476047ce9e7058fa4f608916 as hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/namespace/ee363047751be7b53f6d383d4d3054c5/info/af83f4a7476047ce9e7058fa4f608916 2024-02-21 09:55:50,413 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5e0530b3931e46d4907c4939caa08eb7 2024-02-21 09:55:50,416 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=478 B at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/meta/1588230740/.tmp/rep_barrier/c5e67ac3edec46da9f062e57dbf518e4 2024-02-21 09:55:50,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for af83f4a7476047ce9e7058fa4f608916 2024-02-21 09:55:50,418 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/namespace/ee363047751be7b53f6d383d4d3054c5/info/af83f4a7476047ce9e7058fa4f608916, entries=3, sequenceid=8, filesize=5.0 K 2024-02-21 09:55:50,420 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~147 B/147, heapSize ~688 B/688, currentSize=0 B/0 for ee363047751be7b53f6d383d4d3054c5 in 84ms, sequenceid=8, compaction requested=false 2024-02-21 09:55:50,426 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c5e67ac3edec46da9f062e57dbf518e4 2024-02-21 09:55:50,427 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-02-21 09:55:50,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/namespace/ee363047751be7b53f6d383d4d3054c5/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=1 2024-02-21 09:55:50,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1708509283313.ee363047751be7b53f6d383d4d3054c5. 2024-02-21 09:55:50,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ee363047751be7b53f6d383d4d3054c5: 2024-02-21 09:55:50,438 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1708509283313.ee363047751be7b53f6d383d4d3054c5. 2024-02-21 09:55:50,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=129 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/quota/fbb33d9b2d3eec72f85c5982887e2d54/.tmp/u/b78a88ee1a59404fb2e4d0e90d8d4d54 2024-02-21 09:55:50,449 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b78a88ee1a59404fb2e4d0e90d8d4d54 2024-02-21 09:55:50,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/quota/fbb33d9b2d3eec72f85c5982887e2d54/.tmp/q/5e0530b3931e46d4907c4939caa08eb7 as hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/quota/fbb33d9b2d3eec72f85c5982887e2d54/q/5e0530b3931e46d4907c4939caa08eb7 2024-02-21 09:55:50,454 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.53 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/meta/1588230740/.tmp/table/dede06bcac9a48138cb43a94e7b7e56f 2024-02-21 09:55:50,462 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dede06bcac9a48138cb43a94e7b7e56f 2024-02-21 09:55:50,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5e0530b3931e46d4907c4939caa08eb7 2024-02-21 09:55:50,463 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/quota/fbb33d9b2d3eec72f85c5982887e2d54/q/5e0530b3931e46d4907c4939caa08eb7, entries=5, sequenceid=17, filesize=5.1 K 2024-02-21 09:55:50,463 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/meta/1588230740/.tmp/info/1b1abfc71ad4434889dc2cfe3b783a59 as hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/meta/1588230740/info/1b1abfc71ad4434889dc2cfe3b783a59 2024-02-21 09:55:50,465 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/quota/fbb33d9b2d3eec72f85c5982887e2d54/.tmp/u/b78a88ee1a59404fb2e4d0e90d8d4d54 as hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/quota/fbb33d9b2d3eec72f85c5982887e2d54/u/b78a88ee1a59404fb2e4d0e90d8d4d54 2024-02-21 09:55:50,473 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 1b1abfc71ad4434889dc2cfe3b783a59 2024-02-21 09:55:50,473 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/meta/1588230740/info/1b1abfc71ad4434889dc2cfe3b783a59, entries=30, sequenceid=66, filesize=8.0 K 2024-02-21 09:55:50,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b78a88ee1a59404fb2e4d0e90d8d4d54 2024-02-21 09:55:50,474 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/quota/fbb33d9b2d3eec72f85c5982887e2d54/u/b78a88ee1a59404fb2e4d0e90d8d4d54, entries=4, sequenceid=17, filesize=5.0 K 2024-02-21 09:55:50,474 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/meta/1588230740/.tmp/rep_barrier/c5e67ac3edec46da9f062e57dbf518e4 as hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/meta/1588230740/rep_barrier/c5e67ac3edec46da9f062e57dbf518e4 2024-02-21 09:55:50,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~726 B/726, heapSize ~2.41 KB/2464, currentSize=0 B/0 for fbb33d9b2d3eec72f85c5982887e2d54 in 140ms, sequenceid=17, compaction requested=false 2024-02-21 09:55:50,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/quota/fbb33d9b2d3eec72f85c5982887e2d54/recovered.edits/20.seqid, newMaxSeqId=20, maxSeqId=1 2024-02-21 09:55:50,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:quota,,1708509284048.fbb33d9b2d3eec72f85c5982887e2d54. 2024-02-21 09:55:50,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fbb33d9b2d3eec72f85c5982887e2d54: 2024-02-21 09:55:50,484 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:quota,,1708509284048.fbb33d9b2d3eec72f85c5982887e2d54. 2024-02-21 09:55:50,486 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c5e67ac3edec46da9f062e57dbf518e4 2024-02-21 09:55:50,486 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/meta/1588230740/rep_barrier/c5e67ac3edec46da9f062e57dbf518e4, entries=5, sequenceid=66, filesize=5.3 K 2024-02-21 09:55:50,487 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/meta/1588230740/.tmp/table/dede06bcac9a48138cb43a94e7b7e56f as hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/meta/1588230740/table/dede06bcac9a48138cb43a94e7b7e56f 2024-02-21 09:55:50,495 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dede06bcac9a48138cb43a94e7b7e56f 2024-02-21 09:55:50,495 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/meta/1588230740/table/dede06bcac9a48138cb43a94e7b7e56f, entries=13, sequenceid=66, filesize=5.6 K 2024-02-21 09:55:50,496 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~14.15 KB/14494, heapSize ~25.05 KB/25656, currentSize=0 B/0 for 1588230740 in 160ms, sequenceid=66, compaction requested=false 2024-02-21 09:55:50,504 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/data/hbase/meta/1588230740/recovered.edits/69.seqid, newMaxSeqId=69, maxSeqId=1 2024-02-21 09:55:50,505 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-02-21 09:55:50,505 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-02-21 09:55:50,505 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-02-21 09:55:50,505 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2024-02-21 09:55:50,538 INFO [RS:1;jenkins-hbase4:34401] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,34401,1708509281333; all regions closed. 2024-02-21 09:55:50,538 INFO [RS:0;jenkins-hbase4:42163] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,42163,1708509281284; all regions closed. 2024-02-21 09:55:50,538 DEBUG [RS:0;jenkins-hbase4:42163] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-02-21 09:55:50,538 DEBUG [RS:1;jenkins-hbase4:34401] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-02-21 09:55:50,548 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/WALs/jenkins-hbase4.apache.org,34401,1708509281333/jenkins-hbase4.apache.org%2C34401%2C1708509281333.meta.1708509283037.meta not finished, retry = 0 2024-02-21 09:55:50,548 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/WALs/jenkins-hbase4.apache.org,42163,1708509281284/jenkins-hbase4.apache.org%2C42163%2C1708509281284.1708509282839 not finished, retry = 0 2024-02-21 09:55:50,652 DEBUG [RS:1;jenkins-hbase4:34401] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/oldWALs 2024-02-21 09:55:50,652 INFO [RS:1;jenkins-hbase4:34401] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34401%2C1708509281333.meta:.meta(num 1708509283037) 2024-02-21 09:55:50,652 DEBUG [RS:0;jenkins-hbase4:42163] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/oldWALs 2024-02-21 09:55:50,652 INFO [RS:0;jenkins-hbase4:42163] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C42163%2C1708509281284:(num 1708509282839) 2024-02-21 09:55:50,652 DEBUG [RS:0;jenkins-hbase4:42163] ipc.AbstractRpcClient(489): Stopping rpc client 2024-02-21 09:55:50,653 INFO [RS:0;jenkins-hbase4:42163] regionserver.LeaseManager(133): Closed leases 2024-02-21 09:55:50,653 INFO [RS:0;jenkins-hbase4:42163] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2024-02-21 09:55:50,653 INFO [RS:0;jenkins-hbase4:42163] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-02-21 09:55:50,653 INFO [RS:0;jenkins-hbase4:42163] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-02-21 09:55:50,653 INFO [RS:0;jenkins-hbase4:42163] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-02-21 09:55:50,653 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-02-21 09:55:50,654 INFO [RS:0;jenkins-hbase4:42163] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:42163 2024-02-21 09:55:50,660 DEBUG [RS:1;jenkins-hbase4:34401] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/oldWALs 2024-02-21 09:55:50,660 INFO [RS:1;jenkins-hbase4:34401] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C34401%2C1708509281333:(num 1708509282839) 2024-02-21 09:55:50,661 DEBUG [RS:1;jenkins-hbase4:34401] ipc.AbstractRpcClient(489): Stopping rpc client 2024-02-21 09:55:50,661 INFO [RS:1;jenkins-hbase4:34401] regionserver.LeaseManager(133): Closed leases 2024-02-21 09:55:50,661 INFO [RS:1;jenkins-hbase4:34401] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2024-02-21 09:55:50,661 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-02-21 09:55:50,662 INFO [RS:1;jenkins-hbase4:34401] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:34401 2024-02-21 09:55:50,664 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): regionserver:42163-0x101e92697c90001, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42163,1708509281284 2024-02-21 09:55:50,664 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-02-21 09:55:50,664 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): regionserver:42163-0x101e92697c90001, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-02-21 09:55:50,664 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): regionserver:34401-0x101e92697c90002, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,42163,1708509281284 2024-02-21 09:55:50,665 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): regionserver:42163-0x101e92697c90001, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34401,1708509281333 2024-02-21 09:55:50,665 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): regionserver:34401-0x101e92697c90002, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-02-21 09:55:50,665 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): regionserver:34401-0x101e92697c90002, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,34401,1708509281333 2024-02-21 09:55:50,665 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,34401,1708509281333] 2024-02-21 09:55:50,666 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,34401,1708509281333; numProcessing=1 2024-02-21 09:55:50,667 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,34401,1708509281333 already deleted, retry=false 2024-02-21 09:55:50,667 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,34401,1708509281333 expired; onlineServers=1 2024-02-21 09:55:50,668 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,42163,1708509281284] 2024-02-21 09:55:50,668 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,42163,1708509281284; numProcessing=2 2024-02-21 09:55:50,669 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,42163,1708509281284 already deleted, retry=false 2024-02-21 09:55:50,669 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,42163,1708509281284 expired; onlineServers=0 2024-02-21 09:55:50,669 INFO [RegionServerTracker-0] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,39319,1708509280062' ***** 2024-02-21 09:55:50,669 INFO [RegionServerTracker-0] regionserver.HRegionServer(2313): STOPPED: Cluster shutdown set; onlineServer=0 2024-02-21 09:55:50,670 DEBUG [M:0;jenkins-hbase4:39319] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29480078, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-02-21 09:55:50,670 INFO [M:0;jenkins-hbase4:39319] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,39319,1708509280062 2024-02-21 09:55:50,670 INFO [M:0;jenkins-hbase4:39319] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,39319,1708509280062; all regions closed. 2024-02-21 09:55:50,670 DEBUG [M:0;jenkins-hbase4:39319] ipc.AbstractRpcClient(489): Stopping rpc client 2024-02-21 09:55:50,670 DEBUG [M:0;jenkins-hbase4:39319] cleaner.LogCleaner(198): Cancelling LogCleaner 2024-02-21 09:55:50,670 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2024-02-21 09:55:50,670 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1708509282495] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1708509282495,5,FailOnTimeoutGroup] 2024-02-21 09:55:50,670 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1708509282502] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1708509282502,5,FailOnTimeoutGroup] 2024-02-21 09:55:50,670 DEBUG [M:0;jenkins-hbase4:39319] cleaner.HFileCleaner(317): Stopping file delete threads 2024-02-21 09:55:50,671 INFO [M:0;jenkins-hbase4:39319] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2024-02-21 09:55:50,671 INFO [M:0;jenkins-hbase4:39319] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2024-02-21 09:55:50,671 INFO [M:0;jenkins-hbase4:39319] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS] on shutdown 2024-02-21 09:55:50,671 DEBUG [M:0;jenkins-hbase4:39319] master.HMaster(1517): Stopping service threads 2024-02-21 09:55:50,671 INFO [M:0;jenkins-hbase4:39319] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2024-02-21 09:55:50,671 ERROR [M:0;jenkins-hbase4:39319] procedure2.ProcedureExecutor(699): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-8,5,PEWorkerGroup] Thread[HFileArchiver-9,5,PEWorkerGroup] Thread[HFileArchiver-10,5,PEWorkerGroup] Thread[HFileArchiver-11,5,PEWorkerGroup] Thread[HFileArchiver-12,5,PEWorkerGroup] 2024-02-21 09:55:50,671 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2024-02-21 09:55:50,671 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-21 09:55:50,672 INFO [M:0;jenkins-hbase4:39319] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2024-02-21 09:55:50,672 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-02-21 09:55:50,672 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2024-02-21 09:55:50,673 DEBUG [M:0;jenkins-hbase4:39319] zookeeper.ZKUtil(399): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2024-02-21 09:55:50,673 WARN [M:0;jenkins-hbase4:39319] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2024-02-21 09:55:50,673 INFO [M:0;jenkins-hbase4:39319] assignment.AssignmentManager(315): Stopping assignment manager 2024-02-21 09:55:50,673 INFO [M:0;jenkins-hbase4:39319] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2024-02-21 09:55:50,673 DEBUG [M:0;jenkins-hbase4:39319] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-02-21 09:55:50,673 INFO [M:0;jenkins-hbase4:39319] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-21 09:55:50,673 DEBUG [M:0;jenkins-hbase4:39319] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-21 09:55:50,673 DEBUG [M:0;jenkins-hbase4:39319] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-02-21 09:55:50,673 DEBUG [M:0;jenkins-hbase4:39319] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-21 09:55:50,674 INFO [M:0;jenkins-hbase4:39319] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=152.94 KB heapSize=184.74 KB 2024-02-21 09:55:50,690 INFO [M:0;jenkins-hbase4:39319] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=152.94 KB at sequenceid=376 (bloomFilter=true), to=hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3b19b8f4c2fd415b876d350237f223b3 2024-02-21 09:55:50,697 INFO [M:0;jenkins-hbase4:39319] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3b19b8f4c2fd415b876d350237f223b3 2024-02-21 09:55:50,698 DEBUG [M:0;jenkins-hbase4:39319] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/3b19b8f4c2fd415b876d350237f223b3 as hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3b19b8f4c2fd415b876d350237f223b3 2024-02-21 09:55:50,705 INFO [M:0;jenkins-hbase4:39319] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3b19b8f4c2fd415b876d350237f223b3 2024-02-21 09:55:50,705 INFO [M:0;jenkins-hbase4:39319] regionserver.HStore(1080): Added hdfs://localhost:44089/user/jenkins/test-data/d5bd77a3-ae1e-ec44-8be8-ee62b515136f/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/3b19b8f4c2fd415b876d350237f223b3, entries=45, sequenceid=376, filesize=12.0 K 2024-02-21 09:55:50,706 INFO [M:0;jenkins-hbase4:39319] regionserver.HRegion(2948): Finished flush of dataSize ~152.94 KB/156609, heapSize ~184.73 KB/189160, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 33ms, sequenceid=376, compaction requested=false 2024-02-21 09:55:50,708 INFO [M:0;jenkins-hbase4:39319] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-21 09:55:50,708 DEBUG [M:0;jenkins-hbase4:39319] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-02-21 09:55:50,711 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-02-21 09:55:50,711 INFO [M:0;jenkins-hbase4:39319] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2024-02-21 09:55:50,712 INFO [M:0;jenkins-hbase4:39319] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39319 2024-02-21 09:55:50,714 DEBUG [M:0;jenkins-hbase4:39319] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,39319,1708509280062 already deleted, retry=false 2024-02-21 09:55:50,766 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): regionserver:42163-0x101e92697c90001, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-02-21 09:55:50,766 INFO [RS:0;jenkins-hbase4:42163] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,42163,1708509281284; zookeeper connection closed. 2024-02-21 09:55:50,766 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): regionserver:42163-0x101e92697c90001, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-02-21 09:55:50,767 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7ef1f91b] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7ef1f91b 2024-02-21 09:55:50,767 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): regionserver:34401-0x101e92697c90002, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-02-21 09:55:50,767 INFO [RS:1;jenkins-hbase4:34401] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,34401,1708509281333; zookeeper connection closed. 2024-02-21 09:55:50,767 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): regionserver:34401-0x101e92697c90002, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-02-21 09:55:50,767 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@195ccc86] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@195ccc86 2024-02-21 09:55:50,768 INFO [Listener at localhost/32959] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2024-02-21 09:55:50,816 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-02-21 09:55:50,816 INFO [M:0;jenkins-hbase4:39319] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,39319,1708509280062; zookeeper connection closed. 2024-02-21 09:55:50,816 DEBUG [Listener at localhost/32959-EventThread] zookeeper.ZKWatcher(600): master:39319-0x101e92697c90000, quorum=127.0.0.1:64913, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-02-21 09:55:50,817 WARN [Listener at localhost/32959] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-02-21 09:55:50,820 INFO [Listener at localhost/32959] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-02-21 09:55:50,870 WARN [BP-1840094287-172.31.14.131-1708509276708 heartbeating to localhost/127.0.0.1:44089] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1840094287-172.31.14.131-1708509276708 (Datanode Uuid 2d434cc0-b682-4fa8-bcf5-9c348936ed42) service to localhost/127.0.0.1:44089 2024-02-21 09:55:50,872 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/cluster_f849ae4e-dfee-f859-3d8b-dbe48ad6228b/dfs/data/data3/current/BP-1840094287-172.31.14.131-1708509276708] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-02-21 09:55:50,872 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/cluster_f849ae4e-dfee-f859-3d8b-dbe48ad6228b/dfs/data/data4/current/BP-1840094287-172.31.14.131-1708509276708] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-02-21 09:55:50,925 WARN [Listener at localhost/32959] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-02-21 09:55:50,929 INFO [Listener at localhost/32959] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-02-21 09:55:51,034 WARN [BP-1840094287-172.31.14.131-1708509276708 heartbeating to localhost/127.0.0.1:44089] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-02-21 09:55:51,034 WARN [BP-1840094287-172.31.14.131-1708509276708 heartbeating to localhost/127.0.0.1:44089] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1840094287-172.31.14.131-1708509276708 (Datanode Uuid 2df4423a-c073-4521-a348-7b9d8f679f3d) service to localhost/127.0.0.1:44089 2024-02-21 09:55:51,035 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/cluster_f849ae4e-dfee-f859-3d8b-dbe48ad6228b/dfs/data/data1/current/BP-1840094287-172.31.14.131-1708509276708] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-02-21 09:55:51,035 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/b26e4dc2-3884-1b2c-b7d9-79158d476a95/cluster_f849ae4e-dfee-f859-3d8b-dbe48ad6228b/dfs/data/data2/current/BP-1840094287-172.31.14.131-1708509276708] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-02-21 09:55:51,074 INFO [Listener at localhost/32959] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-02-21 09:55:51,190 INFO [Listener at localhost/32959] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2024-02-21 09:55:51,232 INFO [Listener at localhost/32959] hbase.HBaseTestingUtility(1293): Minicluster is down