2024-02-20 18:54:39,789 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle timeout: 13 mins 2024-02-20 18:54:40,044 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32 2024-02-20 18:54:40,059 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2024-02-20 18:54:40,059 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/cluster_d91434c1-91b8-dcf4-855b-f2496645ac44, deleteOnExit=true 2024-02-20 18:54:40,059 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2024-02-20 18:54:40,060 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/test.cache.data in system properties and HBase conf 2024-02-20 18:54:40,060 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/hadoop.tmp.dir in system properties and HBase conf 2024-02-20 18:54:40,061 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/hadoop.log.dir in system properties and HBase conf 2024-02-20 18:54:40,061 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/mapreduce.cluster.local.dir in system properties and HBase conf 2024-02-20 18:54:40,062 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/mapreduce.cluster.temp.dir in system properties and HBase conf 2024-02-20 18:54:40,062 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2024-02-20 18:54:40,183 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2024-02-20 18:54:40,600 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-02-20 18:54:40,605 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2024-02-20 18:54:40,605 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2024-02-20 18:54:40,605 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/yarn.nodemanager.log-dirs in system properties and HBase conf 2024-02-20 18:54:40,606 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-02-20 18:54:40,606 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2024-02-20 18:54:40,606 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2024-02-20 18:54:40,607 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-02-20 18:54:40,607 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/dfs.journalnode.edits.dir in system properties and HBase conf 2024-02-20 18:54:40,607 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2024-02-20 18:54:40,608 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/nfs.dump.dir in system properties and HBase conf 2024-02-20 18:54:40,608 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/java.io.tmpdir in system properties and HBase conf 2024-02-20 18:54:40,609 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/dfs.journalnode.edits.dir in system properties and HBase conf 2024-02-20 18:54:40,609 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2024-02-20 18:54:40,610 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2024-02-20 18:54:41,187 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-02-20 18:54:41,192 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-02-20 18:54:41,498 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2024-02-20 18:54:41,663 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2024-02-20 18:54:41,678 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-02-20 18:54:41,714 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2024-02-20 18:54:41,747 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/java.io.tmpdir/Jetty_localhost_38121_hdfs____dhr2t/webapp 2024-02-20 18:54:41,877 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38121 2024-02-20 18:54:41,887 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-02-20 18:54:41,888 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-02-20 18:54:42,382 WARN [Listener at localhost/39943] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-02-20 18:54:42,454 WARN [Listener at localhost/39943] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-02-20 18:54:42,475 WARN [Listener at localhost/39943] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-02-20 18:54:42,480 INFO [Listener at localhost/39943] log.Slf4jLog(67): jetty-6.1.26 2024-02-20 18:54:42,485 INFO [Listener at localhost/39943] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/java.io.tmpdir/Jetty_localhost_38107_datanode____.eshpnq/webapp 2024-02-20 18:54:42,582 INFO [Listener at localhost/39943] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38107 2024-02-20 18:54:42,927 WARN [Listener at localhost/38389] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-02-20 18:54:42,945 WARN [Listener at localhost/38389] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-02-20 18:54:42,951 WARN [Listener at localhost/38389] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-02-20 18:54:42,954 INFO [Listener at localhost/38389] log.Slf4jLog(67): jetty-6.1.26 2024-02-20 18:54:42,962 INFO [Listener at localhost/38389] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/java.io.tmpdir/Jetty_localhost_42363_datanode____6bqxg9/webapp 2024-02-20 18:54:43,061 INFO [Listener at localhost/38389] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42363 2024-02-20 18:54:43,069 WARN [Listener at localhost/36187] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-02-20 18:54:43,434 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5fdaec5dd2bbaf62: Processing first storage report for DS-6964c84e-3630-4ffb-9a5a-542e37f38414 from datanode b743e53b-f00a-4b27-9902-1c62c55e594c 2024-02-20 18:54:43,436 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5fdaec5dd2bbaf62: from storage DS-6964c84e-3630-4ffb-9a5a-542e37f38414 node DatanodeRegistration(127.0.0.1:35435, datanodeUuid=b743e53b-f00a-4b27-9902-1c62c55e594c, infoPort=43241, infoSecurePort=0, ipcPort=36187, storageInfo=lv=-57;cid=testClusterID;nsid=1223154009;c=1708455281270), blocks: 0, hasStaleStorage: true, processing time: 1 msecs, invalidatedBlocks: 0 2024-02-20 18:54:43,436 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7c5136af324cd1b3: Processing first storage report for DS-3210ec81-632d-4ef8-8463-3935fe68d080 from datanode 743ee1c3-758b-4482-869f-a6fd2eb870b8 2024-02-20 18:54:43,436 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7c5136af324cd1b3: from storage DS-3210ec81-632d-4ef8-8463-3935fe68d080 node DatanodeRegistration(127.0.0.1:44909, datanodeUuid=743ee1c3-758b-4482-869f-a6fd2eb870b8, infoPort=41783, infoSecurePort=0, ipcPort=38389, storageInfo=lv=-57;cid=testClusterID;nsid=1223154009;c=1708455281270), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2024-02-20 18:54:43,436 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x5fdaec5dd2bbaf62: Processing first storage report for DS-29311873-facc-4725-8644-0450c9cee12e from datanode b743e53b-f00a-4b27-9902-1c62c55e594c 2024-02-20 18:54:43,436 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x5fdaec5dd2bbaf62: from storage DS-29311873-facc-4725-8644-0450c9cee12e node DatanodeRegistration(127.0.0.1:35435, datanodeUuid=b743e53b-f00a-4b27-9902-1c62c55e594c, infoPort=43241, infoSecurePort=0, ipcPort=36187, storageInfo=lv=-57;cid=testClusterID;nsid=1223154009;c=1708455281270), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-02-20 18:54:43,437 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x7c5136af324cd1b3: Processing first storage report for DS-f7feb205-dfd0-4943-a0be-4fa54ad6649f from datanode 743ee1c3-758b-4482-869f-a6fd2eb870b8 2024-02-20 18:54:43,437 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x7c5136af324cd1b3: from storage DS-f7feb205-dfd0-4943-a0be-4fa54ad6649f node DatanodeRegistration(127.0.0.1:44909, datanodeUuid=743ee1c3-758b-4482-869f-a6fd2eb870b8, infoPort=41783, infoSecurePort=0, ipcPort=38389, storageInfo=lv=-57;cid=testClusterID;nsid=1223154009;c=1708455281270), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-02-20 18:54:43,495 DEBUG [Listener at localhost/36187] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32 2024-02-20 18:54:43,610 INFO [Listener at localhost/36187] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/cluster_d91434c1-91b8-dcf4-855b-f2496645ac44/zookeeper_0, clientPort=59580, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/cluster_d91434c1-91b8-dcf4-855b-f2496645ac44/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/cluster_d91434c1-91b8-dcf4-855b-f2496645ac44/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2024-02-20 18:54:43,630 INFO [Listener at localhost/36187] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=59580 2024-02-20 18:54:43,638 INFO [Listener at localhost/36187] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-20 18:54:43,641 INFO [Listener at localhost/36187] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-20 18:54:44,335 INFO [Listener at localhost/36187] util.FSUtils(471): Created version file at hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d with version=8 2024-02-20 18:54:44,335 INFO [Listener at localhost/36187] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/hbase-staging 2024-02-20 18:54:44,648 INFO [Listener at localhost/36187] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2024-02-20 18:54:45,132 INFO [Listener at localhost/36187] client.ConnectionUtils(126): master/jenkins-hbase4:0 server-side Connection retries=45 2024-02-20 18:54:45,166 INFO [Listener at localhost/36187] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-02-20 18:54:45,167 INFO [Listener at localhost/36187] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-02-20 18:54:45,167 INFO [Listener at localhost/36187] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-02-20 18:54:45,167 INFO [Listener at localhost/36187] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-02-20 18:54:45,167 INFO [Listener at localhost/36187] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-02-20 18:54:45,338 INFO [Listener at localhost/36187] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2024-02-20 18:54:45,418 DEBUG [Listener at localhost/36187] util.ClassSize(228): Using Unsafe to estimate memory layout 2024-02-20 18:54:45,517 INFO [Listener at localhost/36187] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36731 2024-02-20 18:54:45,533 INFO [Listener at localhost/36187] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-20 18:54:45,536 INFO [Listener at localhost/36187] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-20 18:54:45,563 INFO [Listener at localhost/36187] zookeeper.RecoverableZooKeeper(93): Process identifier=master:36731 connecting to ZooKeeper ensemble=127.0.0.1:59580 2024-02-20 18:54:45,607 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:367310x0, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-02-20 18:54:45,610 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:36731-0x101e5eeafa10000 connected 2024-02-20 18:54:45,644 DEBUG [Listener at localhost/36187] zookeeper.ZKUtil(165): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-02-20 18:54:45,645 DEBUG [Listener at localhost/36187] zookeeper.ZKUtil(165): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-02-20 18:54:45,649 DEBUG [Listener at localhost/36187] zookeeper.ZKUtil(165): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-02-20 18:54:45,657 DEBUG [Listener at localhost/36187] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36731 2024-02-20 18:54:45,657 DEBUG [Listener at localhost/36187] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36731 2024-02-20 18:54:45,658 DEBUG [Listener at localhost/36187] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36731 2024-02-20 18:54:45,658 DEBUG [Listener at localhost/36187] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36731 2024-02-20 18:54:45,659 DEBUG [Listener at localhost/36187] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36731 2024-02-20 18:54:45,665 INFO [Listener at localhost/36187] master.HMaster(445): hbase.rootdir=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d, hbase.cluster.distributed=false 2024-02-20 18:54:45,736 INFO [Listener at localhost/36187] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-02-20 18:54:45,737 INFO [Listener at localhost/36187] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-02-20 18:54:45,737 INFO [Listener at localhost/36187] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-02-20 18:54:45,737 INFO [Listener at localhost/36187] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-02-20 18:54:45,737 INFO [Listener at localhost/36187] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-02-20 18:54:45,738 INFO [Listener at localhost/36187] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-02-20 18:54:45,743 INFO [Listener at localhost/36187] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-02-20 18:54:45,746 INFO [Listener at localhost/36187] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33065 2024-02-20 18:54:45,749 INFO [Listener at localhost/36187] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-02-20 18:54:45,756 DEBUG [Listener at localhost/36187] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-02-20 18:54:45,757 INFO [Listener at localhost/36187] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-20 18:54:45,759 INFO [Listener at localhost/36187] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-20 18:54:45,762 INFO [Listener at localhost/36187] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33065 connecting to ZooKeeper ensemble=127.0.0.1:59580 2024-02-20 18:54:45,766 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): regionserver:330650x0, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-02-20 18:54:45,767 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33065-0x101e5eeafa10001 connected 2024-02-20 18:54:45,767 DEBUG [Listener at localhost/36187] zookeeper.ZKUtil(165): regionserver:33065-0x101e5eeafa10001, quorum=127.0.0.1:59580, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-02-20 18:54:45,769 DEBUG [Listener at localhost/36187] zookeeper.ZKUtil(165): regionserver:33065-0x101e5eeafa10001, quorum=127.0.0.1:59580, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-02-20 18:54:45,770 DEBUG [Listener at localhost/36187] zookeeper.ZKUtil(165): regionserver:33065-0x101e5eeafa10001, quorum=127.0.0.1:59580, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-02-20 18:54:45,770 DEBUG [Listener at localhost/36187] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33065 2024-02-20 18:54:45,771 DEBUG [Listener at localhost/36187] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33065 2024-02-20 18:54:45,771 DEBUG [Listener at localhost/36187] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33065 2024-02-20 18:54:45,772 DEBUG [Listener at localhost/36187] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33065 2024-02-20 18:54:45,772 DEBUG [Listener at localhost/36187] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33065 2024-02-20 18:54:45,785 INFO [Listener at localhost/36187] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-02-20 18:54:45,786 INFO [Listener at localhost/36187] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-02-20 18:54:45,786 INFO [Listener at localhost/36187] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-02-20 18:54:45,786 INFO [Listener at localhost/36187] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-02-20 18:54:45,787 INFO [Listener at localhost/36187] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-02-20 18:54:45,787 INFO [Listener at localhost/36187] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-02-20 18:54:45,787 INFO [Listener at localhost/36187] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-02-20 18:54:45,789 INFO [Listener at localhost/36187] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38947 2024-02-20 18:54:45,790 INFO [Listener at localhost/36187] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-02-20 18:54:45,791 DEBUG [Listener at localhost/36187] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-02-20 18:54:45,792 INFO [Listener at localhost/36187] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-20 18:54:45,794 INFO [Listener at localhost/36187] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-20 18:54:45,796 INFO [Listener at localhost/36187] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38947 connecting to ZooKeeper ensemble=127.0.0.1:59580 2024-02-20 18:54:45,801 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): regionserver:389470x0, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-02-20 18:54:45,802 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38947-0x101e5eeafa10002 connected 2024-02-20 18:54:45,802 DEBUG [Listener at localhost/36187] zookeeper.ZKUtil(165): regionserver:38947-0x101e5eeafa10002, quorum=127.0.0.1:59580, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-02-20 18:54:45,803 DEBUG [Listener at localhost/36187] zookeeper.ZKUtil(165): regionserver:38947-0x101e5eeafa10002, quorum=127.0.0.1:59580, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-02-20 18:54:45,804 DEBUG [Listener at localhost/36187] zookeeper.ZKUtil(165): regionserver:38947-0x101e5eeafa10002, quorum=127.0.0.1:59580, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-02-20 18:54:45,805 DEBUG [Listener at localhost/36187] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38947 2024-02-20 18:54:45,805 DEBUG [Listener at localhost/36187] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38947 2024-02-20 18:54:45,808 DEBUG [Listener at localhost/36187] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38947 2024-02-20 18:54:45,809 DEBUG [Listener at localhost/36187] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38947 2024-02-20 18:54:45,810 DEBUG [Listener at localhost/36187] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38947 2024-02-20 18:54:45,813 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2174): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,36731,1708455284482 2024-02-20 18:54:45,823 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-02-20 18:54:45,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,36731,1708455284482 2024-02-20 18:54:45,848 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): regionserver:33065-0x101e5eeafa10001, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-02-20 18:54:45,848 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): regionserver:38947-0x101e5eeafa10002, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-02-20 18:54:45,848 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-02-20 18:54:45,849 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-20 18:54:45,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-02-20 18:54:45,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,36731,1708455284482 from backup master directory 2024-02-20 18:54:45,852 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(163): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-02-20 18:54:45,855 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,36731,1708455284482 2024-02-20 18:54:45,855 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-02-20 18:54:45,856 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-02-20 18:54:45,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,36731,1708455284482 2024-02-20 18:54:45,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2024-02-20 18:54:45,860 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2024-02-20 18:54:45,948 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/hbase.id with ID: 7a3c54f2-111c-4737-834e-a998cf5cb4b7 2024-02-20 18:54:45,999 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-20 18:54:46,018 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-20 18:54:46,065 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x6bed6b55 to 127.0.0.1:59580 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-02-20 18:54:46,099 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6c085329, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-02-20 18:54:46,124 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-02-20 18:54:46,126 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2024-02-20 18:54:46,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2024-02-20 18:54:46,144 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2024-02-20 18:54:46,146 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-02-20 18:54:46,151 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-02-20 18:54:46,153 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-02-20 18:54:46,188 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/MasterData/data/master/store-tmp 2024-02-20 18:54:46,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-20 18:54:46,227 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-02-20 18:54:46,227 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-20 18:54:46,228 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-20 18:54:46,228 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-02-20 18:54:46,228 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-20 18:54:46,228 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-20 18:54:46,228 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-02-20 18:54:46,230 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/MasterData/WALs/jenkins-hbase4.apache.org,36731,1708455284482 2024-02-20 18:54:46,259 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36731%2C1708455284482, suffix=, logDir=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/MasterData/WALs/jenkins-hbase4.apache.org,36731,1708455284482, archiveDir=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/MasterData/oldWALs, maxLogs=10 2024-02-20 18:54:46,333 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35435,DS-6964c84e-3630-4ffb-9a5a-542e37f38414,DISK] 2024-02-20 18:54:46,333 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44909,DS-3210ec81-632d-4ef8-8463-3935fe68d080,DISK] 2024-02-20 18:54:46,342 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2024-02-20 18:54:46,414 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/MasterData/WALs/jenkins-hbase4.apache.org,36731,1708455284482/jenkins-hbase4.apache.org%2C36731%2C1708455284482.1708455286275 2024-02-20 18:54:46,414 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44909,DS-3210ec81-632d-4ef8-8463-3935fe68d080,DISK], DatanodeInfoWithStorage[127.0.0.1:35435,DS-6964c84e-3630-4ffb-9a5a-542e37f38414,DISK]] 2024-02-20 18:54:46,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2024-02-20 18:54:46,415 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-20 18:54:46,419 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2024-02-20 18:54:46,420 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2024-02-20 18:54:46,478 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2024-02-20 18:54:46,487 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2024-02-20 18:54:46,512 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2024-02-20 18:54:46,524 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-20 18:54:46,529 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-02-20 18:54:46,531 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-02-20 18:54:46,546 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2024-02-20 18:54:46,550 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-20 18:54:46,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72335404, jitterRate=0.07788151502609253}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-02-20 18:54:46,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2024-02-20 18:54:46,553 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2024-02-20 18:54:46,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2024-02-20 18:54:46,573 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(608): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2024-02-20 18:54:46,576 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2024-02-20 18:54:46,578 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(628): Recovered RegionProcedureStore lease in 1 msec 2024-02-20 18:54:46,612 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(642): Loaded RegionProcedureStore in 34 msec 2024-02-20 18:54:46,613 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2024-02-20 18:54:46,639 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2024-02-20 18:54:46,646 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2024-02-20 18:54:46,674 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2024-02-20 18:54:46,678 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2024-02-20 18:54:46,680 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2024-02-20 18:54:46,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2024-02-20 18:54:46,690 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2024-02-20 18:54:46,694 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-20 18:54:46,695 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2024-02-20 18:54:46,696 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2024-02-20 18:54:46,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2024-02-20 18:54:46,713 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): regionserver:33065-0x101e5eeafa10001, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-02-20 18:54:46,714 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): regionserver:38947-0x101e5eeafa10002, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-02-20 18:54:46,714 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-02-20 18:54:46,714 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-20 18:54:46,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(745): Active/primary master=jenkins-hbase4.apache.org,36731,1708455284482, sessionid=0x101e5eeafa10000, setting cluster-up flag (Was=false) 2024-02-20 18:54:46,732 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-20 18:54:46,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2024-02-20 18:54:46,741 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36731,1708455284482 2024-02-20 18:54:46,747 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-20 18:54:46,754 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2024-02-20 18:54:46,756 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,36731,1708455284482 2024-02-20 18:54:46,759 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.hbase-snapshot/.tmp 2024-02-20 18:54:46,808 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver loaded, priority=536870911. 2024-02-20 18:54:46,816 INFO [RS:0;jenkins-hbase4:33065] regionserver.HRegionServer(954): ClusterId : 7a3c54f2-111c-4737-834e-a998cf5cb4b7 2024-02-20 18:54:46,816 INFO [RS:1;jenkins-hbase4:38947] regionserver.HRegionServer(954): ClusterId : 7a3c54f2-111c-4737-834e-a998cf5cb4b7 2024-02-20 18:54:46,822 DEBUG [RS:1;jenkins-hbase4:38947] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-02-20 18:54:46,822 DEBUG [RS:0;jenkins-hbase4:33065] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-02-20 18:54:46,829 DEBUG [RS:0;jenkins-hbase4:33065] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-02-20 18:54:46,829 DEBUG [RS:1;jenkins-hbase4:38947] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-02-20 18:54:46,829 DEBUG [RS:0;jenkins-hbase4:33065] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-02-20 18:54:46,829 DEBUG [RS:1;jenkins-hbase4:38947] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-02-20 18:54:46,833 DEBUG [RS:0;jenkins-hbase4:33065] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-02-20 18:54:46,835 DEBUG [RS:1;jenkins-hbase4:38947] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-02-20 18:54:46,837 DEBUG [RS:0;jenkins-hbase4:33065] zookeeper.ReadOnlyZKClient(139): Connect 0x7095181d to 127.0.0.1:59580 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-02-20 18:54:46,838 DEBUG [RS:1;jenkins-hbase4:38947] zookeeper.ReadOnlyZKClient(139): Connect 0x78e5b353 to 127.0.0.1:59580 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-02-20 18:54:46,844 DEBUG [RS:0;jenkins-hbase4:33065] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7e52f87f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-02-20 18:54:46,845 DEBUG [RS:0;jenkins-hbase4:33065] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a6d736d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-02-20 18:54:46,845 DEBUG [RS:1;jenkins-hbase4:38947] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7622523f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-02-20 18:54:46,846 DEBUG [RS:1;jenkins-hbase4:38947] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@721dd823, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-02-20 18:54:46,873 DEBUG [RS:0;jenkins-hbase4:33065] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:33065 2024-02-20 18:54:46,873 DEBUG [RS:1;jenkins-hbase4:38947] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:38947 2024-02-20 18:54:46,878 INFO [RS:1;jenkins-hbase4:38947] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-02-20 18:54:46,879 INFO [RS:1;jenkins-hbase4:38947] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-02-20 18:54:46,878 INFO [RS:0;jenkins-hbase4:33065] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-02-20 18:54:46,879 INFO [RS:0;jenkins-hbase4:33065] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-02-20 18:54:46,879 DEBUG [RS:1;jenkins-hbase4:38947] regionserver.HRegionServer(1025): About to register with Master. 2024-02-20 18:54:46,879 DEBUG [RS:0;jenkins-hbase4:33065] regionserver.HRegionServer(1025): About to register with Master. 2024-02-20 18:54:46,882 INFO [RS:1;jenkins-hbase4:38947] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase4.apache.org,36731,1708455284482 with isa=jenkins-hbase4.apache.org/172.31.14.131:38947, startcode=1708455285785 2024-02-20 18:54:46,882 INFO [RS:0;jenkins-hbase4:33065] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase4.apache.org,36731,1708455284482 with isa=jenkins-hbase4.apache.org/172.31.14.131:33065, startcode=1708455285736 2024-02-20 18:54:46,900 DEBUG [RS:0;jenkins-hbase4:33065] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-02-20 18:54:46,900 DEBUG [RS:1;jenkins-hbase4:38947] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-02-20 18:54:46,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2024-02-20 18:54:46,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-02-20 18:54:46,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-02-20 18:54:46,918 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-02-20 18:54:46,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-02-20 18:54:46,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2024-02-20 18:54:46,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-20 18:54:46,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-02-20 18:54:46,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-20 18:54:46,922 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1708455316922 2024-02-20 18:54:46,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2024-02-20 18:54:46,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2024-02-20 18:54:46,943 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2024-02-20 18:54:46,944 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2024-02-20 18:54:46,949 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2024-02-20 18:54:46,950 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-02-20 18:54:46,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2024-02-20 18:54:46,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2024-02-20 18:54:46,950 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2024-02-20 18:54:46,952 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:46,955 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2024-02-20 18:54:46,957 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2024-02-20 18:54:46,958 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2024-02-20 18:54:46,961 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2024-02-20 18:54:46,962 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2024-02-20 18:54:46,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1708455286963,5,FailOnTimeoutGroup] 2024-02-20 18:54:46,964 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1708455286964,5,FailOnTimeoutGroup] 2024-02-20 18:54:46,964 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:46,965 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1466): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2024-02-20 18:54:46,966 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42825, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2024-02-20 18:54:46,966 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34959, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2024-02-20 18:54:46,966 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:46,967 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:46,985 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36731] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,33065,1708455285736 2024-02-20 18:54:46,998 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-02-20 18:54:46,999 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-02-20 18:54:47,000 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d 2024-02-20 18:54:47,004 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=36731] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,38947,1708455285785 2024-02-20 18:54:47,012 DEBUG [RS:0;jenkins-hbase4:33065] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d 2024-02-20 18:54:47,012 DEBUG [RS:1;jenkins-hbase4:38947] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d 2024-02-20 18:54:47,013 DEBUG [RS:0;jenkins-hbase4:33065] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:39943 2024-02-20 18:54:47,013 DEBUG [RS:1;jenkins-hbase4:38947] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:39943 2024-02-20 18:54:47,013 DEBUG [RS:0;jenkins-hbase4:33065] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-02-20 18:54:47,013 DEBUG [RS:1;jenkins-hbase4:38947] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-02-20 18:54:47,027 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-02-20 18:54:47,027 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-20 18:54:47,028 DEBUG [RS:0;jenkins-hbase4:33065] zookeeper.ZKUtil(163): regionserver:33065-0x101e5eeafa10001, quorum=127.0.0.1:59580, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33065,1708455285736 2024-02-20 18:54:47,028 WARN [RS:0;jenkins-hbase4:33065] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-02-20 18:54:47,028 DEBUG [RS:1;jenkins-hbase4:38947] zookeeper.ZKUtil(163): regionserver:38947-0x101e5eeafa10002, quorum=127.0.0.1:59580, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38947,1708455285785 2024-02-20 18:54:47,028 INFO [RS:0;jenkins-hbase4:33065] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-02-20 18:54:47,029 WARN [RS:1;jenkins-hbase4:38947] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-02-20 18:54:47,029 DEBUG [RS:0;jenkins-hbase4:33065] regionserver.HRegionServer(1950): logDir=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/WALs/jenkins-hbase4.apache.org,33065,1708455285736 2024-02-20 18:54:47,029 INFO [RS:1;jenkins-hbase4:38947] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-02-20 18:54:47,029 DEBUG [RS:1;jenkins-hbase4:38947] regionserver.HRegionServer(1950): logDir=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/WALs/jenkins-hbase4.apache.org,38947,1708455285785 2024-02-20 18:54:47,032 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-02-20 18:54:47,032 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33065,1708455285736] 2024-02-20 18:54:47,033 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38947,1708455285785] 2024-02-20 18:54:47,036 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/meta/1588230740/info 2024-02-20 18:54:47,038 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-02-20 18:54:47,039 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-20 18:54:47,039 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-02-20 18:54:47,042 DEBUG [RS:0;jenkins-hbase4:33065] zookeeper.ZKUtil(163): regionserver:33065-0x101e5eeafa10001, quorum=127.0.0.1:59580, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38947,1708455285785 2024-02-20 18:54:47,043 DEBUG [RS:1;jenkins-hbase4:38947] zookeeper.ZKUtil(163): regionserver:38947-0x101e5eeafa10002, quorum=127.0.0.1:59580, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38947,1708455285785 2024-02-20 18:54:47,043 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/meta/1588230740/rep_barrier 2024-02-20 18:54:47,044 DEBUG [RS:1;jenkins-hbase4:38947] zookeeper.ZKUtil(163): regionserver:38947-0x101e5eeafa10002, quorum=127.0.0.1:59580, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33065,1708455285736 2024-02-20 18:54:47,044 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-02-20 18:54:47,044 DEBUG [RS:0;jenkins-hbase4:33065] zookeeper.ZKUtil(163): regionserver:33065-0x101e5eeafa10001, quorum=127.0.0.1:59580, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33065,1708455285736 2024-02-20 18:54:47,045 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-20 18:54:47,045 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-02-20 18:54:47,048 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/meta/1588230740/table 2024-02-20 18:54:47,049 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-02-20 18:54:47,050 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-20 18:54:47,052 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/meta/1588230740 2024-02-20 18:54:47,053 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/meta/1588230740 2024-02-20 18:54:47,057 DEBUG [RS:0;jenkins-hbase4:33065] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-02-20 18:54:47,057 DEBUG [RS:1;jenkins-hbase4:38947] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-02-20 18:54:47,058 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-02-20 18:54:47,060 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2024-02-20 18:54:47,065 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-20 18:54:47,066 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59256903, jitterRate=-0.11700333654880524}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-02-20 18:54:47,066 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2024-02-20 18:54:47,066 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-02-20 18:54:47,066 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-02-20 18:54:47,066 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-02-20 18:54:47,066 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-02-20 18:54:47,066 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-02-20 18:54:47,067 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-02-20 18:54:47,068 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-02-20 18:54:47,068 INFO [RS:0;jenkins-hbase4:33065] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-02-20 18:54:47,068 INFO [RS:1;jenkins-hbase4:38947] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-02-20 18:54:47,074 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2024-02-20 18:54:47,074 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2024-02-20 18:54:47,083 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2024-02-20 18:54:47,091 INFO [RS:1;jenkins-hbase4:38947] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-02-20 18:54:47,091 INFO [RS:0;jenkins-hbase4:33065] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-02-20 18:54:47,096 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2024-02-20 18:54:47,096 INFO [RS:0;jenkins-hbase4:33065] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-02-20 18:54:47,097 INFO [RS:0;jenkins-hbase4:33065] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:47,101 INFO [RS:1;jenkins-hbase4:38947] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-02-20 18:54:47,101 INFO [RS:1;jenkins-hbase4:38947] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:47,102 INFO [RS:0;jenkins-hbase4:33065] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-02-20 18:54:47,102 INFO [RS:1;jenkins-hbase4:38947] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-02-20 18:54:47,104 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2024-02-20 18:54:47,111 INFO [RS:0;jenkins-hbase4:33065] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:47,111 INFO [RS:1;jenkins-hbase4:38947] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:47,111 DEBUG [RS:0;jenkins-hbase4:33065] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-20 18:54:47,111 DEBUG [RS:1;jenkins-hbase4:38947] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-20 18:54:47,111 DEBUG [RS:0;jenkins-hbase4:33065] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-20 18:54:47,111 DEBUG [RS:1;jenkins-hbase4:38947] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-20 18:54:47,111 DEBUG [RS:0;jenkins-hbase4:33065] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-20 18:54:47,111 DEBUG [RS:1;jenkins-hbase4:38947] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-20 18:54:47,112 DEBUG [RS:0;jenkins-hbase4:33065] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-20 18:54:47,112 DEBUG [RS:1;jenkins-hbase4:38947] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-20 18:54:47,112 DEBUG [RS:0;jenkins-hbase4:33065] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-20 18:54:47,112 DEBUG [RS:1;jenkins-hbase4:38947] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-20 18:54:47,112 DEBUG [RS:0;jenkins-hbase4:33065] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-02-20 18:54:47,112 DEBUG [RS:1;jenkins-hbase4:38947] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-02-20 18:54:47,112 DEBUG [RS:0;jenkins-hbase4:33065] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-20 18:54:47,112 DEBUG [RS:1;jenkins-hbase4:38947] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-20 18:54:47,112 DEBUG [RS:0;jenkins-hbase4:33065] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-20 18:54:47,112 DEBUG [RS:1;jenkins-hbase4:38947] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-20 18:54:47,112 DEBUG [RS:0;jenkins-hbase4:33065] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-20 18:54:47,112 DEBUG [RS:1;jenkins-hbase4:38947] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-20 18:54:47,113 DEBUG [RS:0;jenkins-hbase4:33065] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-20 18:54:47,113 DEBUG [RS:1;jenkins-hbase4:38947] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-20 18:54:47,114 INFO [RS:1;jenkins-hbase4:38947] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:47,115 INFO [RS:0;jenkins-hbase4:33065] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:47,115 INFO [RS:1;jenkins-hbase4:38947] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:47,115 INFO [RS:0;jenkins-hbase4:33065] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:47,115 INFO [RS:1;jenkins-hbase4:38947] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:47,115 INFO [RS:0;jenkins-hbase4:33065] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:47,115 INFO [RS:1;jenkins-hbase4:38947] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:47,115 INFO [RS:0;jenkins-hbase4:33065] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:47,132 INFO [RS:0;jenkins-hbase4:33065] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-02-20 18:54:47,134 INFO [RS:1;jenkins-hbase4:38947] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-02-20 18:54:47,135 INFO [RS:0;jenkins-hbase4:33065] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33065,1708455285736-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:47,135 INFO [RS:1;jenkins-hbase4:38947] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38947,1708455285785-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:47,154 INFO [RS:1;jenkins-hbase4:38947] regionserver.Replication(203): jenkins-hbase4.apache.org,38947,1708455285785 started 2024-02-20 18:54:47,154 INFO [RS:0;jenkins-hbase4:33065] regionserver.Replication(203): jenkins-hbase4.apache.org,33065,1708455285736 started 2024-02-20 18:54:47,154 INFO [RS:1;jenkins-hbase4:38947] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,38947,1708455285785, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38947, sessionid=0x101e5eeafa10002 2024-02-20 18:54:47,154 INFO [RS:0;jenkins-hbase4:33065] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,33065,1708455285736, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33065, sessionid=0x101e5eeafa10001 2024-02-20 18:54:47,155 DEBUG [RS:1;jenkins-hbase4:38947] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-02-20 18:54:47,155 DEBUG [RS:0;jenkins-hbase4:33065] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-02-20 18:54:47,155 DEBUG [RS:1;jenkins-hbase4:38947] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38947,1708455285785 2024-02-20 18:54:47,155 DEBUG [RS:0;jenkins-hbase4:33065] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33065,1708455285736 2024-02-20 18:54:47,155 DEBUG [RS:1;jenkins-hbase4:38947] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38947,1708455285785' 2024-02-20 18:54:47,156 DEBUG [RS:0;jenkins-hbase4:33065] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33065,1708455285736' 2024-02-20 18:54:47,156 DEBUG [RS:1;jenkins-hbase4:38947] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-02-20 18:54:47,156 DEBUG [RS:0;jenkins-hbase4:33065] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-02-20 18:54:47,157 DEBUG [RS:0;jenkins-hbase4:33065] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-02-20 18:54:47,157 DEBUG [RS:1;jenkins-hbase4:38947] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-02-20 18:54:47,158 DEBUG [RS:0;jenkins-hbase4:33065] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-02-20 18:54:47,158 DEBUG [RS:1;jenkins-hbase4:38947] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-02-20 18:54:47,158 DEBUG [RS:1;jenkins-hbase4:38947] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-02-20 18:54:47,158 DEBUG [RS:0;jenkins-hbase4:33065] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-02-20 18:54:47,158 DEBUG [RS:1;jenkins-hbase4:38947] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38947,1708455285785 2024-02-20 18:54:47,158 DEBUG [RS:0;jenkins-hbase4:33065] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33065,1708455285736 2024-02-20 18:54:47,159 DEBUG [RS:1;jenkins-hbase4:38947] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38947,1708455285785' 2024-02-20 18:54:47,159 DEBUG [RS:1;jenkins-hbase4:38947] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-02-20 18:54:47,159 DEBUG [RS:0;jenkins-hbase4:33065] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33065,1708455285736' 2024-02-20 18:54:47,159 DEBUG [RS:0;jenkins-hbase4:33065] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-02-20 18:54:47,160 DEBUG [RS:1;jenkins-hbase4:38947] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-02-20 18:54:47,160 DEBUG [RS:0;jenkins-hbase4:33065] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-02-20 18:54:47,160 DEBUG [RS:1;jenkins-hbase4:38947] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-02-20 18:54:47,160 INFO [RS:1;jenkins-hbase4:38947] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-02-20 18:54:47,160 DEBUG [RS:0;jenkins-hbase4:33065] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-02-20 18:54:47,161 INFO [RS:0;jenkins-hbase4:33065] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-02-20 18:54:47,163 INFO [RS:0;jenkins-hbase4:33065] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:47,163 INFO [RS:1;jenkins-hbase4:38947] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:47,164 DEBUG [RS:1;jenkins-hbase4:38947] zookeeper.ZKUtil(399): regionserver:38947-0x101e5eeafa10002, quorum=127.0.0.1:59580, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-02-20 18:54:47,164 DEBUG [RS:0;jenkins-hbase4:33065] zookeeper.ZKUtil(399): regionserver:33065-0x101e5eeafa10001, quorum=127.0.0.1:59580, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-02-20 18:54:47,164 INFO [RS:1;jenkins-hbase4:38947] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-02-20 18:54:47,164 INFO [RS:0;jenkins-hbase4:33065] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-02-20 18:54:47,164 INFO [RS:1;jenkins-hbase4:38947] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:47,164 INFO [RS:0;jenkins-hbase4:33065] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:47,165 INFO [RS:1;jenkins-hbase4:38947] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:47,165 INFO [RS:0;jenkins-hbase4:33065] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:47,255 DEBUG [jenkins-hbase4:36731] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=2, allServersCount=2 2024-02-20 18:54:47,259 DEBUG [jenkins-hbase4:36731] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-02-20 18:54:47,266 DEBUG [jenkins-hbase4:36731] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-02-20 18:54:47,266 DEBUG [jenkins-hbase4:36731] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-02-20 18:54:47,266 DEBUG [jenkins-hbase4:36731] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-02-20 18:54:47,269 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38947,1708455285785, state=OPENING 2024-02-20 18:54:47,276 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2024-02-20 18:54:47,278 INFO [RS:1;jenkins-hbase4:38947] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38947%2C1708455285785, suffix=, logDir=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/WALs/jenkins-hbase4.apache.org,38947,1708455285785, archiveDir=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/oldWALs, maxLogs=32 2024-02-20 18:54:47,278 INFO [RS:0;jenkins-hbase4:33065] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33065%2C1708455285736, suffix=, logDir=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/WALs/jenkins-hbase4.apache.org,33065,1708455285736, archiveDir=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/oldWALs, maxLogs=32 2024-02-20 18:54:47,279 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-20 18:54:47,280 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-02-20 18:54:47,284 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38947,1708455285785}] 2024-02-20 18:54:47,304 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35435,DS-6964c84e-3630-4ffb-9a5a-542e37f38414,DISK] 2024-02-20 18:54:47,304 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44909,DS-3210ec81-632d-4ef8-8463-3935fe68d080,DISK] 2024-02-20 18:54:47,348 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35435,DS-6964c84e-3630-4ffb-9a5a-542e37f38414,DISK] 2024-02-20 18:54:47,349 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44909,DS-3210ec81-632d-4ef8-8463-3935fe68d080,DISK] 2024-02-20 18:54:47,352 INFO [RS:1;jenkins-hbase4:38947] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/WALs/jenkins-hbase4.apache.org,38947,1708455285785/jenkins-hbase4.apache.org%2C38947%2C1708455285785.1708455287284 2024-02-20 18:54:47,358 DEBUG [RS:1;jenkins-hbase4:38947] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:44909,DS-3210ec81-632d-4ef8-8463-3935fe68d080,DISK], DatanodeInfoWithStorage[127.0.0.1:35435,DS-6964c84e-3630-4ffb-9a5a-542e37f38414,DISK]] 2024-02-20 18:54:47,359 INFO [RS:0;jenkins-hbase4:33065] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/WALs/jenkins-hbase4.apache.org,33065,1708455285736/jenkins-hbase4.apache.org%2C33065%2C1708455285736.1708455287284 2024-02-20 18:54:47,360 DEBUG [RS:0;jenkins-hbase4:33065] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35435,DS-6964c84e-3630-4ffb-9a5a-542e37f38414,DISK], DatanodeInfoWithStorage[127.0.0.1:44909,DS-3210ec81-632d-4ef8-8463-3935fe68d080,DISK]] 2024-02-20 18:54:47,517 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38947,1708455285785 2024-02-20 18:54:47,519 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-02-20 18:54:47,523 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47376, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-02-20 18:54:47,535 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2024-02-20 18:54:47,536 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-02-20 18:54:47,539 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38947%2C1708455285785.meta, suffix=.meta, logDir=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/WALs/jenkins-hbase4.apache.org,38947,1708455285785, archiveDir=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/oldWALs, maxLogs=32 2024-02-20 18:54:47,557 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:35435,DS-6964c84e-3630-4ffb-9a5a-542e37f38414,DISK] 2024-02-20 18:54:47,557 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:44909,DS-3210ec81-632d-4ef8-8463-3935fe68d080,DISK] 2024-02-20 18:54:47,564 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/WALs/jenkins-hbase4.apache.org,38947,1708455285785/jenkins-hbase4.apache.org%2C38947%2C1708455285785.meta.1708455287540.meta 2024-02-20 18:54:47,565 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:35435,DS-6964c84e-3630-4ffb-9a5a-542e37f38414,DISK], DatanodeInfoWithStorage[127.0.0.1:44909,DS-3210ec81-632d-4ef8-8463-3935fe68d080,DISK]] 2024-02-20 18:54:47,566 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2024-02-20 18:54:47,568 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2024-02-20 18:54:47,593 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2024-02-20 18:54:47,598 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2024-02-20 18:54:47,606 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2024-02-20 18:54:47,606 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-20 18:54:47,606 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2024-02-20 18:54:47,606 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2024-02-20 18:54:47,610 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-02-20 18:54:47,612 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/meta/1588230740/info 2024-02-20 18:54:47,612 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/meta/1588230740/info 2024-02-20 18:54:47,613 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-02-20 18:54:47,614 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-20 18:54:47,614 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-02-20 18:54:47,616 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/meta/1588230740/rep_barrier 2024-02-20 18:54:47,616 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/meta/1588230740/rep_barrier 2024-02-20 18:54:47,617 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-02-20 18:54:47,618 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-20 18:54:47,618 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-02-20 18:54:47,620 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/meta/1588230740/table 2024-02-20 18:54:47,620 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/meta/1588230740/table 2024-02-20 18:54:47,620 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-02-20 18:54:47,621 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-20 18:54:47,623 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/meta/1588230740 2024-02-20 18:54:47,626 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/meta/1588230740 2024-02-20 18:54:47,630 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-02-20 18:54:47,633 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2024-02-20 18:54:47,635 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74069717, jitterRate=0.10372479259967804}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-02-20 18:54:47,635 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2024-02-20 18:54:47,647 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1708455287509 2024-02-20 18:54:47,665 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:meta,,1.1588230740 2024-02-20 18:54:47,666 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2024-02-20 18:54:47,666 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,38947,1708455285785, state=OPEN 2024-02-20 18:54:47,670 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2024-02-20 18:54:47,670 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-02-20 18:54:47,674 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=3, resume processing ppid=2 2024-02-20 18:54:47,675 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,38947,1708455285785 in 386 msec 2024-02-20 18:54:47,680 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=2, resume processing ppid=1 2024-02-20 18:54:47,680 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 594 msec 2024-02-20 18:54:47,685 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 868 msec 2024-02-20 18:54:47,685 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(954): Wait for region servers to report in: status=null, state=RUNNING, startTime=1708455287685, completionTime=-1 2024-02-20 18:54:47,686 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2024-02-20 18:54:47,686 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2024-02-20 18:54:47,752 DEBUG [hconnection-0x56b9585f-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-02-20 18:54:47,755 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47388, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-02-20 18:54:47,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=2 2024-02-20 18:54:47,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1708455347772 2024-02-20 18:54:47,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1708455407772 2024-02-20 18:54:47,772 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 85 msec 2024-02-20 18:54:47,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36731,1708455284482-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:47,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36731,1708455284482-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:47,797 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36731,1708455284482-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:47,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:36731, period=300000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:47,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:47,808 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2024-02-20 18:54:47,816 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2024-02-20 18:54:47,817 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-02-20 18:54:47,826 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2024-02-20 18:54:47,830 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2024-02-20 18:54:47,832 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-02-20 18:54:47,853 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/hbase/namespace/aae44a8ec16fd3d4228dbcd31bae43a1 2024-02-20 18:54:47,856 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/hbase/namespace/aae44a8ec16fd3d4228dbcd31bae43a1 empty. 2024-02-20 18:54:47,857 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/hbase/namespace/aae44a8ec16fd3d4228dbcd31bae43a1 2024-02-20 18:54:47,857 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2024-02-20 18:54:47,886 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2024-02-20 18:54:47,888 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => aae44a8ec16fd3d4228dbcd31bae43a1, NAME => 'hbase:namespace,,1708455287816.aae44a8ec16fd3d4228dbcd31bae43a1.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp 2024-02-20 18:54:47,907 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1708455287816.aae44a8ec16fd3d4228dbcd31bae43a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-20 18:54:47,907 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing aae44a8ec16fd3d4228dbcd31bae43a1, disabling compactions & flushes 2024-02-20 18:54:47,908 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1708455287816.aae44a8ec16fd3d4228dbcd31bae43a1. 2024-02-20 18:54:47,908 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1708455287816.aae44a8ec16fd3d4228dbcd31bae43a1. 2024-02-20 18:54:47,908 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1708455287816.aae44a8ec16fd3d4228dbcd31bae43a1. after waiting 0 ms 2024-02-20 18:54:47,908 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1708455287816.aae44a8ec16fd3d4228dbcd31bae43a1. 2024-02-20 18:54:47,908 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1708455287816.aae44a8ec16fd3d4228dbcd31bae43a1. 2024-02-20 18:54:47,908 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for aae44a8ec16fd3d4228dbcd31bae43a1: 2024-02-20 18:54:47,915 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2024-02-20 18:54:47,930 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1708455287816.aae44a8ec16fd3d4228dbcd31bae43a1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1708455287918"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1708455287918"}]},"ts":"1708455287918"} 2024-02-20 18:54:47,961 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-02-20 18:54:47,963 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-02-20 18:54:47,967 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708455287963"}]},"ts":"1708455287963"} 2024-02-20 18:54:47,974 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2024-02-20 18:54:47,979 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-02-20 18:54:47,981 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-02-20 18:54:47,981 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-02-20 18:54:47,981 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-02-20 18:54:47,984 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=aae44a8ec16fd3d4228dbcd31bae43a1, ASSIGN}] 2024-02-20 18:54:47,987 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=aae44a8ec16fd3d4228dbcd31bae43a1, ASSIGN 2024-02-20 18:54:47,989 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=aae44a8ec16fd3d4228dbcd31bae43a1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38947,1708455285785; forceNewPlan=false, retain=false 2024-02-20 18:54:48,141 INFO [jenkins-hbase4:36731] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-02-20 18:54:48,142 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=aae44a8ec16fd3d4228dbcd31bae43a1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38947,1708455285785 2024-02-20 18:54:48,142 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1708455287816.aae44a8ec16fd3d4228dbcd31bae43a1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1708455288142"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1708455288142"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1708455288142"}]},"ts":"1708455288142"} 2024-02-20 18:54:48,148 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure aae44a8ec16fd3d4228dbcd31bae43a1, server=jenkins-hbase4.apache.org,38947,1708455285785}] 2024-02-20 18:54:48,305 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38947,1708455285785 2024-02-20 18:54:48,312 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1708455287816.aae44a8ec16fd3d4228dbcd31bae43a1. 2024-02-20 18:54:48,313 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => aae44a8ec16fd3d4228dbcd31bae43a1, NAME => 'hbase:namespace,,1708455287816.aae44a8ec16fd3d4228dbcd31bae43a1.', STARTKEY => '', ENDKEY => ''} 2024-02-20 18:54:48,314 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace aae44a8ec16fd3d4228dbcd31bae43a1 2024-02-20 18:54:48,314 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1708455287816.aae44a8ec16fd3d4228dbcd31bae43a1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-20 18:54:48,314 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for aae44a8ec16fd3d4228dbcd31bae43a1 2024-02-20 18:54:48,314 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for aae44a8ec16fd3d4228dbcd31bae43a1 2024-02-20 18:54:48,317 INFO [StoreOpener-aae44a8ec16fd3d4228dbcd31bae43a1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region aae44a8ec16fd3d4228dbcd31bae43a1 2024-02-20 18:54:48,319 DEBUG [StoreOpener-aae44a8ec16fd3d4228dbcd31bae43a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/namespace/aae44a8ec16fd3d4228dbcd31bae43a1/info 2024-02-20 18:54:48,319 DEBUG [StoreOpener-aae44a8ec16fd3d4228dbcd31bae43a1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/namespace/aae44a8ec16fd3d4228dbcd31bae43a1/info 2024-02-20 18:54:48,320 INFO [StoreOpener-aae44a8ec16fd3d4228dbcd31bae43a1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region aae44a8ec16fd3d4228dbcd31bae43a1 columnFamilyName info 2024-02-20 18:54:48,321 INFO [StoreOpener-aae44a8ec16fd3d4228dbcd31bae43a1-1] regionserver.HStore(310): Store=aae44a8ec16fd3d4228dbcd31bae43a1/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-20 18:54:48,322 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/namespace/aae44a8ec16fd3d4228dbcd31bae43a1 2024-02-20 18:54:48,323 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/namespace/aae44a8ec16fd3d4228dbcd31bae43a1 2024-02-20 18:54:48,329 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for aae44a8ec16fd3d4228dbcd31bae43a1 2024-02-20 18:54:48,332 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/namespace/aae44a8ec16fd3d4228dbcd31bae43a1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-20 18:54:48,333 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened aae44a8ec16fd3d4228dbcd31bae43a1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64393047, jitterRate=-0.04046882688999176}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-02-20 18:54:48,333 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for aae44a8ec16fd3d4228dbcd31bae43a1: 2024-02-20 18:54:48,335 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:namespace,,1708455287816.aae44a8ec16fd3d4228dbcd31bae43a1., pid=6, masterSystemTime=1708455288305 2024-02-20 18:54:48,339 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:namespace,,1708455287816.aae44a8ec16fd3d4228dbcd31bae43a1. 2024-02-20 18:54:48,339 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1708455287816.aae44a8ec16fd3d4228dbcd31bae43a1. 2024-02-20 18:54:48,340 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=aae44a8ec16fd3d4228dbcd31bae43a1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38947,1708455285785 2024-02-20 18:54:48,341 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1708455287816.aae44a8ec16fd3d4228dbcd31bae43a1.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1708455288340"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1708455288340"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1708455288340"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1708455288340"}]},"ts":"1708455288340"} 2024-02-20 18:54:48,349 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=6, resume processing ppid=5 2024-02-20 18:54:48,349 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure aae44a8ec16fd3d4228dbcd31bae43a1, server=jenkins-hbase4.apache.org,38947,1708455285785 in 197 msec 2024-02-20 18:54:48,352 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=5, resume processing ppid=4 2024-02-20 18:54:48,353 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=aae44a8ec16fd3d4228dbcd31bae43a1, ASSIGN in 365 msec 2024-02-20 18:54:48,354 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-02-20 18:54:48,355 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708455288354"}]},"ts":"1708455288354"} 2024-02-20 18:54:48,358 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2024-02-20 18:54:48,361 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2024-02-20 18:54:48,364 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 543 msec 2024-02-20 18:54:48,430 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2024-02-20 18:54:48,432 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2024-02-20 18:54:48,432 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-20 18:54:48,467 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2024-02-20 18:54:48,488 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-02-20 18:54:48,495 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 36 msec 2024-02-20 18:54:48,501 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2024-02-20 18:54:48,514 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-02-20 18:54:48,519 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2024-02-20 18:54:48,528 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2024-02-20 18:54:48,531 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2024-02-20 18:54:48,531 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1084): Master has completed initialization 2.675sec 2024-02-20 18:54:48,534 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(103): Quota table not found. Creating... 2024-02-20 18:54:48,534 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-02-20 18:54:48,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:quota 2024-02-20 18:54:48,536 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(107): Initializing quota support 2024-02-20 18:54:48,538 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_PRE_OPERATION 2024-02-20 18:54:48,539 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(59): Namespace State Manager started. 2024-02-20 18:54:48,540 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-02-20 18:54:48,543 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/hbase/quota/37a6e0e80f56b427adb85b885a01934e 2024-02-20 18:54:48,544 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/hbase/quota/37a6e0e80f56b427adb85b885a01934e empty. 2024-02-20 18:54:48,546 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/hbase/quota/37a6e0e80f56b427adb85b885a01934e 2024-02-20 18:54:48,546 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:quota regions 2024-02-20 18:54:48,547 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(222): Finished updating state of 2 namespaces. 2024-02-20 18:54:48,547 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceAuditor(50): NamespaceAuditor started. 2024-02-20 18:54:48,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:48,549 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=300000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:48,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2024-02-20 18:54:48,551 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2024-02-20 18:54:48,552 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36731,1708455284482-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2024-02-20 18:54:48,553 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36731,1708455284482-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2024-02-20 18:54:48,570 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1176): Balancer post startup initialization complete, took 0 seconds 2024-02-20 18:54:48,571 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36731,1708455284482-OldWALsDirSizeChore, period=300000, unit=MILLISECONDS is enabled. 2024-02-20 18:54:48,574 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/hbase/quota/.tabledesc/.tableinfo.0000000001 2024-02-20 18:54:48,576 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(7675): creating {ENCODED => 37a6e0e80f56b427adb85b885a01934e, NAME => 'hbase:quota,,1708455288534.37a6e0e80f56b427adb85b885a01934e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp 2024-02-20 18:54:48,599 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(866): Instantiated hbase:quota,,1708455288534.37a6e0e80f56b427adb85b885a01934e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-20 18:54:48,599 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1604): Closing 37a6e0e80f56b427adb85b885a01934e, disabling compactions & flushes 2024-02-20 18:54:48,599 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1626): Closing region hbase:quota,,1708455288534.37a6e0e80f56b427adb85b885a01934e. 2024-02-20 18:54:48,599 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1708455288534.37a6e0e80f56b427adb85b885a01934e. 2024-02-20 18:54:48,599 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1708455288534.37a6e0e80f56b427adb85b885a01934e. after waiting 0 ms 2024-02-20 18:54:48,599 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1708455288534.37a6e0e80f56b427adb85b885a01934e. 2024-02-20 18:54:48,599 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1838): Closed hbase:quota,,1708455288534.37a6e0e80f56b427adb85b885a01934e. 2024-02-20 18:54:48,599 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1558): Region close journal for 37a6e0e80f56b427adb85b885a01934e: 2024-02-20 18:54:48,604 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ADD_TO_META 2024-02-20 18:54:48,606 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:quota,,1708455288534.37a6e0e80f56b427adb85b885a01934e.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1708455288606"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1708455288606"}]},"ts":"1708455288606"} 2024-02-20 18:54:48,609 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-02-20 18:54:48,611 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-02-20 18:54:48,611 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708455288611"}]},"ts":"1708455288611"} 2024-02-20 18:54:48,614 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLING in hbase:meta 2024-02-20 18:54:48,620 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-02-20 18:54:48,622 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-02-20 18:54:48,622 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-02-20 18:54:48,622 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-02-20 18:54:48,622 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=37a6e0e80f56b427adb85b885a01934e, ASSIGN}] 2024-02-20 18:54:48,624 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=37a6e0e80f56b427adb85b885a01934e, ASSIGN 2024-02-20 18:54:48,625 DEBUG [Listener at localhost/36187] zookeeper.ReadOnlyZKClient(139): Connect 0x0890ffaa to 127.0.0.1:59580 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-02-20 18:54:48,626 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:quota, region=37a6e0e80f56b427adb85b885a01934e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33065,1708455285736; forceNewPlan=false, retain=false 2024-02-20 18:54:48,630 DEBUG [Listener at localhost/36187] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3adeab09, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-02-20 18:54:48,645 DEBUG [hconnection-0x3bd00b95-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-02-20 18:54:48,663 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47396, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-02-20 18:54:48,673 INFO [Listener at localhost/36187] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,36731,1708455284482 2024-02-20 18:54:48,674 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:54:48,678 DEBUG [Listener at localhost/36187] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-02-20 18:54:48,776 INFO [jenkins-hbase4:36731] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-02-20 18:54:48,777 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=37a6e0e80f56b427adb85b885a01934e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33065,1708455285736 2024-02-20 18:54:48,777 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:quota,,1708455288534.37a6e0e80f56b427adb85b885a01934e.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1708455288777"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1708455288777"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1708455288777"}]},"ts":"1708455288777"} 2024-02-20 18:54:48,780 DEBUG [Listener at localhost/36187] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-02-20 18:54:48,781 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 37a6e0e80f56b427adb85b885a01934e, server=jenkins-hbase4.apache.org,33065,1708455285736}] 2024-02-20 18:54:48,883 DEBUG [Listener at localhost/36187] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-02-20 18:54:48,935 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,33065,1708455285736 2024-02-20 18:54:48,935 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-02-20 18:54:48,938 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52318, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-02-20 18:54:48,944 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:quota,,1708455288534.37a6e0e80f56b427adb85b885a01934e. 2024-02-20 18:54:48,945 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 37a6e0e80f56b427adb85b885a01934e, NAME => 'hbase:quota,,1708455288534.37a6e0e80f56b427adb85b885a01934e.', STARTKEY => '', ENDKEY => ''} 2024-02-20 18:54:48,945 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table quota 37a6e0e80f56b427adb85b885a01934e 2024-02-20 18:54:48,945 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:quota,,1708455288534.37a6e0e80f56b427adb85b885a01934e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-20 18:54:48,945 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 37a6e0e80f56b427adb85b885a01934e 2024-02-20 18:54:48,945 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 37a6e0e80f56b427adb85b885a01934e 2024-02-20 18:54:48,947 INFO [StoreOpener-37a6e0e80f56b427adb85b885a01934e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family q of region 37a6e0e80f56b427adb85b885a01934e 2024-02-20 18:54:48,950 DEBUG [StoreOpener-37a6e0e80f56b427adb85b885a01934e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/quota/37a6e0e80f56b427adb85b885a01934e/q 2024-02-20 18:54:48,950 DEBUG [StoreOpener-37a6e0e80f56b427adb85b885a01934e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/quota/37a6e0e80f56b427adb85b885a01934e/q 2024-02-20 18:54:48,951 INFO [StoreOpener-37a6e0e80f56b427adb85b885a01934e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 37a6e0e80f56b427adb85b885a01934e columnFamilyName q 2024-02-20 18:54:48,952 INFO [StoreOpener-37a6e0e80f56b427adb85b885a01934e-1] regionserver.HStore(310): Store=37a6e0e80f56b427adb85b885a01934e/q, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-20 18:54:48,952 INFO [StoreOpener-37a6e0e80f56b427adb85b885a01934e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family u of region 37a6e0e80f56b427adb85b885a01934e 2024-02-20 18:54:48,954 DEBUG [StoreOpener-37a6e0e80f56b427adb85b885a01934e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/quota/37a6e0e80f56b427adb85b885a01934e/u 2024-02-20 18:54:48,954 DEBUG [StoreOpener-37a6e0e80f56b427adb85b885a01934e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/quota/37a6e0e80f56b427adb85b885a01934e/u 2024-02-20 18:54:48,955 INFO [StoreOpener-37a6e0e80f56b427adb85b885a01934e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 37a6e0e80f56b427adb85b885a01934e columnFamilyName u 2024-02-20 18:54:48,955 INFO [StoreOpener-37a6e0e80f56b427adb85b885a01934e-1] regionserver.HStore(310): Store=37a6e0e80f56b427adb85b885a01934e/u, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-20 18:54:48,957 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/quota/37a6e0e80f56b427adb85b885a01934e 2024-02-20 18:54:48,958 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/quota/37a6e0e80f56b427adb85b885a01934e 2024-02-20 18:54:48,962 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:quota descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2024-02-20 18:54:48,963 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 37a6e0e80f56b427adb85b885a01934e 2024-02-20 18:54:48,967 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/quota/37a6e0e80f56b427adb85b885a01934e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-20 18:54:48,968 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 37a6e0e80f56b427adb85b885a01934e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58838903, jitterRate=-0.12323202192783356}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2024-02-20 18:54:48,968 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 37a6e0e80f56b427adb85b885a01934e: 2024-02-20 18:54:48,970 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:quota,,1708455288534.37a6e0e80f56b427adb85b885a01934e., pid=11, masterSystemTime=1708455288935 2024-02-20 18:54:48,973 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:quota,,1708455288534.37a6e0e80f56b427adb85b885a01934e. 2024-02-20 18:54:48,974 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:quota,,1708455288534.37a6e0e80f56b427adb85b885a01934e. 2024-02-20 18:54:48,975 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=37a6e0e80f56b427adb85b885a01934e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33065,1708455285736 2024-02-20 18:54:48,975 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:quota,,1708455288534.37a6e0e80f56b427adb85b885a01934e.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1708455288975"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1708455288975"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1708455288975"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1708455288975"}]},"ts":"1708455288975"} 2024-02-20 18:54:48,982 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=11, resume processing ppid=10 2024-02-20 18:54:48,983 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 37a6e0e80f56b427adb85b885a01934e, server=jenkins-hbase4.apache.org,33065,1708455285736 in 197 msec 2024-02-20 18:54:48,986 DEBUG [Listener at localhost/36187] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-02-20 18:54:48,988 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=10, resume processing ppid=9 2024-02-20 18:54:48,988 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:quota, region=37a6e0e80f56b427adb85b885a01934e, ASSIGN in 360 msec 2024-02-20 18:54:48,989 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-02-20 18:54:48,989 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708455288989"}]},"ts":"1708455288989"} 2024-02-20 18:54:48,991 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLED in hbase:meta 2024-02-20 18:54:48,995 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_POST_OPERATION 2024-02-20 18:54:48,998 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:quota in 461 msec 2024-02-20 18:54:49,100 DEBUG [Listener at localhost/36187] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-02-20 18:54:49,104 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47260, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2024-02-20 18:54:49,119 DEBUG [hconnection-0x3bd00b95-shared-pool-3] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-02-20 18:54:49,123 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52332, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-02-20 18:54:49,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-02-20 18:54:49,140 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] procedure2.ProcedureExecutor(1075): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin0 2024-02-20 18:54:49,142 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_PRE_OPERATION 2024-02-20 18:54:49,144 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-02-20 18:54:49,147 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/default/TestQuotaAdmin0/82e64f94bac772699b7195bba7790e7d 2024-02-20 18:54:49,147 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin0" procId is: 12 2024-02-20 18:54:49,148 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/default/TestQuotaAdmin0/82e64f94bac772699b7195bba7790e7d empty. 2024-02-20 18:54:49,149 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/default/TestQuotaAdmin0/82e64f94bac772699b7195bba7790e7d 2024-02-20 18:54:49,149 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-02-20 18:54:49,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-02-20 18:54:49,172 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/default/TestQuotaAdmin0/.tabledesc/.tableinfo.0000000001 2024-02-20 18:54:49,173 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(7675): creating {ENCODED => 82e64f94bac772699b7195bba7790e7d, NAME => 'TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp 2024-02-20 18:54:49,190 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-20 18:54:49,190 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1604): Closing 82e64f94bac772699b7195bba7790e7d, disabling compactions & flushes 2024-02-20 18:54:49,191 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d. 2024-02-20 18:54:49,191 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d. 2024-02-20 18:54:49,191 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d. after waiting 0 ms 2024-02-20 18:54:49,191 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d. 2024-02-20 18:54:49,191 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d. 2024-02-20 18:54:49,191 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1558): Region close journal for 82e64f94bac772699b7195bba7790e7d: 2024-02-20 18:54:49,195 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ADD_TO_META 2024-02-20 18:54:49,197 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708455289197"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1708455289197"}]},"ts":"1708455289197"} 2024-02-20 18:54:49,200 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-02-20 18:54:49,201 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-02-20 18:54:49,202 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708455289201"}]},"ts":"1708455289201"} 2024-02-20 18:54:49,204 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLING in hbase:meta 2024-02-20 18:54:49,208 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-02-20 18:54:49,209 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-02-20 18:54:49,209 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-02-20 18:54:49,210 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-02-20 18:54:49,210 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=82e64f94bac772699b7195bba7790e7d, ASSIGN}] 2024-02-20 18:54:49,212 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=82e64f94bac772699b7195bba7790e7d, ASSIGN 2024-02-20 18:54:49,213 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin0, region=82e64f94bac772699b7195bba7790e7d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38947,1708455285785; forceNewPlan=false, retain=false 2024-02-20 18:54:49,364 INFO [jenkins-hbase4:36731] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-02-20 18:54:49,365 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=82e64f94bac772699b7195bba7790e7d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38947,1708455285785 2024-02-20 18:54:49,365 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708455289365"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1708455289365"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1708455289365"}]},"ts":"1708455289365"} 2024-02-20 18:54:49,368 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; OpenRegionProcedure 82e64f94bac772699b7195bba7790e7d, server=jenkins-hbase4.apache.org,38947,1708455285785}] 2024-02-20 18:54:49,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-02-20 18:54:49,522 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38947,1708455285785 2024-02-20 18:54:49,529 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d. 2024-02-20 18:54:49,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 82e64f94bac772699b7195bba7790e7d, NAME => 'TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d.', STARTKEY => '', ENDKEY => ''} 2024-02-20 18:54:49,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin0 82e64f94bac772699b7195bba7790e7d 2024-02-20 18:54:49,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-20 18:54:49,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 82e64f94bac772699b7195bba7790e7d 2024-02-20 18:54:49,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 82e64f94bac772699b7195bba7790e7d 2024-02-20 18:54:49,532 INFO [StoreOpener-82e64f94bac772699b7195bba7790e7d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 82e64f94bac772699b7195bba7790e7d 2024-02-20 18:54:49,534 DEBUG [StoreOpener-82e64f94bac772699b7195bba7790e7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/default/TestQuotaAdmin0/82e64f94bac772699b7195bba7790e7d/cf 2024-02-20 18:54:49,535 DEBUG [StoreOpener-82e64f94bac772699b7195bba7790e7d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/default/TestQuotaAdmin0/82e64f94bac772699b7195bba7790e7d/cf 2024-02-20 18:54:49,535 INFO [StoreOpener-82e64f94bac772699b7195bba7790e7d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 82e64f94bac772699b7195bba7790e7d columnFamilyName cf 2024-02-20 18:54:49,536 INFO [StoreOpener-82e64f94bac772699b7195bba7790e7d-1] regionserver.HStore(310): Store=82e64f94bac772699b7195bba7790e7d/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-20 18:54:49,540 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/default/TestQuotaAdmin0/82e64f94bac772699b7195bba7790e7d 2024-02-20 18:54:49,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/default/TestQuotaAdmin0/82e64f94bac772699b7195bba7790e7d 2024-02-20 18:54:49,547 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 82e64f94bac772699b7195bba7790e7d 2024-02-20 18:54:49,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/default/TestQuotaAdmin0/82e64f94bac772699b7195bba7790e7d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-20 18:54:49,552 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 82e64f94bac772699b7195bba7790e7d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61522810, jitterRate=-0.08323869109153748}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-02-20 18:54:49,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 82e64f94bac772699b7195bba7790e7d: 2024-02-20 18:54:49,554 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d., pid=14, masterSystemTime=1708455289522 2024-02-20 18:54:49,557 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d. 2024-02-20 18:54:49,557 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d. 2024-02-20 18:54:49,558 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=82e64f94bac772699b7195bba7790e7d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38947,1708455285785 2024-02-20 18:54:49,558 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708455289558"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1708455289558"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1708455289558"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1708455289558"}]},"ts":"1708455289558"} 2024-02-20 18:54:49,565 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=14, resume processing ppid=13 2024-02-20 18:54:49,565 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=14, ppid=13, state=SUCCESS; OpenRegionProcedure 82e64f94bac772699b7195bba7790e7d, server=jenkins-hbase4.apache.org,38947,1708455285785 in 193 msec 2024-02-20 18:54:49,568 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=13, resume processing ppid=12 2024-02-20 18:54:49,569 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=82e64f94bac772699b7195bba7790e7d, ASSIGN in 355 msec 2024-02-20 18:54:49,570 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-02-20 18:54:49,570 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708455289570"}]},"ts":"1708455289570"} 2024-02-20 18:54:49,573 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLED in hbase:meta 2024-02-20 18:54:49,577 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_POST_OPERATION 2024-02-20 18:54:49,580 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=12, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin0 in 439 msec 2024-02-20 18:54:49,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-02-20 18:54:49,914 INFO [Listener at localhost/36187] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin0, procId: 12 completed 2024-02-20 18:54:49,914 DEBUG [Listener at localhost/36187] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin0 get assigned. Timeout = 60000ms 2024-02-20 18:54:49,915 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:54:49,919 INFO [Listener at localhost/36187] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin0 assigned to meta. Checking AM states. 2024-02-20 18:54:49,920 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:54:49,920 INFO [Listener at localhost/36187] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin0 assigned. 2024-02-20 18:54:49,921 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:54:49,936 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-02-20 18:54:49,939 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47266, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=MasterService 2024-02-20 18:54:49,941 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-02-20 18:54:49,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] procedure2.ProcedureExecutor(1075): Stored pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin1 2024-02-20 18:54:49,945 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_PRE_OPERATION 2024-02-20 18:54:49,946 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin1" procId is: 15 2024-02-20 18:54:49,947 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-02-20 18:54:49,947 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-02-20 18:54:49,950 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/default/TestQuotaAdmin1/8b82563ddfbe8b9c5e97a1912c043b43 2024-02-20 18:54:49,951 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/default/TestQuotaAdmin1/8b82563ddfbe8b9c5e97a1912c043b43 empty. 2024-02-20 18:54:49,952 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/default/TestQuotaAdmin1/8b82563ddfbe8b9c5e97a1912c043b43 2024-02-20 18:54:49,952 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-02-20 18:54:49,982 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/default/TestQuotaAdmin1/.tabledesc/.tableinfo.0000000001 2024-02-20 18:54:49,984 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 8b82563ddfbe8b9c5e97a1912c043b43, NAME => 'TestQuotaAdmin1,,1708455289940.8b82563ddfbe8b9c5e97a1912c043b43.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp 2024-02-20 18:54:49,990 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-02-20 18:54:49,992 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52338, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2024-02-20 18:54:50,003 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1708455289940.8b82563ddfbe8b9c5e97a1912c043b43.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-20 18:54:50,004 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1604): Closing 8b82563ddfbe8b9c5e97a1912c043b43, disabling compactions & flushes 2024-02-20 18:54:50,004 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1708455289940.8b82563ddfbe8b9c5e97a1912c043b43. 2024-02-20 18:54:50,004 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1708455289940.8b82563ddfbe8b9c5e97a1912c043b43. 2024-02-20 18:54:50,004 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1708455289940.8b82563ddfbe8b9c5e97a1912c043b43. after waiting 0 ms 2024-02-20 18:54:50,004 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1708455289940.8b82563ddfbe8b9c5e97a1912c043b43. 2024-02-20 18:54:50,004 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1708455289940.8b82563ddfbe8b9c5e97a1912c043b43. 2024-02-20 18:54:50,004 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1558): Region close journal for 8b82563ddfbe8b9c5e97a1912c043b43: 2024-02-20 18:54:50,009 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ADD_TO_META 2024-02-20 18:54:50,011 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1708455289940.8b82563ddfbe8b9c5e97a1912c043b43.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708455290011"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1708455290011"}]},"ts":"1708455290011"} 2024-02-20 18:54:50,014 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-02-20 18:54:50,015 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-02-20 18:54:50,015 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708455290015"}]},"ts":"1708455290015"} 2024-02-20 18:54:50,018 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLING in hbase:meta 2024-02-20 18:54:50,023 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-02-20 18:54:50,024 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-02-20 18:54:50,024 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-02-20 18:54:50,024 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-02-20 18:54:50,025 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=8b82563ddfbe8b9c5e97a1912c043b43, ASSIGN}] 2024-02-20 18:54:50,027 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=8b82563ddfbe8b9c5e97a1912c043b43, ASSIGN 2024-02-20 18:54:50,028 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin1, region=8b82563ddfbe8b9c5e97a1912c043b43, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38947,1708455285785; forceNewPlan=false, retain=false 2024-02-20 18:54:50,178 INFO [jenkins-hbase4:36731] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-02-20 18:54:50,179 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=8b82563ddfbe8b9c5e97a1912c043b43, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38947,1708455285785 2024-02-20 18:54:50,180 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1708455289940.8b82563ddfbe8b9c5e97a1912c043b43.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708455290179"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1708455290179"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1708455290179"}]},"ts":"1708455290179"} 2024-02-20 18:54:50,183 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure 8b82563ddfbe8b9c5e97a1912c043b43, server=jenkins-hbase4.apache.org,38947,1708455285785}] 2024-02-20 18:54:50,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-02-20 18:54:50,336 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38947,1708455285785 2024-02-20 18:54:50,343 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin1,,1708455289940.8b82563ddfbe8b9c5e97a1912c043b43. 2024-02-20 18:54:50,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 8b82563ddfbe8b9c5e97a1912c043b43, NAME => 'TestQuotaAdmin1,,1708455289940.8b82563ddfbe8b9c5e97a1912c043b43.', STARTKEY => '', ENDKEY => ''} 2024-02-20 18:54:50,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin1 8b82563ddfbe8b9c5e97a1912c043b43 2024-02-20 18:54:50,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1708455289940.8b82563ddfbe8b9c5e97a1912c043b43.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-20 18:54:50,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 8b82563ddfbe8b9c5e97a1912c043b43 2024-02-20 18:54:50,343 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 8b82563ddfbe8b9c5e97a1912c043b43 2024-02-20 18:54:50,345 INFO [StoreOpener-8b82563ddfbe8b9c5e97a1912c043b43-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 8b82563ddfbe8b9c5e97a1912c043b43 2024-02-20 18:54:50,348 DEBUG [StoreOpener-8b82563ddfbe8b9c5e97a1912c043b43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/default/TestQuotaAdmin1/8b82563ddfbe8b9c5e97a1912c043b43/cf 2024-02-20 18:54:50,348 DEBUG [StoreOpener-8b82563ddfbe8b9c5e97a1912c043b43-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/default/TestQuotaAdmin1/8b82563ddfbe8b9c5e97a1912c043b43/cf 2024-02-20 18:54:50,348 INFO [StoreOpener-8b82563ddfbe8b9c5e97a1912c043b43-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 8b82563ddfbe8b9c5e97a1912c043b43 columnFamilyName cf 2024-02-20 18:54:50,349 INFO [StoreOpener-8b82563ddfbe8b9c5e97a1912c043b43-1] regionserver.HStore(310): Store=8b82563ddfbe8b9c5e97a1912c043b43/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-20 18:54:50,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/default/TestQuotaAdmin1/8b82563ddfbe8b9c5e97a1912c043b43 2024-02-20 18:54:50,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/default/TestQuotaAdmin1/8b82563ddfbe8b9c5e97a1912c043b43 2024-02-20 18:54:50,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 8b82563ddfbe8b9c5e97a1912c043b43 2024-02-20 18:54:50,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/default/TestQuotaAdmin1/8b82563ddfbe8b9c5e97a1912c043b43/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-20 18:54:50,364 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 8b82563ddfbe8b9c5e97a1912c043b43; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66134958, jitterRate=-0.014512330293655396}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-02-20 18:54:50,364 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 8b82563ddfbe8b9c5e97a1912c043b43: 2024-02-20 18:54:50,366 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin1,,1708455289940.8b82563ddfbe8b9c5e97a1912c043b43., pid=17, masterSystemTime=1708455290336 2024-02-20 18:54:50,368 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin1,,1708455289940.8b82563ddfbe8b9c5e97a1912c043b43. 2024-02-20 18:54:50,368 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin1,,1708455289940.8b82563ddfbe8b9c5e97a1912c043b43. 2024-02-20 18:54:50,369 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=8b82563ddfbe8b9c5e97a1912c043b43, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38947,1708455285785 2024-02-20 18:54:50,369 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin1,,1708455289940.8b82563ddfbe8b9c5e97a1912c043b43.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708455290369"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1708455290369"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1708455290369"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1708455290369"}]},"ts":"1708455290369"} 2024-02-20 18:54:50,375 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=17, resume processing ppid=16 2024-02-20 18:54:50,375 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure 8b82563ddfbe8b9c5e97a1912c043b43, server=jenkins-hbase4.apache.org,38947,1708455285785 in 189 msec 2024-02-20 18:54:50,378 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=16, resume processing ppid=15 2024-02-20 18:54:50,378 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=8b82563ddfbe8b9c5e97a1912c043b43, ASSIGN in 350 msec 2024-02-20 18:54:50,379 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-02-20 18:54:50,380 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708455290380"}]},"ts":"1708455290380"} 2024-02-20 18:54:50,382 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLED in hbase:meta 2024-02-20 18:54:50,385 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_POST_OPERATION 2024-02-20 18:54:50,387 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=15, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin1 in 444 msec 2024-02-20 18:54:50,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-02-20 18:54:50,702 INFO [Listener at localhost/36187] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin1, procId: 15 completed 2024-02-20 18:54:50,702 DEBUG [Listener at localhost/36187] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin1 get assigned. Timeout = 60000ms 2024-02-20 18:54:50,702 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:54:50,705 INFO [Listener at localhost/36187] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin1 assigned to meta. Checking AM states. 2024-02-20 18:54:50,706 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:54:50,706 INFO [Listener at localhost/36187] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin1 assigned. 2024-02-20 18:54:50,706 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:54:50,718 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-02-20 18:54:50,720 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] procedure2.ProcedureExecutor(1075): Stored pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin2 2024-02-20 18:54:50,722 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_PRE_OPERATION 2024-02-20 18:54:50,722 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin2" procId is: 18 2024-02-20 18:54:50,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-02-20 18:54:50,724 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-02-20 18:54:50,726 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/default/TestQuotaAdmin2/51a58db2ce73e1af862393164b91790a 2024-02-20 18:54:50,727 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/default/TestQuotaAdmin2/51a58db2ce73e1af862393164b91790a empty. 2024-02-20 18:54:50,728 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/default/TestQuotaAdmin2/51a58db2ce73e1af862393164b91790a 2024-02-20 18:54:50,728 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-02-20 18:54:50,751 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/default/TestQuotaAdmin2/.tabledesc/.tableinfo.0000000001 2024-02-20 18:54:50,754 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(7675): creating {ENCODED => 51a58db2ce73e1af862393164b91790a, NAME => 'TestQuotaAdmin2,,1708455290718.51a58db2ce73e1af862393164b91790a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp 2024-02-20 18:54:50,771 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1708455290718.51a58db2ce73e1af862393164b91790a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-20 18:54:50,771 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1604): Closing 51a58db2ce73e1af862393164b91790a, disabling compactions & flushes 2024-02-20 18:54:50,772 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1708455290718.51a58db2ce73e1af862393164b91790a. 2024-02-20 18:54:50,772 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1708455290718.51a58db2ce73e1af862393164b91790a. 2024-02-20 18:54:50,772 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1708455290718.51a58db2ce73e1af862393164b91790a. after waiting 0 ms 2024-02-20 18:54:50,772 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1708455290718.51a58db2ce73e1af862393164b91790a. 2024-02-20 18:54:50,772 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1708455290718.51a58db2ce73e1af862393164b91790a. 2024-02-20 18:54:50,772 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1558): Region close journal for 51a58db2ce73e1af862393164b91790a: 2024-02-20 18:54:50,776 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ADD_TO_META 2024-02-20 18:54:50,778 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1708455290718.51a58db2ce73e1af862393164b91790a.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708455290778"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1708455290778"}]},"ts":"1708455290778"} 2024-02-20 18:54:50,781 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-02-20 18:54:50,782 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-02-20 18:54:50,782 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708455290782"}]},"ts":"1708455290782"} 2024-02-20 18:54:50,784 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLING in hbase:meta 2024-02-20 18:54:50,790 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-02-20 18:54:50,791 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-02-20 18:54:50,791 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-02-20 18:54:50,791 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-02-20 18:54:50,791 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=51a58db2ce73e1af862393164b91790a, ASSIGN}] 2024-02-20 18:54:50,793 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=51a58db2ce73e1af862393164b91790a, ASSIGN 2024-02-20 18:54:50,794 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin2, region=51a58db2ce73e1af862393164b91790a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33065,1708455285736; forceNewPlan=false, retain=false 2024-02-20 18:54:50,945 INFO [jenkins-hbase4:36731] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-02-20 18:54:50,946 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=51a58db2ce73e1af862393164b91790a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33065,1708455285736 2024-02-20 18:54:50,946 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1708455290718.51a58db2ce73e1af862393164b91790a.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708455290946"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1708455290946"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1708455290946"}]},"ts":"1708455290946"} 2024-02-20 18:54:50,949 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE; OpenRegionProcedure 51a58db2ce73e1af862393164b91790a, server=jenkins-hbase4.apache.org,33065,1708455285736}] 2024-02-20 18:54:50,975 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-02-20 18:54:51,102 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,33065,1708455285736 2024-02-20 18:54:51,108 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin2,,1708455290718.51a58db2ce73e1af862393164b91790a. 2024-02-20 18:54:51,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 51a58db2ce73e1af862393164b91790a, NAME => 'TestQuotaAdmin2,,1708455290718.51a58db2ce73e1af862393164b91790a.', STARTKEY => '', ENDKEY => ''} 2024-02-20 18:54:51,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin2 51a58db2ce73e1af862393164b91790a 2024-02-20 18:54:51,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1708455290718.51a58db2ce73e1af862393164b91790a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-20 18:54:51,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 51a58db2ce73e1af862393164b91790a 2024-02-20 18:54:51,109 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 51a58db2ce73e1af862393164b91790a 2024-02-20 18:54:51,111 INFO [StoreOpener-51a58db2ce73e1af862393164b91790a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 51a58db2ce73e1af862393164b91790a 2024-02-20 18:54:51,114 DEBUG [StoreOpener-51a58db2ce73e1af862393164b91790a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/default/TestQuotaAdmin2/51a58db2ce73e1af862393164b91790a/cf 2024-02-20 18:54:51,114 DEBUG [StoreOpener-51a58db2ce73e1af862393164b91790a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/default/TestQuotaAdmin2/51a58db2ce73e1af862393164b91790a/cf 2024-02-20 18:54:51,115 INFO [StoreOpener-51a58db2ce73e1af862393164b91790a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 51a58db2ce73e1af862393164b91790a columnFamilyName cf 2024-02-20 18:54:51,115 INFO [StoreOpener-51a58db2ce73e1af862393164b91790a-1] regionserver.HStore(310): Store=51a58db2ce73e1af862393164b91790a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-20 18:54:51,117 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/default/TestQuotaAdmin2/51a58db2ce73e1af862393164b91790a 2024-02-20 18:54:51,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/default/TestQuotaAdmin2/51a58db2ce73e1af862393164b91790a 2024-02-20 18:54:51,124 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 51a58db2ce73e1af862393164b91790a 2024-02-20 18:54:51,127 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/default/TestQuotaAdmin2/51a58db2ce73e1af862393164b91790a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-20 18:54:51,128 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 51a58db2ce73e1af862393164b91790a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67168976, jitterRate=8.957386016845703E-4}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-02-20 18:54:51,128 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 51a58db2ce73e1af862393164b91790a: 2024-02-20 18:54:51,129 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin2,,1708455290718.51a58db2ce73e1af862393164b91790a., pid=20, masterSystemTime=1708455291102 2024-02-20 18:54:51,132 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin2,,1708455290718.51a58db2ce73e1af862393164b91790a. 2024-02-20 18:54:51,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin2,,1708455290718.51a58db2ce73e1af862393164b91790a. 2024-02-20 18:54:51,133 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=51a58db2ce73e1af862393164b91790a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33065,1708455285736 2024-02-20 18:54:51,133 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin2,,1708455290718.51a58db2ce73e1af862393164b91790a.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708455291133"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1708455291133"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1708455291133"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1708455291133"}]},"ts":"1708455291133"} 2024-02-20 18:54:51,139 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=20, resume processing ppid=19 2024-02-20 18:54:51,139 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=20, ppid=19, state=SUCCESS; OpenRegionProcedure 51a58db2ce73e1af862393164b91790a, server=jenkins-hbase4.apache.org,33065,1708455285736 in 187 msec 2024-02-20 18:54:51,142 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=19, resume processing ppid=18 2024-02-20 18:54:51,143 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=19, ppid=18, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=51a58db2ce73e1af862393164b91790a, ASSIGN in 348 msec 2024-02-20 18:54:51,144 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-02-20 18:54:51,144 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708455291144"}]},"ts":"1708455291144"} 2024-02-20 18:54:51,146 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLED in hbase:meta 2024-02-20 18:54:51,150 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_POST_OPERATION 2024-02-20 18:54:51,152 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=18, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin2 in 432 msec 2024-02-20 18:54:51,477 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-02-20 18:54:51,478 INFO [Listener at localhost/36187] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin2, procId: 18 completed 2024-02-20 18:54:51,478 DEBUG [Listener at localhost/36187] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin2 get assigned. Timeout = 60000ms 2024-02-20 18:54:51,478 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:54:51,482 INFO [Listener at localhost/36187] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin2 assigned to meta. Checking AM states. 2024-02-20 18:54:51,482 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:54:51,482 INFO [Listener at localhost/36187] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin2 assigned. 2024-02-20 18:54:51,482 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:54:51,492 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-02-20 18:54:51,497 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47270, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService 2024-02-20 18:54:51,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.HMaster$15(3020): Client=jenkins//172.31.14.131 creating {NAME => 'TestNs'} 2024-02-20 18:54:51,503 DEBUG [hconnection-0x31ea37aa-metaLookup-shared--pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-02-20 18:54:51,506 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47412, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2024-02-20 18:54:51,506 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] procedure2.ProcedureExecutor(1075): Stored pid=21, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=TestNs 2024-02-20 18:54:51,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-02-20 18:54:51,521 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-02-20 18:54:51,526 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=21, state=SUCCESS; CreateNamespaceProcedure, namespace=TestNs in 22 msec 2024-02-20 18:54:51,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-02-20 18:54:51,769 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-02-20 18:54:51,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] procedure2.ProcedureExecutor(1075): Stored pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestNs:TestTable 2024-02-20 18:54:51,774 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_PRE_OPERATION 2024-02-20 18:54:51,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "TestNs" qualifier: "TestTable" procId is: 22 2024-02-20 18:54:51,775 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-02-20 18:54:51,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-02-20 18:54:51,779 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/TestNs/TestTable/dd8b20d7562c2a270ea5be09b22c2a55 2024-02-20 18:54:51,779 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/TestNs/TestTable/e226b379223e6b8046292613eecc95b6 2024-02-20 18:54:51,780 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/TestNs/TestTable/e226b379223e6b8046292613eecc95b6 empty. 2024-02-20 18:54:51,780 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/TestNs/TestTable/dd8b20d7562c2a270ea5be09b22c2a55 empty. 2024-02-20 18:54:51,781 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/TestNs/TestTable/e226b379223e6b8046292613eecc95b6 2024-02-20 18:54:51,781 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/TestNs/TestTable/dd8b20d7562c2a270ea5be09b22c2a55 2024-02-20 18:54:51,781 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-02-20 18:54:51,800 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/TestNs/TestTable/.tabledesc/.tableinfo.0000000001 2024-02-20 18:54:51,802 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(7675): creating {ENCODED => dd8b20d7562c2a270ea5be09b22c2a55, NAME => 'TestNs:TestTable,,1708455291769.dd8b20d7562c2a270ea5be09b22c2a55.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp 2024-02-20 18:54:51,802 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(7675): creating {ENCODED => e226b379223e6b8046292613eecc95b6, NAME => 'TestNs:TestTable,1,1708455291769.e226b379223e6b8046292613eecc95b6.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp 2024-02-20 18:54:51,826 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1708455291769.e226b379223e6b8046292613eecc95b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-20 18:54:51,826 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1604): Closing e226b379223e6b8046292613eecc95b6, disabling compactions & flushes 2024-02-20 18:54:51,826 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1708455291769.e226b379223e6b8046292613eecc95b6. 2024-02-20 18:54:51,826 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1708455291769.e226b379223e6b8046292613eecc95b6. 2024-02-20 18:54:51,826 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1708455291769.e226b379223e6b8046292613eecc95b6. after waiting 0 ms 2024-02-20 18:54:51,826 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1708455291769.e226b379223e6b8046292613eecc95b6. 2024-02-20 18:54:51,826 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1708455291769.e226b379223e6b8046292613eecc95b6. 2024-02-20 18:54:51,826 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1558): Region close journal for e226b379223e6b8046292613eecc95b6: 2024-02-20 18:54:51,827 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1708455291769.dd8b20d7562c2a270ea5be09b22c2a55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-20 18:54:51,827 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1604): Closing dd8b20d7562c2a270ea5be09b22c2a55, disabling compactions & flushes 2024-02-20 18:54:51,827 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1708455291769.dd8b20d7562c2a270ea5be09b22c2a55. 2024-02-20 18:54:51,827 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1708455291769.dd8b20d7562c2a270ea5be09b22c2a55. 2024-02-20 18:54:51,827 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1708455291769.dd8b20d7562c2a270ea5be09b22c2a55. after waiting 0 ms 2024-02-20 18:54:51,827 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1708455291769.dd8b20d7562c2a270ea5be09b22c2a55. 2024-02-20 18:54:51,827 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1708455291769.dd8b20d7562c2a270ea5be09b22c2a55. 2024-02-20 18:54:51,827 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1558): Region close journal for dd8b20d7562c2a270ea5be09b22c2a55: 2024-02-20 18:54:51,831 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ADD_TO_META 2024-02-20 18:54:51,833 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1708455291769.e226b379223e6b8046292613eecc95b6.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1708455291833"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1708455291833"}]},"ts":"1708455291833"} 2024-02-20 18:54:51,833 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,,1708455291769.dd8b20d7562c2a270ea5be09b22c2a55.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1708455291833"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1708455291833"}]},"ts":"1708455291833"} 2024-02-20 18:54:51,837 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2024-02-20 18:54:51,839 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-02-20 18:54:51,839 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708455291839"}]},"ts":"1708455291839"} 2024-02-20 18:54:51,845 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLING in hbase:meta 2024-02-20 18:54:51,850 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-02-20 18:54:51,852 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-02-20 18:54:51,852 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-02-20 18:54:51,852 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-02-20 18:54:51,852 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=dd8b20d7562c2a270ea5be09b22c2a55, ASSIGN}, {pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=e226b379223e6b8046292613eecc95b6, ASSIGN}] 2024-02-20 18:54:51,854 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=e226b379223e6b8046292613eecc95b6, ASSIGN 2024-02-20 18:54:51,854 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=dd8b20d7562c2a270ea5be09b22c2a55, ASSIGN 2024-02-20 18:54:51,856 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=e226b379223e6b8046292613eecc95b6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38947,1708455285785; forceNewPlan=false, retain=false 2024-02-20 18:54:51,856 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=dd8b20d7562c2a270ea5be09b22c2a55, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33065,1708455285736; forceNewPlan=false, retain=false 2024-02-20 18:54:52,006 INFO [jenkins-hbase4:36731] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2024-02-20 18:54:52,007 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=e226b379223e6b8046292613eecc95b6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38947,1708455285785 2024-02-20 18:54:52,007 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=dd8b20d7562c2a270ea5be09b22c2a55, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33065,1708455285736 2024-02-20 18:54:52,008 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1708455291769.dd8b20d7562c2a270ea5be09b22c2a55.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1708455292007"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1708455292007"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1708455292007"}]},"ts":"1708455292007"} 2024-02-20 18:54:52,008 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1708455291769.e226b379223e6b8046292613eecc95b6.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1708455292007"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1708455292007"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1708455292007"}]},"ts":"1708455292007"} 2024-02-20 18:54:52,011 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure e226b379223e6b8046292613eecc95b6, server=jenkins-hbase4.apache.org,38947,1708455285785}] 2024-02-20 18:54:52,013 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=26, ppid=23, state=RUNNABLE; OpenRegionProcedure dd8b20d7562c2a270ea5be09b22c2a55, server=jenkins-hbase4.apache.org,33065,1708455285736}] 2024-02-20 18:54:52,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-02-20 18:54:52,164 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38947,1708455285785 2024-02-20 18:54:52,166 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,33065,1708455285736 2024-02-20 18:54:52,170 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,1,1708455291769.e226b379223e6b8046292613eecc95b6. 2024-02-20 18:54:52,170 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => e226b379223e6b8046292613eecc95b6, NAME => 'TestNs:TestTable,1,1708455291769.e226b379223e6b8046292613eecc95b6.', STARTKEY => '1', ENDKEY => ''} 2024-02-20 18:54:52,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable e226b379223e6b8046292613eecc95b6 2024-02-20 18:54:52,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1708455291769.e226b379223e6b8046292613eecc95b6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-20 18:54:52,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for e226b379223e6b8046292613eecc95b6 2024-02-20 18:54:52,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for e226b379223e6b8046292613eecc95b6 2024-02-20 18:54:52,171 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,,1708455291769.dd8b20d7562c2a270ea5be09b22c2a55. 2024-02-20 18:54:52,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dd8b20d7562c2a270ea5be09b22c2a55, NAME => 'TestNs:TestTable,,1708455291769.dd8b20d7562c2a270ea5be09b22c2a55.', STARTKEY => '', ENDKEY => '1'} 2024-02-20 18:54:52,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable dd8b20d7562c2a270ea5be09b22c2a55 2024-02-20 18:54:52,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1708455291769.dd8b20d7562c2a270ea5be09b22c2a55.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-20 18:54:52,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dd8b20d7562c2a270ea5be09b22c2a55 2024-02-20 18:54:52,172 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dd8b20d7562c2a270ea5be09b22c2a55 2024-02-20 18:54:52,173 INFO [StoreOpener-e226b379223e6b8046292613eecc95b6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region e226b379223e6b8046292613eecc95b6 2024-02-20 18:54:52,174 INFO [StoreOpener-dd8b20d7562c2a270ea5be09b22c2a55-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region dd8b20d7562c2a270ea5be09b22c2a55 2024-02-20 18:54:52,175 DEBUG [StoreOpener-e226b379223e6b8046292613eecc95b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/TestNs/TestTable/e226b379223e6b8046292613eecc95b6/cf 2024-02-20 18:54:52,175 DEBUG [StoreOpener-e226b379223e6b8046292613eecc95b6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/TestNs/TestTable/e226b379223e6b8046292613eecc95b6/cf 2024-02-20 18:54:52,176 INFO [StoreOpener-e226b379223e6b8046292613eecc95b6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region e226b379223e6b8046292613eecc95b6 columnFamilyName cf 2024-02-20 18:54:52,177 DEBUG [StoreOpener-dd8b20d7562c2a270ea5be09b22c2a55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/TestNs/TestTable/dd8b20d7562c2a270ea5be09b22c2a55/cf 2024-02-20 18:54:52,177 DEBUG [StoreOpener-dd8b20d7562c2a270ea5be09b22c2a55-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/TestNs/TestTable/dd8b20d7562c2a270ea5be09b22c2a55/cf 2024-02-20 18:54:52,177 INFO [StoreOpener-e226b379223e6b8046292613eecc95b6-1] regionserver.HStore(310): Store=e226b379223e6b8046292613eecc95b6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-20 18:54:52,178 INFO [StoreOpener-dd8b20d7562c2a270ea5be09b22c2a55-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dd8b20d7562c2a270ea5be09b22c2a55 columnFamilyName cf 2024-02-20 18:54:52,179 INFO [StoreOpener-dd8b20d7562c2a270ea5be09b22c2a55-1] regionserver.HStore(310): Store=dd8b20d7562c2a270ea5be09b22c2a55/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-20 18:54:52,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/TestNs/TestTable/e226b379223e6b8046292613eecc95b6 2024-02-20 18:54:52,181 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/TestNs/TestTable/e226b379223e6b8046292613eecc95b6 2024-02-20 18:54:52,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/TestNs/TestTable/dd8b20d7562c2a270ea5be09b22c2a55 2024-02-20 18:54:52,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/TestNs/TestTable/dd8b20d7562c2a270ea5be09b22c2a55 2024-02-20 18:54:52,186 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for e226b379223e6b8046292613eecc95b6 2024-02-20 18:54:52,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dd8b20d7562c2a270ea5be09b22c2a55 2024-02-20 18:54:52,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/TestNs/TestTable/e226b379223e6b8046292613eecc95b6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-20 18:54:52,190 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened e226b379223e6b8046292613eecc95b6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67477755, jitterRate=0.005496904253959656}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-02-20 18:54:52,190 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for e226b379223e6b8046292613eecc95b6: 2024-02-20 18:54:52,192 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestNs:TestTable,1,1708455291769.e226b379223e6b8046292613eecc95b6., pid=25, masterSystemTime=1708455292164 2024-02-20 18:54:52,195 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestNs:TestTable,1,1708455291769.e226b379223e6b8046292613eecc95b6. 2024-02-20 18:54:52,195 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,1,1708455291769.e226b379223e6b8046292613eecc95b6. 2024-02-20 18:54:52,196 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=e226b379223e6b8046292613eecc95b6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38947,1708455285785 2024-02-20 18:54:52,196 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,1,1708455291769.e226b379223e6b8046292613eecc95b6.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1708455292196"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1708455292196"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1708455292196"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1708455292196"}]},"ts":"1708455292196"} 2024-02-20 18:54:52,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/TestNs/TestTable/dd8b20d7562c2a270ea5be09b22c2a55/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-20 18:54:52,198 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dd8b20d7562c2a270ea5be09b22c2a55; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63585460, jitterRate=-0.05250281095504761}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-02-20 18:54:52,198 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dd8b20d7562c2a270ea5be09b22c2a55: 2024-02-20 18:54:52,199 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestNs:TestTable,,1708455291769.dd8b20d7562c2a270ea5be09b22c2a55., pid=26, masterSystemTime=1708455292166 2024-02-20 18:54:52,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestNs:TestTable,,1708455291769.dd8b20d7562c2a270ea5be09b22c2a55. 2024-02-20 18:54:52,202 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,,1708455291769.dd8b20d7562c2a270ea5be09b22c2a55. 2024-02-20 18:54:52,202 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=25, resume processing ppid=24 2024-02-20 18:54:52,203 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=dd8b20d7562c2a270ea5be09b22c2a55, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33065,1708455285736 2024-02-20 18:54:52,203 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,,1708455291769.dd8b20d7562c2a270ea5be09b22c2a55.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1708455292203"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1708455292203"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1708455292203"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1708455292203"}]},"ts":"1708455292203"} 2024-02-20 18:54:52,204 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure e226b379223e6b8046292613eecc95b6, server=jenkins-hbase4.apache.org,38947,1708455285785 in 188 msec 2024-02-20 18:54:52,205 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=24, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=e226b379223e6b8046292613eecc95b6, ASSIGN in 351 msec 2024-02-20 18:54:52,210 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=26, resume processing ppid=23 2024-02-20 18:54:52,210 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=26, ppid=23, state=SUCCESS; OpenRegionProcedure dd8b20d7562c2a270ea5be09b22c2a55, server=jenkins-hbase4.apache.org,33065,1708455285736 in 195 msec 2024-02-20 18:54:52,213 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=23, resume processing ppid=22 2024-02-20 18:54:52,213 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=23, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=dd8b20d7562c2a270ea5be09b22c2a55, ASSIGN in 358 msec 2024-02-20 18:54:52,214 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-02-20 18:54:52,214 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708455292214"}]},"ts":"1708455292214"} 2024-02-20 18:54:52,216 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLED in hbase:meta 2024-02-20 18:54:52,220 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_POST_OPERATION 2024-02-20 18:54:52,222 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=22, state=SUCCESS; CreateTableProcedure table=TestNs:TestTable in 451 msec 2024-02-20 18:54:52,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-02-20 18:54:52,529 INFO [Listener at localhost/36187] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: TestNs:TestTable, procId: 22 completed 2024-02-20 18:54:52,529 DEBUG [Listener at localhost/36187] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestNs:TestTable get assigned. Timeout = 60000ms 2024-02-20 18:54:52,530 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:54:52,534 INFO [Listener at localhost/36187] hbase.HBaseTestingUtility(3484): All regions for table TestNs:TestTable assigned to meta. Checking AM states. 2024-02-20 18:54:52,534 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:54:52,534 INFO [Listener at localhost/36187] hbase.HBaseTestingUtility(3504): All regions for table TestNs:TestTable assigned. 2024-02-20 18:54:52,535 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:54:52,580 INFO [Listener at localhost/36187] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=304, OpenFileDescriptor=632, MaxFileDescriptor=60000, SystemLoadAverage=254, ProcessCount=167, AvailableMemoryMB=10832 2024-02-20 18:54:52,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-02-20 18:54:52,640 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36990, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-02-20 18:54:52,919 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:54:52,920 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-20 18:54:52,920 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708458892668 bypass), TestNs=QuotaState(ts=1708458892668 bypass)} 2024-02-20 18:54:52,920 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1708458892668 bypass), TestQuotaAdmin2=QuotaState(ts=1708458892668 bypass)} 2024-02-20 18:54:52,920 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1708458892668 [ TestNs:TestTable ])} 2024-02-20 18:54:52,920 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708458892668 bypass)} 2024-02-20 18:54:53,159 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2024-02-20 18:54:53,170 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:54:53,171 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-20 18:54:53,171 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708458892668 bypass), TestNs=QuotaState(ts=1708458892668 bypass)} 2024-02-20 18:54:53,171 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1708458892668 bypass), TestNs:TestTable=QuotaState(ts=1708458892668 bypass), TestQuotaAdmin1=QuotaState(ts=1708458892668 bypass)} 2024-02-20 18:54:53,171 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1708458892668 [ TestNs:TestTable ])} 2024-02-20 18:54:53,171 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708458892668 bypass)} 2024-02-20 18:54:53,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:54:53,195 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 90 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:47396 deadline: 1708455303193, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:54:53,223 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestNs:TestTable' 2024-02-20 18:54:53,224 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin2' 2024-02-20 18:54:53,225 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:quota' 2024-02-20 18:54:53,226 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin0' 2024-02-20 18:54:53,226 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2024-02-20 18:54:53,227 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2024-02-20 18:54:53,227 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin1' 2024-02-20 18:54:53,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:54:53,480 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 92 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:47396 deadline: 1708455303194, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:54:53,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:54:53,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 94 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:47396 deadline: 1708455303194, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:54:54,644 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-02-20 18:54:54,644 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver Metrics about HBase MasterObservers 2024-02-20 18:54:54,645 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-02-20 18:54:54,645 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2024-02-20 18:54:54,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:54:54,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 96 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:47396 deadline: 1708455303193, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:54:56,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:54:56,007 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 98 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:47396 deadline: 1708455303194, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:54:58,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:54:58,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 100 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:47396 deadline: 1708455303194, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:54:58,531 ERROR [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10380: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1708455291769.e226b379223e6b8046292613eecc95b6., hostname=jenkins-hbase4.apache.org,38947,1708455285785, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-20 18:54:58,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:54:58,535 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 101 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:47396 deadline: 1708455308534, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:54:58,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:54:58,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 103 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:47396 deadline: 1708455308534, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:54:59,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:54:59,294 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 105 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:47396 deadline: 1708455308534, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:00,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:00,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 107 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:47396 deadline: 1708455308534, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:01,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:01,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 109 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:47396 deadline: 1708455308534, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:03,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:03,826 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 111 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:47396 deadline: 1708455308534, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:03,827 ERROR [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10329: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1708455291769.e226b379223e6b8046292613eecc95b6., hostname=jenkins-hbase4.apache.org,38947,1708455285785, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-20 18:55:04,089 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:55:04,089 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-20 18:55:04,089 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708462492668 bypass), TestNs=QuotaState(ts=1708462492668 bypass)} 2024-02-20 18:55:04,089 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1708462492668 bypass), TestQuotaAdmin2=QuotaState(ts=1708462492668 bypass)} 2024-02-20 18:55:04,089 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1708462492668 bypass)} 2024-02-20 18:55:04,089 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708462492668 bypass)} 2024-02-20 18:55:04,340 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:55:04,340 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-20 18:55:04,340 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708462492668 bypass), TestNs=QuotaState(ts=1708462492668 bypass)} 2024-02-20 18:55:04,340 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1708462492668 bypass), TestNs:TestTable=QuotaState(ts=1708462492668 bypass), TestQuotaAdmin1=QuotaState(ts=1708462492668 bypass)} 2024-02-20 18:55:04,340 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1708462492668 bypass)} 2024-02-20 18:55:04,340 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708462492668 bypass)} 2024-02-20 18:55:04,356 INFO [Listener at localhost/36187] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=289 (was 304), OpenFileDescriptor=603 (was 632), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=220 (was 254), ProcessCount=167 (was 167), AvailableMemoryMB=10771 (was 10832) 2024-02-20 18:55:04,371 INFO [Listener at localhost/36187] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=289, OpenFileDescriptor=603, MaxFileDescriptor=60000, SystemLoadAverage=220, ProcessCount=167, AvailableMemoryMB=10771 2024-02-20 18:55:04,636 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:55:04,636 INFO [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-02-20 18:55:04,886 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-20 18:55:04,887 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708466092768 bypass), TestNs=QuotaState(ts=1708466092768 bypass)} 2024-02-20 18:55:04,888 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1708466092768 bypass), TestQuotaAdmin2=QuotaState(ts=1708466092768 bypass)} 2024-02-20 18:55:04,888 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1708466092768 [ default ])} 2024-02-20 18:55:04,888 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708466092768 bypass)} 2024-02-20 18:55:05,139 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:55:05,139 INFO [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-02-20 18:55:05,389 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-20 18:55:05,390 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708466092868 bypass), TestNs=QuotaState(ts=1708466092868 bypass)} 2024-02-20 18:55:05,392 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1708466092868 bypass), TestNs:TestTable=QuotaState(ts=1708466092868 bypass), TestQuotaAdmin1=QuotaState(ts=1708466092868 bypass)} 2024-02-20 18:55:05,392 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1708466092868 [ default ])} 2024-02-20 18:55:05,392 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708466092868 bypass)} 2024-02-20 18:55:05,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-02-20 18:55:05,401 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 123 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:47396 deadline: 1708455315401, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-02-20 18:55:05,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-02-20 18:55:05,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 125 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:47396 deadline: 1708455315402, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-02-20 18:55:06,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-02-20 18:55:06,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 127 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:47396 deadline: 1708455315401, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-02-20 18:55:06,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-02-20 18:55:06,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 129 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47396 deadline: 1708455315401, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-02-20 18:55:08,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-02-20 18:55:08,181 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 131 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47396 deadline: 1708455315401, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-02-20 18:55:10,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-02-20 18:55:10,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 133 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47396 deadline: 1708455315401, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-02-20 18:55:10,703 ERROR [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10316: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d., hostname=jenkins-hbase4.apache.org,38947,1708455285785, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:199) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-20 18:55:10,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:10,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 140 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47396 deadline: 1708455320718, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:10,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:10,974 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 142 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47396 deadline: 1708455320719, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:11,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:11,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 144 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47396 deadline: 1708455320718, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:12,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:12,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 146 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47396 deadline: 1708455320719, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:13,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:13,502 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 148 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47396 deadline: 1708455320718, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:16,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:16,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 150 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47396 deadline: 1708455320719, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:16,012 ERROR [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10309: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d., hostname=jenkins-hbase4.apache.org,38947,1708455285785, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:200) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-20 18:55:16,270 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:55:16,270 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-20 18:55:16,270 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708469692868 bypass), TestNs=QuotaState(ts=1708469692868 bypass)} 2024-02-20 18:55:16,270 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1708469692868 bypass), TestQuotaAdmin2=QuotaState(ts=1708469692868 bypass)} 2024-02-20 18:55:16,270 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1708469692868 bypass)} 2024-02-20 18:55:16,270 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708469692868 bypass)} 2024-02-20 18:55:16,521 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:55:16,521 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-20 18:55:16,521 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708469692868 bypass), TestNs=QuotaState(ts=1708469692868 bypass)} 2024-02-20 18:55:16,521 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1708469692868 bypass), TestNs:TestTable=QuotaState(ts=1708469692868 bypass), TestQuotaAdmin1=QuotaState(ts=1708469692868 bypass)} 2024-02-20 18:55:16,521 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1708469692868 bypass)} 2024-02-20 18:55:16,521 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708469692868 bypass)} 2024-02-20 18:55:16,535 INFO [Listener at localhost/36187] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=289 (was 289), OpenFileDescriptor=599 (was 603), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=209 (was 220), ProcessCount=167 (was 167), AvailableMemoryMB=10778 (was 10771) - AvailableMemoryMB LEAK? - 2024-02-20 18:55:16,550 INFO [Listener at localhost/36187] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=289, OpenFileDescriptor=599, MaxFileDescriptor=60000, SystemLoadAverage=209, ProcessCount=167, AvailableMemoryMB=10777 2024-02-20 18:55:16,814 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:55:16,815 INFO [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-02-20 18:55:17,065 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-20 18:55:17,066 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708473292968 bypass), TestNs=QuotaState(ts=1708473292968 bypass)} 2024-02-20 18:55:17,067 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1708473292968 bypass), TestQuotaAdmin2=QuotaState(ts=1708473292968 bypass)} 2024-02-20 18:55:17,067 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1708473292968 global-limiter)} 2024-02-20 18:55:17,068 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708473292968 bypass)} 2024-02-20 18:55:17,318 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:55:17,318 INFO [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-02-20 18:55:17,569 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-20 18:55:17,570 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708473293068 bypass), TestNs=QuotaState(ts=1708473293068 bypass)} 2024-02-20 18:55:17,570 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1708473293068 bypass), TestNs:TestTable=QuotaState(ts=1708473293068 bypass), TestQuotaAdmin1=QuotaState(ts=1708473293068 bypass)} 2024-02-20 18:55:17,570 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1708473293068 global-limiter)} 2024-02-20 18:55:17,571 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708473293068 bypass)} 2024-02-20 18:55:17,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:17,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 163 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47396 deadline: 1708455327587, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:17,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:17,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 165 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47396 deadline: 1708455327588, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:18,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:18,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 167 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47396 deadline: 1708455327588, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:19,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:19,109 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 169 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47396 deadline: 1708455327588, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:20,368 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:20,369 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 171 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47396 deadline: 1708455327587, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:22,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:22,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 173 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47396 deadline: 1708455327587, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:22,876 ERROR [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10314: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d., hostname=jenkins-hbase4.apache.org,38947,1708455285785, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:178) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-20 18:55:22,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-02-20 18:55:22,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 177 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47396 deadline: 1708455332884, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-02-20 18:55:23,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-02-20 18:55:23,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 179 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47396 deadline: 1708455332884, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-02-20 18:55:23,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-02-20 18:55:23,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 181 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47396 deadline: 1708455332884, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-02-20 18:55:24,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-02-20 18:55:24,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 183 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47396 deadline: 1708455332884, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-02-20 18:55:25,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-02-20 18:55:25,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 185 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47396 deadline: 1708455332883, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-02-20 18:55:28,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-02-20 18:55:28,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 187 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47396 deadline: 1708455332883, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-02-20 18:55:28,164 ERROR [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=3 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10300: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-3' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d., hostname=jenkins-hbase4.apache.org,38947,1708455285785, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-20 18:55:28,421 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:55:28,421 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-20 18:55:28,421 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708476893068 bypass), TestNs=QuotaState(ts=1708476893068 bypass)} 2024-02-20 18:55:28,421 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1708476893068 bypass), TestQuotaAdmin2=QuotaState(ts=1708476893068 bypass)} 2024-02-20 18:55:28,421 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1708476893068 bypass)} 2024-02-20 18:55:28,421 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708476893068 bypass)} 2024-02-20 18:55:28,671 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:55:28,672 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-20 18:55:28,672 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708476893068 bypass), TestNs=QuotaState(ts=1708476893068 bypass)} 2024-02-20 18:55:28,672 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1708476893068 bypass), TestNs:TestTable=QuotaState(ts=1708476893068 bypass), TestQuotaAdmin1=QuotaState(ts=1708476893068 bypass)} 2024-02-20 18:55:28,672 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1708476893068 bypass)} 2024-02-20 18:55:28,672 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708476893068 bypass)} 2024-02-20 18:55:28,688 INFO [Listener at localhost/36187] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=280 (was 289), OpenFileDescriptor=597 (was 599), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=206 (was 209), ProcessCount=167 (was 167), AvailableMemoryMB=10768 (was 10777) 2024-02-20 18:55:28,701 INFO [Listener at localhost/36187] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=280, OpenFileDescriptor=597, MaxFileDescriptor=60000, SystemLoadAverage=206, ProcessCount=167, AvailableMemoryMB=10768 2024-02-20 18:55:28,959 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:55:28,960 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-20 18:55:28,961 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708480493068 bypass), TestNs=QuotaState(ts=1708480493068 bypass)} 2024-02-20 18:55:28,963 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1708480493068 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin2=QuotaState(ts=1708480493068 bypass)} 2024-02-20 18:55:28,963 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(218): {} 2024-02-20 18:55:28,963 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708480493068 bypass)} 2024-02-20 18:55:29,213 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:55:29,216 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-20 18:55:29,216 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708480493068 bypass), TestNs=QuotaState(ts=1708480493068 bypass)} 2024-02-20 18:55:29,216 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1708480493068 bypass), TestNs:TestTable=QuotaState(ts=1708480493068 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin1=QuotaState(ts=1708480493068 bypass)} 2024-02-20 18:55:29,216 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(218): {} 2024-02-20 18:55:29,216 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708480493068 bypass)} 2024-02-20 18:55:29,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:29,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 202 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:47396 deadline: 1708455339234, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:29,490 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:29,491 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 204 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:47396 deadline: 1708455339234, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:29,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:29,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 206 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:47396 deadline: 1708455339234, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:30,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:30,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 208 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:47396 deadline: 1708455339234, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:32,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:32,020 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 210 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:47396 deadline: 1708455339235, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:34,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:34,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 212 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:47396 deadline: 1708455339234, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:34,527 ERROR [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10335: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1708455291769.e226b379223e6b8046292613eecc95b6., hostname=jenkins-hbase4.apache.org,38947,1708455285785, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-20 18:55:34,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:34,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 213 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:47396 deadline: 1708455344529, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:34,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:34,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 215 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:47396 deadline: 1708455344529, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:35,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:35,291 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 217 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:47396 deadline: 1708455344529, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:36,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:36,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 219 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:47396 deadline: 1708455344529, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:37,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:37,310 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 221 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:47396 deadline: 1708455344529, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:39,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:39,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 223 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:47396 deadline: 1708455344529, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-20 18:55:39,825 ERROR [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10339: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1708455291769.e226b379223e6b8046292613eecc95b6., hostname=jenkins-hbase4.apache.org,38947,1708455285785, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-20 18:55:40,082 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:55:40,082 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-20 18:55:40,083 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708484093068 bypass), TestNs=QuotaState(ts=1708484093068 bypass)} 2024-02-20 18:55:40,083 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1708484093068 bypass), TestQuotaAdmin2=QuotaState(ts=1708484093068 bypass)} 2024-02-20 18:55:40,083 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(218): {} 2024-02-20 18:55:40,083 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708484093068 bypass)} 2024-02-20 18:55:40,333 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:55:40,333 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-20 18:55:40,333 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708484093068 bypass), TestNs=QuotaState(ts=1708484093068 bypass)} 2024-02-20 18:55:40,333 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1708484093068 bypass), TestNs:TestTable=QuotaState(ts=1708484093068 bypass), TestQuotaAdmin1=QuotaState(ts=1708484093068 bypass)} 2024-02-20 18:55:40,333 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1708484093068 bypass)} 2024-02-20 18:55:40,333 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708484093068 bypass)} 2024-02-20 18:55:40,346 INFO [Listener at localhost/36187] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=280 (was 280), OpenFileDescriptor=597 (was 597), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=189 (was 206), ProcessCount=165 (was 167), AvailableMemoryMB=11431 (was 10768) - AvailableMemoryMB LEAK? - 2024-02-20 18:55:40,359 INFO [Listener at localhost/36187] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=280, OpenFileDescriptor=597, MaxFileDescriptor=60000, SystemLoadAverage=189, ProcessCount=165, AvailableMemoryMB=11430 2024-02-20 18:55:40,620 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:55:40,620 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-20 18:55:40,621 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708487693068 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1708487693068 bypass)} 2024-02-20 18:55:40,621 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1708487693068 bypass), TestQuotaAdmin2=QuotaState(ts=1708487693068 bypass)} 2024-02-20 18:55:40,621 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(218): {} 2024-02-20 18:55:40,621 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708487693068 bypass)} 2024-02-20 18:55:40,872 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:55:40,872 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-20 18:55:40,873 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708487693068 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1708487693068 bypass)} 2024-02-20 18:55:40,873 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1708487693068 bypass), TestNs:TestTable=QuotaState(ts=1708487693068 bypass), TestQuotaAdmin1=QuotaState(ts=1708487693068 bypass)} 2024-02-20 18:55:40,873 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(218): {} 2024-02-20 18:55:40,873 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708487693068 bypass)} 2024-02-20 18:55:40,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-02-20 18:55:40,889 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 235 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47396 deadline: 1708455350889, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-02-20 18:55:41,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-02-20 18:55:41,145 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 237 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47396 deadline: 1708455350889, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-02-20 18:55:41,649 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-02-20 18:55:41,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 239 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47396 deadline: 1708455350889, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-02-20 18:55:42,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-02-20 18:55:42,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 241 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47396 deadline: 1708455350890, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-02-20 18:55:43,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-02-20 18:55:43,657 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 243 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47396 deadline: 1708455350889, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-02-20 18:55:46,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-02-20 18:55:46,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 245 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:47396 deadline: 1708455350889, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-02-20 18:55:46,181 ERROR [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10338: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d., hostname=jenkins-hbase4.apache.org,38947,1708455285785, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:128) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-20 18:55:46,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:46,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 252 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47396 deadline: 1708455356189, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:46,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:46,444 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 254 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47396 deadline: 1708455356190, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:46,950 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:46,951 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 256 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47396 deadline: 1708455356189, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:47,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:47,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 258 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47396 deadline: 1708455356189, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:48,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:48,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 260 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47396 deadline: 1708455356190, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:51,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:51,475 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38947] ipc.CallRunner(144): callId: 262 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:47396 deadline: 1708455356189, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-02-20 18:55:51,476 ERROR [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10323: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d., hostname=jenkins-hbase4.apache.org,38947,1708455285785, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-20 18:55:51,734 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:55:51,734 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-20 18:55:51,734 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708491293068 bypass), TestNs=QuotaState(ts=1708491293068 bypass)} 2024-02-20 18:55:51,734 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1708491293068 bypass), TestQuotaAdmin2=QuotaState(ts=1708491293068 bypass)} 2024-02-20 18:55:51,734 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(218): {} 2024-02-20 18:55:51,734 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708491293068 bypass)} 2024-02-20 18:55:51,985 INFO [Listener at localhost/36187] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-20 18:55:51,985 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-20 18:55:51,985 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1708491293068 bypass), TestNs=QuotaState(ts=1708491293068 bypass)} 2024-02-20 18:55:51,985 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1708491293068 bypass), TestNs:TestTable=QuotaState(ts=1708491293068 bypass), TestQuotaAdmin1=QuotaState(ts=1708491293068 bypass)} 2024-02-20 18:55:51,985 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1708491293068 bypass)} 2024-02-20 18:55:51,985 DEBUG [Listener at localhost/36187] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1708491293068 bypass)} 2024-02-20 18:55:51,998 INFO [Listener at localhost/36187] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=266 (was 280), OpenFileDescriptor=585 (was 597), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=160 (was 189), ProcessCount=168 (was 165) - ProcessCount LEAK? -, AvailableMemoryMB=11430 (was 11430) 2024-02-20 18:55:52,001 INFO [Listener at localhost/36187] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin0 2024-02-20 18:55:52,005 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin0 2024-02-20 18:55:52,012 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] procedure2.ProcedureExecutor(1075): Stored pid=27, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin0 2024-02-20 18:55:52,016 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708455352016"}]},"ts":"1708455352016"} 2024-02-20 18:55:52,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-02-20 18:55:52,017 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLING in hbase:meta 2024-02-20 18:55:52,020 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set TestQuotaAdmin0 to state=DISABLING 2024-02-20 18:55:52,021 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=82e64f94bac772699b7195bba7790e7d, UNASSIGN}] 2024-02-20 18:55:52,022 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=82e64f94bac772699b7195bba7790e7d, UNASSIGN 2024-02-20 18:55:52,023 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=82e64f94bac772699b7195bba7790e7d, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38947,1708455285785 2024-02-20 18:55:52,023 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708455352023"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1708455352023"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1708455352023"}]},"ts":"1708455352023"} 2024-02-20 18:55:52,025 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure 82e64f94bac772699b7195bba7790e7d, server=jenkins-hbase4.apache.org,38947,1708455285785}] 2024-02-20 18:55:52,167 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase4.apache.org,38947,1708455285785, timeout=1708455352181, delay=14, operations=[pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure 82e64f94bac772699b7195bba7790e7d, server=jenkins-hbase4.apache.org,38947,1708455285785]] 2024-02-20 18:55:52,182 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38947,1708455285785 2024-02-20 18:55:52,185 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 82e64f94bac772699b7195bba7790e7d 2024-02-20 18:55:52,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 82e64f94bac772699b7195bba7790e7d, disabling compactions & flushes 2024-02-20 18:55:52,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d. 2024-02-20 18:55:52,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d. 2024-02-20 18:55:52,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d. after waiting 0 ms 2024-02-20 18:55:52,186 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d. 2024-02-20 18:55:52,186 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 82e64f94bac772699b7195bba7790e7d 1/1 column families, dataSize=578 B heapSize=2.11 KB 2024-02-20 18:55:52,259 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=578 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/default/TestQuotaAdmin0/82e64f94bac772699b7195bba7790e7d/.tmp/cf/0827e8c54390417385a6c077ee30f911 2024-02-20 18:55:52,268 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-02-20 18:55:52,304 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/default/TestQuotaAdmin0/82e64f94bac772699b7195bba7790e7d/.tmp/cf/0827e8c54390417385a6c077ee30f911 as hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/default/TestQuotaAdmin0/82e64f94bac772699b7195bba7790e7d/cf/0827e8c54390417385a6c077ee30f911 2024-02-20 18:55:52,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/default/TestQuotaAdmin0/82e64f94bac772699b7195bba7790e7d/cf/0827e8c54390417385a6c077ee30f911, entries=6, sequenceid=21, filesize=4.7 K 2024-02-20 18:55:52,317 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~578 B/578, heapSize ~2.09 KB/2144, currentSize=0 B/0 for 82e64f94bac772699b7195bba7790e7d in 131ms, sequenceid=21, compaction requested=false 2024-02-20 18:55:52,325 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/default/TestQuotaAdmin0/82e64f94bac772699b7195bba7790e7d/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2024-02-20 18:55:52,326 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d. 2024-02-20 18:55:52,327 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 82e64f94bac772699b7195bba7790e7d: 2024-02-20 18:55:52,329 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 82e64f94bac772699b7195bba7790e7d 2024-02-20 18:55:52,329 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=82e64f94bac772699b7195bba7790e7d, regionState=CLOSED 2024-02-20 18:55:52,329 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708455352329"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1708455352329"}]},"ts":"1708455352329"} 2024-02-20 18:55:52,333 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=29, resume processing ppid=28 2024-02-20 18:55:52,333 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=29, ppid=28, state=SUCCESS; CloseRegionProcedure 82e64f94bac772699b7195bba7790e7d, server=jenkins-hbase4.apache.org,38947,1708455285785 in 306 msec 2024-02-20 18:55:52,335 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=28, resume processing ppid=27 2024-02-20 18:55:52,335 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=82e64f94bac772699b7195bba7790e7d, UNASSIGN in 312 msec 2024-02-20 18:55:52,336 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708455352336"}]},"ts":"1708455352336"} 2024-02-20 18:55:52,337 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLED in hbase:meta 2024-02-20 18:55:52,339 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set TestQuotaAdmin0 to state=DISABLED 2024-02-20 18:55:52,342 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=27, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin0 in 333 msec 2024-02-20 18:55:52,770 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-02-20 18:55:52,770 INFO [Listener at localhost/36187] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin0, procId: 27 completed 2024-02-20 18:55:52,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin0 2024-02-20 18:55:52,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] procedure2.ProcedureExecutor(1075): Stored pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin0 2024-02-20 18:55:52,784 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-02-20 18:55:52,785 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=30, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-02-20 18:55:52,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-02-20 18:55:52,792 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/default/TestQuotaAdmin0/82e64f94bac772699b7195bba7790e7d 2024-02-20 18:55:52,796 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/default/TestQuotaAdmin0/82e64f94bac772699b7195bba7790e7d/cf, FileablePath, hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/default/TestQuotaAdmin0/82e64f94bac772699b7195bba7790e7d/recovered.edits] 2024-02-20 18:55:52,806 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/default/TestQuotaAdmin0/82e64f94bac772699b7195bba7790e7d/cf/0827e8c54390417385a6c077ee30f911 to hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/archive/data/default/TestQuotaAdmin0/82e64f94bac772699b7195bba7790e7d/cf/0827e8c54390417385a6c077ee30f911 2024-02-20 18:55:52,811 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/default/TestQuotaAdmin0/82e64f94bac772699b7195bba7790e7d/recovered.edits/24.seqid to hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/archive/data/default/TestQuotaAdmin0/82e64f94bac772699b7195bba7790e7d/recovered.edits/24.seqid 2024-02-20 18:55:52,814 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/default/TestQuotaAdmin0/82e64f94bac772699b7195bba7790e7d 2024-02-20 18:55:52,814 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-02-20 18:55:52,817 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=30, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-02-20 18:55:52,837 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin0 from hbase:meta 2024-02-20 18:55:52,840 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin0' descriptor. 2024-02-20 18:55:52,841 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=30, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-02-20 18:55:52,841 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin0' from region states. 2024-02-20 18:55:52,842 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1708455352842"}]},"ts":"9223372036854775807"} 2024-02-20 18:55:52,844 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-02-20 18:55:52,844 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 82e64f94bac772699b7195bba7790e7d, NAME => 'TestQuotaAdmin0,,1708455289133.82e64f94bac772699b7195bba7790e7d.', STARTKEY => '', ENDKEY => ''}] 2024-02-20 18:55:52,844 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin0' as deleted. 2024-02-20 18:55:52,844 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1708455352844"}]},"ts":"9223372036854775807"} 2024-02-20 18:55:52,846 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin0 state from META 2024-02-20 18:55:52,848 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=30, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-02-20 18:55:52,849 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=30, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin0 in 72 msec 2024-02-20 18:55:53,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-02-20 18:55:53,041 INFO [Listener at localhost/36187] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin0, procId: 30 completed 2024-02-20 18:55:53,041 INFO [Listener at localhost/36187] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin1 2024-02-20 18:55:53,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin1 2024-02-20 18:55:53,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] procedure2.ProcedureExecutor(1075): Stored pid=31, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin1 2024-02-20 18:55:53,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-02-20 18:55:53,047 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708455353047"}]},"ts":"1708455353047"} 2024-02-20 18:55:53,049 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLING in hbase:meta 2024-02-20 18:55:53,051 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set TestQuotaAdmin1 to state=DISABLING 2024-02-20 18:55:53,052 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=8b82563ddfbe8b9c5e97a1912c043b43, UNASSIGN}] 2024-02-20 18:55:53,053 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=8b82563ddfbe8b9c5e97a1912c043b43, UNASSIGN 2024-02-20 18:55:53,054 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=8b82563ddfbe8b9c5e97a1912c043b43, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38947,1708455285785 2024-02-20 18:55:53,054 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1708455289940.8b82563ddfbe8b9c5e97a1912c043b43.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708455353054"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1708455353054"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1708455353054"}]},"ts":"1708455353054"} 2024-02-20 18:55:53,056 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=33, ppid=32, state=RUNNABLE; CloseRegionProcedure 8b82563ddfbe8b9c5e97a1912c043b43, server=jenkins-hbase4.apache.org,38947,1708455285785}] 2024-02-20 18:55:53,208 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38947,1708455285785 2024-02-20 18:55:53,209 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 8b82563ddfbe8b9c5e97a1912c043b43 2024-02-20 18:55:53,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 8b82563ddfbe8b9c5e97a1912c043b43, disabling compactions & flushes 2024-02-20 18:55:53,210 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1708455289940.8b82563ddfbe8b9c5e97a1912c043b43. 2024-02-20 18:55:53,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1708455289940.8b82563ddfbe8b9c5e97a1912c043b43. 2024-02-20 18:55:53,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1708455289940.8b82563ddfbe8b9c5e97a1912c043b43. after waiting 0 ms 2024-02-20 18:55:53,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1708455289940.8b82563ddfbe8b9c5e97a1912c043b43. 2024-02-20 18:55:53,215 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/default/TestQuotaAdmin1/8b82563ddfbe8b9c5e97a1912c043b43/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-02-20 18:55:53,216 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1708455289940.8b82563ddfbe8b9c5e97a1912c043b43. 2024-02-20 18:55:53,216 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 8b82563ddfbe8b9c5e97a1912c043b43: 2024-02-20 18:55:53,218 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 8b82563ddfbe8b9c5e97a1912c043b43 2024-02-20 18:55:53,219 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=8b82563ddfbe8b9c5e97a1912c043b43, regionState=CLOSED 2024-02-20 18:55:53,219 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1708455289940.8b82563ddfbe8b9c5e97a1912c043b43.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708455353219"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1708455353219"}]},"ts":"1708455353219"} 2024-02-20 18:55:53,223 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=33, resume processing ppid=32 2024-02-20 18:55:53,223 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=33, ppid=32, state=SUCCESS; CloseRegionProcedure 8b82563ddfbe8b9c5e97a1912c043b43, server=jenkins-hbase4.apache.org,38947,1708455285785 in 164 msec 2024-02-20 18:55:53,225 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=32, resume processing ppid=31 2024-02-20 18:55:53,225 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=32, ppid=31, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=8b82563ddfbe8b9c5e97a1912c043b43, UNASSIGN in 171 msec 2024-02-20 18:55:53,226 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708455353226"}]},"ts":"1708455353226"} 2024-02-20 18:55:53,227 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLED in hbase:meta 2024-02-20 18:55:53,230 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set TestQuotaAdmin1 to state=DISABLED 2024-02-20 18:55:53,232 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=31, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin1 in 188 msec 2024-02-20 18:55:53,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-02-20 18:55:53,298 INFO [Listener at localhost/36187] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin1, procId: 31 completed 2024-02-20 18:55:53,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin1 2024-02-20 18:55:53,300 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] procedure2.ProcedureExecutor(1075): Stored pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin1 2024-02-20 18:55:53,302 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-02-20 18:55:53,303 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=34, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-02-20 18:55:53,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-02-20 18:55:53,308 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/default/TestQuotaAdmin1/8b82563ddfbe8b9c5e97a1912c043b43 2024-02-20 18:55:53,310 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/default/TestQuotaAdmin1/8b82563ddfbe8b9c5e97a1912c043b43/cf, FileablePath, hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/default/TestQuotaAdmin1/8b82563ddfbe8b9c5e97a1912c043b43/recovered.edits] 2024-02-20 18:55:53,319 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/default/TestQuotaAdmin1/8b82563ddfbe8b9c5e97a1912c043b43/recovered.edits/4.seqid to hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/archive/data/default/TestQuotaAdmin1/8b82563ddfbe8b9c5e97a1912c043b43/recovered.edits/4.seqid 2024-02-20 18:55:53,320 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/default/TestQuotaAdmin1/8b82563ddfbe8b9c5e97a1912c043b43 2024-02-20 18:55:53,320 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-02-20 18:55:53,324 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=34, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-02-20 18:55:53,326 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin1 from hbase:meta 2024-02-20 18:55:53,328 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin1' descriptor. 2024-02-20 18:55:53,330 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=34, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-02-20 18:55:53,330 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin1' from region states. 2024-02-20 18:55:53,330 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1,,1708455289940.8b82563ddfbe8b9c5e97a1912c043b43.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1708455353330"}]},"ts":"9223372036854775807"} 2024-02-20 18:55:53,332 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-02-20 18:55:53,332 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 8b82563ddfbe8b9c5e97a1912c043b43, NAME => 'TestQuotaAdmin1,,1708455289940.8b82563ddfbe8b9c5e97a1912c043b43.', STARTKEY => '', ENDKEY => ''}] 2024-02-20 18:55:53,332 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin1' as deleted. 2024-02-20 18:55:53,332 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1708455353332"}]},"ts":"9223372036854775807"} 2024-02-20 18:55:53,333 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin1 state from META 2024-02-20 18:55:53,336 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=34, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-02-20 18:55:53,338 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=34, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin1 in 37 msec 2024-02-20 18:55:53,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-02-20 18:55:53,557 INFO [Listener at localhost/36187] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin1, procId: 34 completed 2024-02-20 18:55:53,557 INFO [Listener at localhost/36187] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin2 2024-02-20 18:55:53,558 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin2 2024-02-20 18:55:53,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] procedure2.ProcedureExecutor(1075): Stored pid=35, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin2 2024-02-20 18:55:53,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-02-20 18:55:53,563 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708455353562"}]},"ts":"1708455353562"} 2024-02-20 18:55:53,564 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLING in hbase:meta 2024-02-20 18:55:53,566 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set TestQuotaAdmin2 to state=DISABLING 2024-02-20 18:55:53,567 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=51a58db2ce73e1af862393164b91790a, UNASSIGN}] 2024-02-20 18:55:53,568 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=51a58db2ce73e1af862393164b91790a, UNASSIGN 2024-02-20 18:55:53,569 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=51a58db2ce73e1af862393164b91790a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33065,1708455285736 2024-02-20 18:55:53,569 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1708455290718.51a58db2ce73e1af862393164b91790a.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708455353569"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1708455353569"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1708455353569"}]},"ts":"1708455353569"} 2024-02-20 18:55:53,570 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; CloseRegionProcedure 51a58db2ce73e1af862393164b91790a, server=jenkins-hbase4.apache.org,33065,1708455285736}] 2024-02-20 18:55:53,722 DEBUG [RSProcedureDispatcher-pool-5] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,33065,1708455285736 2024-02-20 18:55:53,723 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 51a58db2ce73e1af862393164b91790a 2024-02-20 18:55:53,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 51a58db2ce73e1af862393164b91790a, disabling compactions & flushes 2024-02-20 18:55:53,724 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1708455290718.51a58db2ce73e1af862393164b91790a. 2024-02-20 18:55:53,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1708455290718.51a58db2ce73e1af862393164b91790a. 2024-02-20 18:55:53,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1708455290718.51a58db2ce73e1af862393164b91790a. after waiting 0 ms 2024-02-20 18:55:53,724 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1708455290718.51a58db2ce73e1af862393164b91790a. 2024-02-20 18:55:53,730 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/default/TestQuotaAdmin2/51a58db2ce73e1af862393164b91790a/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-02-20 18:55:53,732 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1708455290718.51a58db2ce73e1af862393164b91790a. 2024-02-20 18:55:53,732 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 51a58db2ce73e1af862393164b91790a: 2024-02-20 18:55:53,734 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 51a58db2ce73e1af862393164b91790a 2024-02-20 18:55:53,734 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=51a58db2ce73e1af862393164b91790a, regionState=CLOSED 2024-02-20 18:55:53,735 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1708455290718.51a58db2ce73e1af862393164b91790a.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1708455353734"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1708455353734"}]},"ts":"1708455353734"} 2024-02-20 18:55:53,738 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=37, resume processing ppid=36 2024-02-20 18:55:53,738 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=37, ppid=36, state=SUCCESS; CloseRegionProcedure 51a58db2ce73e1af862393164b91790a, server=jenkins-hbase4.apache.org,33065,1708455285736 in 166 msec 2024-02-20 18:55:53,740 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=36, resume processing ppid=35 2024-02-20 18:55:53,740 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=51a58db2ce73e1af862393164b91790a, UNASSIGN in 171 msec 2024-02-20 18:55:53,741 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708455353741"}]},"ts":"1708455353741"} 2024-02-20 18:55:53,743 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLED in hbase:meta 2024-02-20 18:55:53,745 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set TestQuotaAdmin2 to state=DISABLED 2024-02-20 18:55:53,747 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=35, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin2 in 188 msec 2024-02-20 18:55:53,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-02-20 18:55:53,813 INFO [Listener at localhost/36187] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin2, procId: 35 completed 2024-02-20 18:55:53,814 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin2 2024-02-20 18:55:53,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] procedure2.ProcedureExecutor(1075): Stored pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin2 2024-02-20 18:55:53,817 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-02-20 18:55:53,818 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=38, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-02-20 18:55:53,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-02-20 18:55:53,823 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/default/TestQuotaAdmin2/51a58db2ce73e1af862393164b91790a 2024-02-20 18:55:53,825 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/default/TestQuotaAdmin2/51a58db2ce73e1af862393164b91790a/cf, FileablePath, hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/default/TestQuotaAdmin2/51a58db2ce73e1af862393164b91790a/recovered.edits] 2024-02-20 18:55:53,833 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/default/TestQuotaAdmin2/51a58db2ce73e1af862393164b91790a/recovered.edits/4.seqid to hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/archive/data/default/TestQuotaAdmin2/51a58db2ce73e1af862393164b91790a/recovered.edits/4.seqid 2024-02-20 18:55:53,834 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/default/TestQuotaAdmin2/51a58db2ce73e1af862393164b91790a 2024-02-20 18:55:53,834 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-02-20 18:55:53,837 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=38, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-02-20 18:55:53,838 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin2 from hbase:meta 2024-02-20 18:55:53,841 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin2' descriptor. 2024-02-20 18:55:53,842 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=38, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-02-20 18:55:53,842 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin2' from region states. 2024-02-20 18:55:53,842 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2,,1708455290718.51a58db2ce73e1af862393164b91790a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1708455353842"}]},"ts":"9223372036854775807"} 2024-02-20 18:55:53,844 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-02-20 18:55:53,844 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 51a58db2ce73e1af862393164b91790a, NAME => 'TestQuotaAdmin2,,1708455290718.51a58db2ce73e1af862393164b91790a.', STARTKEY => '', ENDKEY => ''}] 2024-02-20 18:55:53,844 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin2' as deleted. 2024-02-20 18:55:53,844 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1708455353844"}]},"ts":"9223372036854775807"} 2024-02-20 18:55:53,846 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin2 state from META 2024-02-20 18:55:53,848 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=38, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-02-20 18:55:53,850 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=38, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin2 in 34 msec 2024-02-20 18:55:54,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-02-20 18:55:54,072 INFO [Listener at localhost/36187] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin2, procId: 38 completed 2024-02-20 18:55:54,072 INFO [Listener at localhost/36187] client.HBaseAdmin$15(890): Started disable of TestNs:TestTable 2024-02-20 18:55:54,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestNs:TestTable 2024-02-20 18:55:54,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] procedure2.ProcedureExecutor(1075): Stored pid=39, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestNs:TestTable 2024-02-20 18:55:54,077 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-02-20 18:55:54,077 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708455354077"}]},"ts":"1708455354077"} 2024-02-20 18:55:54,079 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLING in hbase:meta 2024-02-20 18:55:54,081 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set TestNs:TestTable to state=DISABLING 2024-02-20 18:55:54,082 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=dd8b20d7562c2a270ea5be09b22c2a55, UNASSIGN}, {pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=e226b379223e6b8046292613eecc95b6, UNASSIGN}] 2024-02-20 18:55:54,083 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=dd8b20d7562c2a270ea5be09b22c2a55, UNASSIGN 2024-02-20 18:55:54,083 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=e226b379223e6b8046292613eecc95b6, UNASSIGN 2024-02-20 18:55:54,084 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=dd8b20d7562c2a270ea5be09b22c2a55, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33065,1708455285736 2024-02-20 18:55:54,084 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1708455291769.dd8b20d7562c2a270ea5be09b22c2a55.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1708455354084"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1708455354084"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1708455354084"}]},"ts":"1708455354084"} 2024-02-20 18:55:54,084 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=e226b379223e6b8046292613eecc95b6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38947,1708455285785 2024-02-20 18:55:54,084 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1708455291769.e226b379223e6b8046292613eecc95b6.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1708455354084"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1708455354084"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1708455354084"}]},"ts":"1708455354084"} 2024-02-20 18:55:54,086 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=42, ppid=40, state=RUNNABLE; CloseRegionProcedure dd8b20d7562c2a270ea5be09b22c2a55, server=jenkins-hbase4.apache.org,33065,1708455285736}] 2024-02-20 18:55:54,087 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=43, ppid=41, state=RUNNABLE; CloseRegionProcedure e226b379223e6b8046292613eecc95b6, server=jenkins-hbase4.apache.org,38947,1708455285785}] 2024-02-20 18:55:54,238 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,33065,1708455285736 2024-02-20 18:55:54,238 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dd8b20d7562c2a270ea5be09b22c2a55 2024-02-20 18:55:54,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dd8b20d7562c2a270ea5be09b22c2a55, disabling compactions & flushes 2024-02-20 18:55:54,239 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38947,1708455285785 2024-02-20 18:55:54,239 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1708455291769.dd8b20d7562c2a270ea5be09b22c2a55. 2024-02-20 18:55:54,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1708455291769.dd8b20d7562c2a270ea5be09b22c2a55. 2024-02-20 18:55:54,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1708455291769.dd8b20d7562c2a270ea5be09b22c2a55. after waiting 0 ms 2024-02-20 18:55:54,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1708455291769.dd8b20d7562c2a270ea5be09b22c2a55. 2024-02-20 18:55:54,240 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close e226b379223e6b8046292613eecc95b6 2024-02-20 18:55:54,240 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing e226b379223e6b8046292613eecc95b6, disabling compactions & flushes 2024-02-20 18:55:54,240 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1708455291769.e226b379223e6b8046292613eecc95b6. 2024-02-20 18:55:54,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1708455291769.e226b379223e6b8046292613eecc95b6. 2024-02-20 18:55:54,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1708455291769.e226b379223e6b8046292613eecc95b6. after waiting 0 ms 2024-02-20 18:55:54,241 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1708455291769.e226b379223e6b8046292613eecc95b6. 2024-02-20 18:55:54,245 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/TestNs/TestTable/dd8b20d7562c2a270ea5be09b22c2a55/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-02-20 18:55:54,246 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/TestNs/TestTable/e226b379223e6b8046292613eecc95b6/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-02-20 18:55:54,247 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1708455291769.dd8b20d7562c2a270ea5be09b22c2a55. 2024-02-20 18:55:54,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dd8b20d7562c2a270ea5be09b22c2a55: 2024-02-20 18:55:54,247 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1708455291769.e226b379223e6b8046292613eecc95b6. 2024-02-20 18:55:54,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for e226b379223e6b8046292613eecc95b6: 2024-02-20 18:55:54,249 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dd8b20d7562c2a270ea5be09b22c2a55 2024-02-20 18:55:54,250 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=dd8b20d7562c2a270ea5be09b22c2a55, regionState=CLOSED 2024-02-20 18:55:54,250 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,,1708455291769.dd8b20d7562c2a270ea5be09b22c2a55.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1708455354250"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1708455354250"}]},"ts":"1708455354250"} 2024-02-20 18:55:54,250 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed e226b379223e6b8046292613eecc95b6 2024-02-20 18:55:54,251 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=e226b379223e6b8046292613eecc95b6, regionState=CLOSED 2024-02-20 18:55:54,251 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1708455291769.e226b379223e6b8046292613eecc95b6.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1708455354251"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1708455354251"}]},"ts":"1708455354251"} 2024-02-20 18:55:54,253 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=42, resume processing ppid=40 2024-02-20 18:55:54,254 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=43, resume processing ppid=41 2024-02-20 18:55:54,254 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=42, ppid=40, state=SUCCESS; CloseRegionProcedure dd8b20d7562c2a270ea5be09b22c2a55, server=jenkins-hbase4.apache.org,33065,1708455285736 in 165 msec 2024-02-20 18:55:54,255 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=dd8b20d7562c2a270ea5be09b22c2a55, UNASSIGN in 171 msec 2024-02-20 18:55:54,255 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=43, ppid=41, state=SUCCESS; CloseRegionProcedure e226b379223e6b8046292613eecc95b6, server=jenkins-hbase4.apache.org,38947,1708455285785 in 165 msec 2024-02-20 18:55:54,256 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=41, resume processing ppid=39 2024-02-20 18:55:54,256 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=41, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=e226b379223e6b8046292613eecc95b6, UNASSIGN in 172 msec 2024-02-20 18:55:54,257 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1708455354257"}]},"ts":"1708455354257"} 2024-02-20 18:55:54,258 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLED in hbase:meta 2024-02-20 18:55:54,261 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set TestNs:TestTable to state=DISABLED 2024-02-20 18:55:54,263 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=39, state=SUCCESS; DisableTableProcedure table=TestNs:TestTable in 189 msec 2024-02-20 18:55:54,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-02-20 18:55:54,328 INFO [Listener at localhost/36187] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: TestNs:TestTable, procId: 39 completed 2024-02-20 18:55:54,329 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestNs:TestTable 2024-02-20 18:55:54,330 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] procedure2.ProcedureExecutor(1075): Stored pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestNs:TestTable 2024-02-20 18:55:54,332 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-02-20 18:55:54,333 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=44, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-02-20 18:55:54,334 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-02-20 18:55:54,338 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/TestNs/TestTable/dd8b20d7562c2a270ea5be09b22c2a55 2024-02-20 18:55:54,338 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/TestNs/TestTable/e226b379223e6b8046292613eecc95b6 2024-02-20 18:55:54,341 DEBUG [HFileArchiver-11] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/TestNs/TestTable/dd8b20d7562c2a270ea5be09b22c2a55/cf, FileablePath, hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/TestNs/TestTable/dd8b20d7562c2a270ea5be09b22c2a55/recovered.edits] 2024-02-20 18:55:54,341 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/TestNs/TestTable/e226b379223e6b8046292613eecc95b6/cf, FileablePath, hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/TestNs/TestTable/e226b379223e6b8046292613eecc95b6/recovered.edits] 2024-02-20 18:55:54,349 DEBUG [HFileArchiver-11] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/TestNs/TestTable/dd8b20d7562c2a270ea5be09b22c2a55/recovered.edits/4.seqid to hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/archive/data/TestNs/TestTable/dd8b20d7562c2a270ea5be09b22c2a55/recovered.edits/4.seqid 2024-02-20 18:55:54,349 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/TestNs/TestTable/e226b379223e6b8046292613eecc95b6/recovered.edits/4.seqid to hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/archive/data/TestNs/TestTable/e226b379223e6b8046292613eecc95b6/recovered.edits/4.seqid 2024-02-20 18:55:54,350 DEBUG [HFileArchiver-11] backup.HFileArchiver(596): Deleted hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/TestNs/TestTable/dd8b20d7562c2a270ea5be09b22c2a55 2024-02-20 18:55:54,350 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/.tmp/data/TestNs/TestTable/e226b379223e6b8046292613eecc95b6 2024-02-20 18:55:54,350 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-02-20 18:55:54,354 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=44, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-02-20 18:55:54,356 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of TestNs:TestTable from hbase:meta 2024-02-20 18:55:54,358 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'TestNs:TestTable' descriptor. 2024-02-20 18:55:54,359 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=44, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-02-20 18:55:54,359 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'TestNs:TestTable' from region states. 2024-02-20 18:55:54,359 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,,1708455291769.dd8b20d7562c2a270ea5be09b22c2a55.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1708455354359"}]},"ts":"9223372036854775807"} 2024-02-20 18:55:54,360 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,1,1708455291769.e226b379223e6b8046292613eecc95b6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1708455354359"}]},"ts":"9223372036854775807"} 2024-02-20 18:55:54,361 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2024-02-20 18:55:54,361 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => dd8b20d7562c2a270ea5be09b22c2a55, NAME => 'TestNs:TestTable,,1708455291769.dd8b20d7562c2a270ea5be09b22c2a55.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => e226b379223e6b8046292613eecc95b6, NAME => 'TestNs:TestTable,1,1708455291769.e226b379223e6b8046292613eecc95b6.', STARTKEY => '1', ENDKEY => ''}] 2024-02-20 18:55:54,362 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'TestNs:TestTable' as deleted. 2024-02-20 18:55:54,362 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1708455354362"}]},"ts":"9223372036854775807"} 2024-02-20 18:55:54,363 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table TestNs:TestTable state from META 2024-02-20 18:55:54,366 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=44, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-02-20 18:55:54,368 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=44, state=SUCCESS; DeleteTableProcedure table=TestNs:TestTable in 37 msec 2024-02-20 18:55:54,586 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-02-20 18:55:54,586 INFO [Listener at localhost/36187] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: TestNs:TestTable, procId: 44 completed 2024-02-20 18:55:54,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.HMaster$17(3092): Client=jenkins//172.31.14.131 delete TestNs 2024-02-20 18:55:54,597 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] procedure2.ProcedureExecutor(1075): Stored pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE; DeleteNamespaceProcedure, namespace=TestNs 2024-02-20 18:55:54,599 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-02-20 18:55:54,602 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_FROM_NS_TABLE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-02-20 18:55:54,604 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_FROM_ZK, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-02-20 18:55:54,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-02-20 18:55:54,606 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace/TestNs 2024-02-20 18:55:54,606 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-02-20 18:55:54,606 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_DIRECTORIES, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-02-20 18:55:54,609 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_NAMESPACE_QUOTA, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-02-20 18:55:54,610 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=45, state=SUCCESS; DeleteNamespaceProcedure, namespace=TestNs in 18 msec 2024-02-20 18:55:54,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36731] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-02-20 18:55:54,856 INFO [Listener at localhost/36187] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2024-02-20 18:55:54,856 INFO [Listener at localhost/36187] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-02-20 18:55:54,857 DEBUG [Listener at localhost/36187] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0890ffaa to 127.0.0.1:59580 2024-02-20 18:55:54,857 DEBUG [Listener at localhost/36187] ipc.AbstractRpcClient(489): Stopping rpc client 2024-02-20 18:55:54,857 DEBUG [Listener at localhost/36187] util.JVMClusterUtil(237): Shutting down HBase Cluster 2024-02-20 18:55:54,857 DEBUG [Listener at localhost/36187] util.JVMClusterUtil(257): Found active master hash=1272740537, stopped=false 2024-02-20 18:55:54,858 DEBUG [Listener at localhost/36187] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-02-20 18:55:54,858 INFO [Listener at localhost/36187] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,36731,1708455284482 2024-02-20 18:55:54,860 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): regionserver:33065-0x101e5eeafa10001, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-02-20 18:55:54,860 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-02-20 18:55:54,860 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): regionserver:38947-0x101e5eeafa10002, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-02-20 18:55:54,860 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-20 18:55:54,861 INFO [Listener at localhost/36187] procedure2.ProcedureExecutor(675): Stopping 2024-02-20 18:55:54,861 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:33065-0x101e5eeafa10001, quorum=127.0.0.1:59580, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-02-20 18:55:54,861 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:38947-0x101e5eeafa10002, quorum=127.0.0.1:59580, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-02-20 18:55:54,861 DEBUG [Listener at localhost/36187] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6bed6b55 to 127.0.0.1:59580 2024-02-20 18:55:54,861 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-02-20 18:55:54,861 DEBUG [Listener at localhost/36187] ipc.AbstractRpcClient(489): Stopping rpc client 2024-02-20 18:55:54,862 INFO [Listener at localhost/36187] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,33065,1708455285736' ***** 2024-02-20 18:55:54,862 INFO [Listener at localhost/36187] regionserver.HRegionServer(2313): STOPPED: Shutdown requested 2024-02-20 18:55:54,862 INFO [Listener at localhost/36187] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,38947,1708455285785' ***** 2024-02-20 18:55:54,862 INFO [Listener at localhost/36187] regionserver.HRegionServer(2313): STOPPED: Shutdown requested 2024-02-20 18:55:54,862 INFO [RS:0;jenkins-hbase4:33065] regionserver.HeapMemoryManager(220): Stopping 2024-02-20 18:55:54,862 INFO [RS:1;jenkins-hbase4:38947] regionserver.HeapMemoryManager(220): Stopping 2024-02-20 18:55:54,862 INFO [RS:1;jenkins-hbase4:38947] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-02-20 18:55:54,862 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-02-20 18:55:54,862 INFO [RS:1;jenkins-hbase4:38947] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-02-20 18:55:54,862 INFO [RS:0;jenkins-hbase4:33065] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-02-20 18:55:54,862 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-02-20 18:55:54,862 INFO [RS:0;jenkins-hbase4:33065] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-02-20 18:55:54,862 INFO [RS:1;jenkins-hbase4:38947] regionserver.HRegionServer(3307): Received CLOSE for aae44a8ec16fd3d4228dbcd31bae43a1 2024-02-20 18:55:54,862 INFO [RS:0;jenkins-hbase4:33065] regionserver.HRegionServer(3307): Received CLOSE for 37a6e0e80f56b427adb85b885a01934e 2024-02-20 18:55:54,863 INFO [RS:0;jenkins-hbase4:33065] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,33065,1708455285736 2024-02-20 18:55:54,863 INFO [RS:1;jenkins-hbase4:38947] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,38947,1708455285785 2024-02-20 18:55:54,863 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing aae44a8ec16fd3d4228dbcd31bae43a1, disabling compactions & flushes 2024-02-20 18:55:54,863 INFO [RS:1;jenkins-hbase4:38947] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-02-20 18:55:54,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 37a6e0e80f56b427adb85b885a01934e, disabling compactions & flushes 2024-02-20 18:55:54,864 DEBUG [RS:1;jenkins-hbase4:38947] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x78e5b353 to 127.0.0.1:59580 2024-02-20 18:55:54,863 INFO [RS:0;jenkins-hbase4:33065] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-02-20 18:55:54,864 DEBUG [RS:1;jenkins-hbase4:38947] ipc.AbstractRpcClient(489): Stopping rpc client 2024-02-20 18:55:54,864 DEBUG [RS:0;jenkins-hbase4:33065] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7095181d to 127.0.0.1:59580 2024-02-20 18:55:54,864 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:quota,,1708455288534.37a6e0e80f56b427adb85b885a01934e. 2024-02-20 18:55:54,864 INFO [RS:1;jenkins-hbase4:38947] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-02-20 18:55:54,864 INFO [RS:1;jenkins-hbase4:38947] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-02-20 18:55:54,864 INFO [RS:1;jenkins-hbase4:38947] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-02-20 18:55:54,865 INFO [RS:1;jenkins-hbase4:38947] regionserver.HRegionServer(3307): Received CLOSE for 1588230740 2024-02-20 18:55:54,865 INFO [RS:1;jenkins-hbase4:38947] regionserver.HRegionServer(1477): Waiting on 2 regions to close 2024-02-20 18:55:54,864 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1708455287816.aae44a8ec16fd3d4228dbcd31bae43a1. 2024-02-20 18:55:54,865 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-02-20 18:55:54,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1708455287816.aae44a8ec16fd3d4228dbcd31bae43a1. 2024-02-20 18:55:54,865 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-02-20 18:55:54,865 DEBUG [RS:1;jenkins-hbase4:38947] regionserver.HRegionServer(1481): Online Regions={1588230740=hbase:meta,,1.1588230740, aae44a8ec16fd3d4228dbcd31bae43a1=hbase:namespace,,1708455287816.aae44a8ec16fd3d4228dbcd31bae43a1.} 2024-02-20 18:55:54,864 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1708455288534.37a6e0e80f56b427adb85b885a01934e. 2024-02-20 18:55:54,864 DEBUG [RS:0;jenkins-hbase4:33065] ipc.AbstractRpcClient(489): Stopping rpc client 2024-02-20 18:55:54,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1708455288534.37a6e0e80f56b427adb85b885a01934e. after waiting 0 ms 2024-02-20 18:55:54,866 INFO [RS:0;jenkins-hbase4:33065] regionserver.HRegionServer(1477): Waiting on 1 regions to close 2024-02-20 18:55:54,865 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-02-20 18:55:54,865 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1708455287816.aae44a8ec16fd3d4228dbcd31bae43a1. after waiting 0 ms 2024-02-20 18:55:54,866 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-02-20 18:55:54,866 DEBUG [RS:0;jenkins-hbase4:33065] regionserver.HRegionServer(1481): Online Regions={37a6e0e80f56b427adb85b885a01934e=hbase:quota,,1708455288534.37a6e0e80f56b427adb85b885a01934e.} 2024-02-20 18:55:54,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1708455288534.37a6e0e80f56b427adb85b885a01934e. 2024-02-20 18:55:54,866 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-02-20 18:55:54,866 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 37a6e0e80f56b427adb85b885a01934e 2/2 column families, dataSize=726 B heapSize=2.44 KB 2024-02-20 18:55:54,866 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=14.15 KB heapSize=25.10 KB 2024-02-20 18:55:54,867 DEBUG [RS:0;jenkins-hbase4:33065] regionserver.HRegionServer(1507): Waiting on 37a6e0e80f56b427adb85b885a01934e 2024-02-20 18:55:54,867 DEBUG [RS:1;jenkins-hbase4:38947] regionserver.HRegionServer(1507): Waiting on 1588230740, aae44a8ec16fd3d4228dbcd31bae43a1 2024-02-20 18:55:54,866 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1708455287816.aae44a8ec16fd3d4228dbcd31bae43a1. 2024-02-20 18:55:54,867 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing aae44a8ec16fd3d4228dbcd31bae43a1 1/1 column families, dataSize=147 B heapSize=704 B 2024-02-20 18:55:54,877 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-02-20 18:55:54,877 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-02-20 18:55:54,908 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=12.16 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/meta/1588230740/.tmp/info/b52fef5262fa4ac892e163e3448c1b6e 2024-02-20 18:55:54,925 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=147 B at sequenceid=8 (bloomFilter=true), to=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/namespace/aae44a8ec16fd3d4228dbcd31bae43a1/.tmp/info/88ab0133a6504238a3fb062b7208d987 2024-02-20 18:55:54,928 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b52fef5262fa4ac892e163e3448c1b6e 2024-02-20 18:55:54,932 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 88ab0133a6504238a3fb062b7208d987 2024-02-20 18:55:54,933 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/namespace/aae44a8ec16fd3d4228dbcd31bae43a1/.tmp/info/88ab0133a6504238a3fb062b7208d987 as hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/namespace/aae44a8ec16fd3d4228dbcd31bae43a1/info/88ab0133a6504238a3fb062b7208d987 2024-02-20 18:55:54,941 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=478 B at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/meta/1588230740/.tmp/rep_barrier/e8ac26031a764dc599282d38c513481d 2024-02-20 18:55:54,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 88ab0133a6504238a3fb062b7208d987 2024-02-20 18:55:54,944 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/namespace/aae44a8ec16fd3d4228dbcd31bae43a1/info/88ab0133a6504238a3fb062b7208d987, entries=3, sequenceid=8, filesize=5.0 K 2024-02-20 18:55:54,945 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~147 B/147, heapSize ~688 B/688, currentSize=0 B/0 for aae44a8ec16fd3d4228dbcd31bae43a1 in 78ms, sequenceid=8, compaction requested=false 2024-02-20 18:55:54,951 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/namespace/aae44a8ec16fd3d4228dbcd31bae43a1/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=1 2024-02-20 18:55:54,952 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1708455287816.aae44a8ec16fd3d4228dbcd31bae43a1. 2024-02-20 18:55:54,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for aae44a8ec16fd3d4228dbcd31bae43a1: 2024-02-20 18:55:54,952 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1708455287816.aae44a8ec16fd3d4228dbcd31bae43a1. 2024-02-20 18:55:54,952 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e8ac26031a764dc599282d38c513481d 2024-02-20 18:55:54,965 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.53 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/meta/1588230740/.tmp/table/a09b9d79b7aa47d593c4f36cd5e735de 2024-02-20 18:55:54,973 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a09b9d79b7aa47d593c4f36cd5e735de 2024-02-20 18:55:54,974 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/meta/1588230740/.tmp/info/b52fef5262fa4ac892e163e3448c1b6e as hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/meta/1588230740/info/b52fef5262fa4ac892e163e3448c1b6e 2024-02-20 18:55:54,983 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b52fef5262fa4ac892e163e3448c1b6e 2024-02-20 18:55:54,983 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/meta/1588230740/info/b52fef5262fa4ac892e163e3448c1b6e, entries=30, sequenceid=66, filesize=8.0 K 2024-02-20 18:55:54,985 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/meta/1588230740/.tmp/rep_barrier/e8ac26031a764dc599282d38c513481d as hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/meta/1588230740/rep_barrier/e8ac26031a764dc599282d38c513481d 2024-02-20 18:55:54,994 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e8ac26031a764dc599282d38c513481d 2024-02-20 18:55:54,994 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/meta/1588230740/rep_barrier/e8ac26031a764dc599282d38c513481d, entries=5, sequenceid=66, filesize=5.3 K 2024-02-20 18:55:54,995 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/meta/1588230740/.tmp/table/a09b9d79b7aa47d593c4f36cd5e735de as hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/meta/1588230740/table/a09b9d79b7aa47d593c4f36cd5e735de 2024-02-20 18:55:55,004 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a09b9d79b7aa47d593c4f36cd5e735de 2024-02-20 18:55:55,004 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/meta/1588230740/table/a09b9d79b7aa47d593c4f36cd5e735de, entries=13, sequenceid=66, filesize=5.6 K 2024-02-20 18:55:55,005 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~14.15 KB/14494, heapSize ~25.05 KB/25656, currentSize=0 B/0 for 1588230740 in 139ms, sequenceid=66, compaction requested=false 2024-02-20 18:55:55,013 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/meta/1588230740/recovered.edits/69.seqid, newMaxSeqId=69, maxSeqId=1 2024-02-20 18:55:55,014 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-02-20 18:55:55,014 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-02-20 18:55:55,014 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-02-20 18:55:55,014 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2024-02-20 18:55:55,067 INFO [RS:1;jenkins-hbase4:38947] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,38947,1708455285785; all regions closed. 2024-02-20 18:55:55,067 DEBUG [RS:0;jenkins-hbase4:33065] regionserver.HRegionServer(1507): Waiting on 37a6e0e80f56b427adb85b885a01934e 2024-02-20 18:55:55,067 DEBUG [RS:1;jenkins-hbase4:38947] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-02-20 18:55:55,078 DEBUG [RS:1;jenkins-hbase4:38947] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/oldWALs 2024-02-20 18:55:55,078 INFO [RS:1;jenkins-hbase4:38947] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38947%2C1708455285785.meta:.meta(num 1708455287540) 2024-02-20 18:55:55,085 DEBUG [RS:1;jenkins-hbase4:38947] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/oldWALs 2024-02-20 18:55:55,085 INFO [RS:1;jenkins-hbase4:38947] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38947%2C1708455285785:(num 1708455287284) 2024-02-20 18:55:55,085 DEBUG [RS:1;jenkins-hbase4:38947] ipc.AbstractRpcClient(489): Stopping rpc client 2024-02-20 18:55:55,085 INFO [RS:1;jenkins-hbase4:38947] regionserver.LeaseManager(133): Closed leases 2024-02-20 18:55:55,085 INFO [RS:1;jenkins-hbase4:38947] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2024-02-20 18:55:55,086 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-02-20 18:55:55,086 INFO [RS:1;jenkins-hbase4:38947] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38947 2024-02-20 18:55:55,092 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): regionserver:33065-0x101e5eeafa10001, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38947,1708455285785 2024-02-20 18:55:55,092 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-02-20 18:55:55,092 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): regionserver:33065-0x101e5eeafa10001, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-02-20 18:55:55,092 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): regionserver:38947-0x101e5eeafa10002, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38947,1708455285785 2024-02-20 18:55:55,092 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): regionserver:38947-0x101e5eeafa10002, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-02-20 18:55:55,093 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38947,1708455285785] 2024-02-20 18:55:55,093 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38947,1708455285785; numProcessing=1 2024-02-20 18:55:55,095 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38947,1708455285785 already deleted, retry=false 2024-02-20 18:55:55,095 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,38947,1708455285785 expired; onlineServers=1 2024-02-20 18:55:55,159 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2024-02-20 18:55:55,159 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2024-02-20 18:55:55,195 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): regionserver:38947-0x101e5eeafa10002, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-02-20 18:55:55,195 INFO [RS:1;jenkins-hbase4:38947] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,38947,1708455285785; zookeeper connection closed. 2024-02-20 18:55:55,195 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): regionserver:38947-0x101e5eeafa10002, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-02-20 18:55:55,195 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@1ff260e7] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@1ff260e7 2024-02-20 18:55:55,268 DEBUG [RS:0;jenkins-hbase4:33065] regionserver.HRegionServer(1507): Waiting on 37a6e0e80f56b427adb85b885a01934e 2024-02-20 18:55:55,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=597 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/quota/37a6e0e80f56b427adb85b885a01934e/.tmp/q/49c62ee1508447679f02dadcc95f1c4e 2024-02-20 18:55:55,334 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 49c62ee1508447679f02dadcc95f1c4e 2024-02-20 18:55:55,347 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=129 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/quota/37a6e0e80f56b427adb85b885a01934e/.tmp/u/3c919840ce4043658d03e220051245cf 2024-02-20 18:55:55,354 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3c919840ce4043658d03e220051245cf 2024-02-20 18:55:55,355 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/quota/37a6e0e80f56b427adb85b885a01934e/.tmp/q/49c62ee1508447679f02dadcc95f1c4e as hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/quota/37a6e0e80f56b427adb85b885a01934e/q/49c62ee1508447679f02dadcc95f1c4e 2024-02-20 18:55:55,362 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 49c62ee1508447679f02dadcc95f1c4e 2024-02-20 18:55:55,363 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/quota/37a6e0e80f56b427adb85b885a01934e/q/49c62ee1508447679f02dadcc95f1c4e, entries=5, sequenceid=17, filesize=5.1 K 2024-02-20 18:55:55,364 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/quota/37a6e0e80f56b427adb85b885a01934e/.tmp/u/3c919840ce4043658d03e220051245cf as hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/quota/37a6e0e80f56b427adb85b885a01934e/u/3c919840ce4043658d03e220051245cf 2024-02-20 18:55:55,372 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3c919840ce4043658d03e220051245cf 2024-02-20 18:55:55,372 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/quota/37a6e0e80f56b427adb85b885a01934e/u/3c919840ce4043658d03e220051245cf, entries=4, sequenceid=17, filesize=5.0 K 2024-02-20 18:55:55,373 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~726 B/726, heapSize ~2.41 KB/2464, currentSize=0 B/0 for 37a6e0e80f56b427adb85b885a01934e in 507ms, sequenceid=17, compaction requested=false 2024-02-20 18:55:55,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/data/hbase/quota/37a6e0e80f56b427adb85b885a01934e/recovered.edits/20.seqid, newMaxSeqId=20, maxSeqId=1 2024-02-20 18:55:55,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:quota,,1708455288534.37a6e0e80f56b427adb85b885a01934e. 2024-02-20 18:55:55,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 37a6e0e80f56b427adb85b885a01934e: 2024-02-20 18:55:55,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:quota,,1708455288534.37a6e0e80f56b427adb85b885a01934e. 2024-02-20 18:55:55,468 INFO [RS:0;jenkins-hbase4:33065] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,33065,1708455285736; all regions closed. 2024-02-20 18:55:55,468 DEBUG [RS:0;jenkins-hbase4:33065] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-02-20 18:55:55,476 DEBUG [RS:0;jenkins-hbase4:33065] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/oldWALs 2024-02-20 18:55:55,476 INFO [RS:0;jenkins-hbase4:33065] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33065%2C1708455285736:(num 1708455287284) 2024-02-20 18:55:55,476 DEBUG [RS:0;jenkins-hbase4:33065] ipc.AbstractRpcClient(489): Stopping rpc client 2024-02-20 18:55:55,476 INFO [RS:0;jenkins-hbase4:33065] regionserver.LeaseManager(133): Closed leases 2024-02-20 18:55:55,476 INFO [RS:0;jenkins-hbase4:33065] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2024-02-20 18:55:55,477 INFO [RS:0;jenkins-hbase4:33065] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-02-20 18:55:55,477 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-02-20 18:55:55,477 INFO [RS:0;jenkins-hbase4:33065] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-02-20 18:55:55,477 INFO [RS:0;jenkins-hbase4:33065] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-02-20 18:55:55,477 INFO [RS:0;jenkins-hbase4:33065] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33065 2024-02-20 18:55:55,479 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): regionserver:33065-0x101e5eeafa10001, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33065,1708455285736 2024-02-20 18:55:55,479 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-02-20 18:55:55,480 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33065,1708455285736] 2024-02-20 18:55:55,480 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33065,1708455285736; numProcessing=2 2024-02-20 18:55:55,482 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33065,1708455285736 already deleted, retry=false 2024-02-20 18:55:55,482 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,33065,1708455285736 expired; onlineServers=0 2024-02-20 18:55:55,482 INFO [RegionServerTracker-0] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,36731,1708455284482' ***** 2024-02-20 18:55:55,482 INFO [RegionServerTracker-0] regionserver.HRegionServer(2313): STOPPED: Cluster shutdown set; onlineServer=0 2024-02-20 18:55:55,483 DEBUG [M:0;jenkins-hbase4:36731] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@13004578, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-02-20 18:55:55,483 INFO [M:0;jenkins-hbase4:36731] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,36731,1708455284482 2024-02-20 18:55:55,483 INFO [M:0;jenkins-hbase4:36731] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,36731,1708455284482; all regions closed. 2024-02-20 18:55:55,483 DEBUG [M:0;jenkins-hbase4:36731] ipc.AbstractRpcClient(489): Stopping rpc client 2024-02-20 18:55:55,483 DEBUG [M:0;jenkins-hbase4:36731] cleaner.LogCleaner(198): Cancelling LogCleaner 2024-02-20 18:55:55,483 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2024-02-20 18:55:55,484 DEBUG [M:0;jenkins-hbase4:36731] cleaner.HFileCleaner(317): Stopping file delete threads 2024-02-20 18:55:55,484 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1708455286964] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1708455286964,5,FailOnTimeoutGroup] 2024-02-20 18:55:55,484 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1708455286963] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1708455286963,5,FailOnTimeoutGroup] 2024-02-20 18:55:55,484 INFO [M:0;jenkins-hbase4:36731] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2024-02-20 18:55:55,484 INFO [M:0;jenkins-hbase4:36731] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2024-02-20 18:55:55,484 INFO [M:0;jenkins-hbase4:36731] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS] on shutdown 2024-02-20 18:55:55,484 DEBUG [M:0;jenkins-hbase4:36731] master.HMaster(1517): Stopping service threads 2024-02-20 18:55:55,484 INFO [M:0;jenkins-hbase4:36731] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2024-02-20 18:55:55,485 ERROR [M:0;jenkins-hbase4:36731] procedure2.ProcedureExecutor(699): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-8,5,PEWorkerGroup] Thread[HFileArchiver-9,5,PEWorkerGroup] Thread[HFileArchiver-10,5,PEWorkerGroup] Thread[HFileArchiver-11,5,PEWorkerGroup] Thread[HFileArchiver-12,5,PEWorkerGroup] 2024-02-20 18:55:55,485 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2024-02-20 18:55:55,485 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-20 18:55:55,485 INFO [M:0;jenkins-hbase4:36731] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2024-02-20 18:55:55,485 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2024-02-20 18:55:55,486 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-02-20 18:55:55,486 DEBUG [M:0;jenkins-hbase4:36731] zookeeper.ZKUtil(399): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2024-02-20 18:55:55,486 WARN [M:0;jenkins-hbase4:36731] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2024-02-20 18:55:55,486 INFO [M:0;jenkins-hbase4:36731] assignment.AssignmentManager(315): Stopping assignment manager 2024-02-20 18:55:55,486 INFO [M:0;jenkins-hbase4:36731] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2024-02-20 18:55:55,487 DEBUG [M:0;jenkins-hbase4:36731] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-02-20 18:55:55,487 INFO [M:0;jenkins-hbase4:36731] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-20 18:55:55,487 DEBUG [M:0;jenkins-hbase4:36731] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-20 18:55:55,487 DEBUG [M:0;jenkins-hbase4:36731] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-02-20 18:55:55,487 DEBUG [M:0;jenkins-hbase4:36731] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-20 18:55:55,487 INFO [M:0;jenkins-hbase4:36731] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=153.03 KB heapSize=184.84 KB 2024-02-20 18:55:55,502 INFO [M:0;jenkins-hbase4:36731] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=153.03 KB at sequenceid=376 (bloomFilter=true), to=hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/74cbf88593754f4f8b7936e37d425ace 2024-02-20 18:55:55,508 INFO [M:0;jenkins-hbase4:36731] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 74cbf88593754f4f8b7936e37d425ace 2024-02-20 18:55:55,509 DEBUG [M:0;jenkins-hbase4:36731] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/74cbf88593754f4f8b7936e37d425ace as hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/74cbf88593754f4f8b7936e37d425ace 2024-02-20 18:55:55,516 INFO [M:0;jenkins-hbase4:36731] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 74cbf88593754f4f8b7936e37d425ace 2024-02-20 18:55:55,516 INFO [M:0;jenkins-hbase4:36731] regionserver.HStore(1080): Added hdfs://localhost:39943/user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/74cbf88593754f4f8b7936e37d425ace, entries=45, sequenceid=376, filesize=12.0 K 2024-02-20 18:55:55,517 INFO [M:0;jenkins-hbase4:36731] regionserver.HRegion(2948): Finished flush of dataSize ~153.03 KB/156700, heapSize ~184.82 KB/189256, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 30ms, sequenceid=376, compaction requested=false 2024-02-20 18:55:55,518 INFO [M:0;jenkins-hbase4:36731] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-20 18:55:55,518 DEBUG [M:0;jenkins-hbase4:36731] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-02-20 18:55:55,521 WARN [Close-WAL-Writer-0] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(641): complete file /user/jenkins/test-data/9e3b95ac-d709-d06c-853b-5e876173207d/MasterData/WALs/jenkins-hbase4.apache.org,36731,1708455284482/jenkins-hbase4.apache.org%2C36731%2C1708455284482.1708455286275 not finished, retry = 0 2024-02-20 18:55:55,581 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): regionserver:33065-0x101e5eeafa10001, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-02-20 18:55:55,581 INFO [RS:0;jenkins-hbase4:33065] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,33065,1708455285736; zookeeper connection closed. 2024-02-20 18:55:55,581 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): regionserver:33065-0x101e5eeafa10001, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-02-20 18:55:55,582 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@c153464] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@c153464 2024-02-20 18:55:55,582 INFO [Listener at localhost/36187] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2024-02-20 18:55:55,623 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-02-20 18:55:55,623 INFO [M:0;jenkins-hbase4:36731] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2024-02-20 18:55:55,623 INFO [M:0;jenkins-hbase4:36731] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36731 2024-02-20 18:55:55,625 DEBUG [M:0;jenkins-hbase4:36731] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,36731,1708455284482 already deleted, retry=false 2024-02-20 18:55:55,727 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-02-20 18:55:55,727 INFO [M:0;jenkins-hbase4:36731] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,36731,1708455284482; zookeeper connection closed. 2024-02-20 18:55:55,727 DEBUG [Listener at localhost/36187-EventThread] zookeeper.ZKWatcher(600): master:36731-0x101e5eeafa10000, quorum=127.0.0.1:59580, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-02-20 18:55:55,729 WARN [Listener at localhost/36187] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-02-20 18:55:55,732 INFO [Listener at localhost/36187] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-02-20 18:55:55,836 WARN [BP-2126669188-172.31.14.131-1708455281270 heartbeating to localhost/127.0.0.1:39943] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-02-20 18:55:55,836 WARN [BP-2126669188-172.31.14.131-1708455281270 heartbeating to localhost/127.0.0.1:39943] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2126669188-172.31.14.131-1708455281270 (Datanode Uuid b743e53b-f00a-4b27-9902-1c62c55e594c) service to localhost/127.0.0.1:39943 2024-02-20 18:55:55,838 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/cluster_d91434c1-91b8-dcf4-855b-f2496645ac44/dfs/data/data3/current/BP-2126669188-172.31.14.131-1708455281270] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-02-20 18:55:55,838 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/cluster_d91434c1-91b8-dcf4-855b-f2496645ac44/dfs/data/data4/current/BP-2126669188-172.31.14.131-1708455281270] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-02-20 18:55:55,839 WARN [Listener at localhost/36187] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-02-20 18:55:55,841 INFO [Listener at localhost/36187] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-02-20 18:55:55,945 WARN [BP-2126669188-172.31.14.131-1708455281270 heartbeating to localhost/127.0.0.1:39943] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-02-20 18:55:55,945 WARN [BP-2126669188-172.31.14.131-1708455281270 heartbeating to localhost/127.0.0.1:39943] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2126669188-172.31.14.131-1708455281270 (Datanode Uuid 743ee1c3-758b-4482-869f-a6fd2eb870b8) service to localhost/127.0.0.1:39943 2024-02-20 18:55:55,946 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/cluster_d91434c1-91b8-dcf4-855b-f2496645ac44/dfs/data/data1/current/BP-2126669188-172.31.14.131-1708455281270] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-02-20 18:55:55,946 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/2bf1630a-e3de-f073-9f52-74b4e9983c32/cluster_d91434c1-91b8-dcf4-855b-f2496645ac44/dfs/data/data2/current/BP-2126669188-172.31.14.131-1708455281270] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-02-20 18:55:55,982 INFO [Listener at localhost/36187] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-02-20 18:55:56,097 INFO [Listener at localhost/36187] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2024-02-20 18:55:56,141 INFO [Listener at localhost/36187] hbase.HBaseTestingUtility(1293): Minicluster is down