2024-02-27 13:54:34,676 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle timeout: 13 mins 2024-02-27 13:54:34,896 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092 2024-02-27 13:54:34,911 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2024-02-27 13:54:34,912 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/cluster_7819d6a5-f5a3-e085-7fba-bdd2117692ef, deleteOnExit=true 2024-02-27 13:54:34,912 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2024-02-27 13:54:34,913 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/test.cache.data in system properties and HBase conf 2024-02-27 13:54:34,913 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/hadoop.tmp.dir in system properties and HBase conf 2024-02-27 13:54:34,914 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/hadoop.log.dir in system properties and HBase conf 2024-02-27 13:54:34,914 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/mapreduce.cluster.local.dir in system properties and HBase conf 2024-02-27 13:54:34,915 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/mapreduce.cluster.temp.dir in system properties and HBase conf 2024-02-27 13:54:34,915 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2024-02-27 13:54:35,043 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2024-02-27 13:54:35,465 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-02-27 13:54:35,471 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2024-02-27 13:54:35,471 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2024-02-27 13:54:35,471 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/yarn.nodemanager.log-dirs in system properties and HBase conf 2024-02-27 13:54:35,472 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-02-27 13:54:35,472 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2024-02-27 13:54:35,472 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2024-02-27 13:54:35,473 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-02-27 13:54:35,473 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/dfs.journalnode.edits.dir in system properties and HBase conf 2024-02-27 13:54:35,474 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2024-02-27 13:54:35,474 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/nfs.dump.dir in system properties and HBase conf 2024-02-27 13:54:35,475 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/java.io.tmpdir in system properties and HBase conf 2024-02-27 13:54:35,475 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/dfs.journalnode.edits.dir in system properties and HBase conf 2024-02-27 13:54:35,475 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2024-02-27 13:54:35,475 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2024-02-27 13:54:36,057 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-02-27 13:54:36,062 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-02-27 13:54:36,391 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2024-02-27 13:54:36,565 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2024-02-27 13:54:36,581 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-02-27 13:54:36,617 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2024-02-27 13:54:36,649 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/java.io.tmpdir/Jetty_localhost_45957_hdfs____.bjlwbg/webapp 2024-02-27 13:54:36,775 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45957 2024-02-27 13:54:36,785 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-02-27 13:54:36,785 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-02-27 13:54:37,263 WARN [Listener at localhost/41495] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-02-27 13:54:37,348 WARN [Listener at localhost/41495] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-02-27 13:54:37,371 WARN [Listener at localhost/41495] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-02-27 13:54:37,379 INFO [Listener at localhost/41495] log.Slf4jLog(67): jetty-6.1.26 2024-02-27 13:54:37,384 INFO [Listener at localhost/41495] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/java.io.tmpdir/Jetty_localhost_45767_datanode____.9pqzr6/webapp 2024-02-27 13:54:37,482 INFO [Listener at localhost/41495] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:45767 2024-02-27 13:54:37,794 WARN [Listener at localhost/45643] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-02-27 13:54:37,810 WARN [Listener at localhost/45643] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-02-27 13:54:37,814 WARN [Listener at localhost/45643] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-02-27 13:54:37,817 INFO [Listener at localhost/45643] log.Slf4jLog(67): jetty-6.1.26 2024-02-27 13:54:37,827 INFO [Listener at localhost/45643] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/java.io.tmpdir/Jetty_localhost_33433_datanode____pilzbv/webapp 2024-02-27 13:54:37,936 INFO [Listener at localhost/45643] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:33433 2024-02-27 13:54:37,944 WARN [Listener at localhost/33159] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-02-27 13:54:38,284 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xafacd1729334940: Processing first storage report for DS-4a99446b-b165-4467-85b6-d60926d94d4c from datanode d3d1c02e-155d-49c4-b45e-9e943a6cc416 2024-02-27 13:54:38,287 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xafacd1729334940: from storage DS-4a99446b-b165-4467-85b6-d60926d94d4c node DatanodeRegistration(127.0.0.1:34401, datanodeUuid=d3d1c02e-155d-49c4-b45e-9e943a6cc416, infoPort=33375, infoSecurePort=0, ipcPort=45643, storageInfo=lv=-57;cid=testClusterID;nsid=1363017354;c=1709042076152), blocks: 0, hasStaleStorage: true, processing time: 3 msecs, invalidatedBlocks: 0 2024-02-27 13:54:38,287 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfd4f0a2a2b9b9cbe: Processing first storage report for DS-3635241f-6e99-4434-b2c4-1dbc903af692 from datanode 9252af07-b9ae-490b-9329-61fec675ec09 2024-02-27 13:54:38,288 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfd4f0a2a2b9b9cbe: from storage DS-3635241f-6e99-4434-b2c4-1dbc903af692 node DatanodeRegistration(127.0.0.1:43027, datanodeUuid=9252af07-b9ae-490b-9329-61fec675ec09, infoPort=35749, infoSecurePort=0, ipcPort=33159, storageInfo=lv=-57;cid=testClusterID;nsid=1363017354;c=1709042076152), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2024-02-27 13:54:38,288 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xafacd1729334940: Processing first storage report for DS-2a7cfdce-044c-44dc-9bef-1076628de954 from datanode d3d1c02e-155d-49c4-b45e-9e943a6cc416 2024-02-27 13:54:38,288 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xafacd1729334940: from storage DS-2a7cfdce-044c-44dc-9bef-1076628de954 node DatanodeRegistration(127.0.0.1:34401, datanodeUuid=d3d1c02e-155d-49c4-b45e-9e943a6cc416, infoPort=33375, infoSecurePort=0, ipcPort=45643, storageInfo=lv=-57;cid=testClusterID;nsid=1363017354;c=1709042076152), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-02-27 13:54:38,288 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xfd4f0a2a2b9b9cbe: Processing first storage report for DS-aa4080fb-1397-48a1-869e-b7b48e3bcc48 from datanode 9252af07-b9ae-490b-9329-61fec675ec09 2024-02-27 13:54:38,288 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xfd4f0a2a2b9b9cbe: from storage DS-aa4080fb-1397-48a1-869e-b7b48e3bcc48 node DatanodeRegistration(127.0.0.1:43027, datanodeUuid=9252af07-b9ae-490b-9329-61fec675ec09, infoPort=35749, infoSecurePort=0, ipcPort=33159, storageInfo=lv=-57;cid=testClusterID;nsid=1363017354;c=1709042076152), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2024-02-27 13:54:38,371 DEBUG [Listener at localhost/33159] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092 2024-02-27 13:54:38,513 INFO [Listener at localhost/33159] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/cluster_7819d6a5-f5a3-e085-7fba-bdd2117692ef/zookeeper_0, clientPort=60991, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/cluster_7819d6a5-f5a3-e085-7fba-bdd2117692ef/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/cluster_7819d6a5-f5a3-e085-7fba-bdd2117692ef/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2024-02-27 13:54:38,529 INFO [Listener at localhost/33159] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=60991 2024-02-27 13:54:38,541 INFO [Listener at localhost/33159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-27 13:54:38,543 INFO [Listener at localhost/33159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-27 13:54:39,214 INFO [Listener at localhost/33159] util.FSUtils(471): Created version file at hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be with version=8 2024-02-27 13:54:39,214 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/hbase-staging 2024-02-27 13:54:39,546 INFO [Listener at localhost/33159] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2024-02-27 13:54:40,068 INFO [Listener at localhost/33159] client.ConnectionUtils(126): master/jenkins-hbase4:0 server-side Connection retries=45 2024-02-27 13:54:40,103 INFO [Listener at localhost/33159] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-02-27 13:54:40,103 INFO [Listener at localhost/33159] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-02-27 13:54:40,104 INFO [Listener at localhost/33159] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-02-27 13:54:40,104 INFO [Listener at localhost/33159] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-02-27 13:54:40,104 INFO [Listener at localhost/33159] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-02-27 13:54:40,257 INFO [Listener at localhost/33159] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2024-02-27 13:54:40,334 DEBUG [Listener at localhost/33159] util.ClassSize(228): Using Unsafe to estimate memory layout 2024-02-27 13:54:40,434 INFO [Listener at localhost/33159] ipc.NettyRpcServer(120): Bind to /172.31.14.131:41827 2024-02-27 13:54:40,444 INFO [Listener at localhost/33159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-27 13:54:40,446 INFO [Listener at localhost/33159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-27 13:54:40,468 INFO [Listener at localhost/33159] zookeeper.RecoverableZooKeeper(93): Process identifier=master:41827 connecting to ZooKeeper ensemble=127.0.0.1:60991 2024-02-27 13:54:40,513 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:418270x0, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-02-27 13:54:40,515 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:41827-0x10010395a8b0000 connected 2024-02-27 13:54:40,546 DEBUG [Listener at localhost/33159] zookeeper.ZKUtil(165): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-02-27 13:54:40,547 DEBUG [Listener at localhost/33159] zookeeper.ZKUtil(165): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-02-27 13:54:40,550 DEBUG [Listener at localhost/33159] zookeeper.ZKUtil(165): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-02-27 13:54:40,559 DEBUG [Listener at localhost/33159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=41827 2024-02-27 13:54:40,559 DEBUG [Listener at localhost/33159] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=41827 2024-02-27 13:54:40,559 DEBUG [Listener at localhost/33159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=41827 2024-02-27 13:54:40,560 DEBUG [Listener at localhost/33159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=41827 2024-02-27 13:54:40,560 DEBUG [Listener at localhost/33159] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=41827 2024-02-27 13:54:40,566 INFO [Listener at localhost/33159] master.HMaster(445): hbase.rootdir=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be, hbase.cluster.distributed=false 2024-02-27 13:54:40,637 INFO [Listener at localhost/33159] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-02-27 13:54:40,637 INFO [Listener at localhost/33159] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-02-27 13:54:40,637 INFO [Listener at localhost/33159] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-02-27 13:54:40,638 INFO [Listener at localhost/33159] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-02-27 13:54:40,638 INFO [Listener at localhost/33159] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-02-27 13:54:40,638 INFO [Listener at localhost/33159] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-02-27 13:54:40,643 INFO [Listener at localhost/33159] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-02-27 13:54:40,646 INFO [Listener at localhost/33159] ipc.NettyRpcServer(120): Bind to /172.31.14.131:36357 2024-02-27 13:54:40,648 INFO [Listener at localhost/33159] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-02-27 13:54:40,655 DEBUG [Listener at localhost/33159] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-02-27 13:54:40,656 INFO [Listener at localhost/33159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-27 13:54:40,658 INFO [Listener at localhost/33159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-27 13:54:40,660 INFO [Listener at localhost/33159] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:36357 connecting to ZooKeeper ensemble=127.0.0.1:60991 2024-02-27 13:54:40,664 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): regionserver:363570x0, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-02-27 13:54:40,665 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:36357-0x10010395a8b0001 connected 2024-02-27 13:54:40,665 DEBUG [Listener at localhost/33159] zookeeper.ZKUtil(165): regionserver:36357-0x10010395a8b0001, quorum=127.0.0.1:60991, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-02-27 13:54:40,667 DEBUG [Listener at localhost/33159] zookeeper.ZKUtil(165): regionserver:36357-0x10010395a8b0001, quorum=127.0.0.1:60991, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-02-27 13:54:40,668 DEBUG [Listener at localhost/33159] zookeeper.ZKUtil(165): regionserver:36357-0x10010395a8b0001, quorum=127.0.0.1:60991, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-02-27 13:54:40,668 DEBUG [Listener at localhost/33159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=36357 2024-02-27 13:54:40,669 DEBUG [Listener at localhost/33159] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=36357 2024-02-27 13:54:40,669 DEBUG [Listener at localhost/33159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=36357 2024-02-27 13:54:40,673 DEBUG [Listener at localhost/33159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=36357 2024-02-27 13:54:40,674 DEBUG [Listener at localhost/33159] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=36357 2024-02-27 13:54:40,687 INFO [Listener at localhost/33159] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-02-27 13:54:40,687 INFO [Listener at localhost/33159] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-02-27 13:54:40,687 INFO [Listener at localhost/33159] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-02-27 13:54:40,687 INFO [Listener at localhost/33159] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-02-27 13:54:40,688 INFO [Listener at localhost/33159] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-02-27 13:54:40,688 INFO [Listener at localhost/33159] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-02-27 13:54:40,688 INFO [Listener at localhost/33159] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-02-27 13:54:40,689 INFO [Listener at localhost/33159] ipc.NettyRpcServer(120): Bind to /172.31.14.131:33695 2024-02-27 13:54:40,690 INFO [Listener at localhost/33159] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-02-27 13:54:40,691 DEBUG [Listener at localhost/33159] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-02-27 13:54:40,692 INFO [Listener at localhost/33159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-27 13:54:40,694 INFO [Listener at localhost/33159] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-27 13:54:40,697 INFO [Listener at localhost/33159] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:33695 connecting to ZooKeeper ensemble=127.0.0.1:60991 2024-02-27 13:54:40,703 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): regionserver:336950x0, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-02-27 13:54:40,704 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:33695-0x10010395a8b0002 connected 2024-02-27 13:54:40,704 DEBUG [Listener at localhost/33159] zookeeper.ZKUtil(165): regionserver:33695-0x10010395a8b0002, quorum=127.0.0.1:60991, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-02-27 13:54:40,705 DEBUG [Listener at localhost/33159] zookeeper.ZKUtil(165): regionserver:33695-0x10010395a8b0002, quorum=127.0.0.1:60991, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-02-27 13:54:40,706 DEBUG [Listener at localhost/33159] zookeeper.ZKUtil(165): regionserver:33695-0x10010395a8b0002, quorum=127.0.0.1:60991, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-02-27 13:54:40,707 DEBUG [Listener at localhost/33159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=33695 2024-02-27 13:54:40,707 DEBUG [Listener at localhost/33159] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=33695 2024-02-27 13:54:40,709 DEBUG [Listener at localhost/33159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=33695 2024-02-27 13:54:40,713 DEBUG [Listener at localhost/33159] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=33695 2024-02-27 13:54:40,714 DEBUG [Listener at localhost/33159] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=33695 2024-02-27 13:54:40,715 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2174): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,41827,1709042079370 2024-02-27 13:54:40,725 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-02-27 13:54:40,728 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,41827,1709042079370 2024-02-27 13:54:40,748 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): regionserver:33695-0x10010395a8b0002, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-02-27 13:54:40,748 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-02-27 13:54:40,748 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): regionserver:36357-0x10010395a8b0001, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-02-27 13:54:40,748 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-27 13:54:40,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-02-27 13:54:40,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,41827,1709042079370 from backup master directory 2024-02-27 13:54:40,752 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(163): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-02-27 13:54:40,755 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,41827,1709042079370 2024-02-27 13:54:40,755 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-02-27 13:54:40,756 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-02-27 13:54:40,756 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,41827,1709042079370 2024-02-27 13:54:40,760 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2024-02-27 13:54:40,761 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2024-02-27 13:54:40,854 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/hbase.id with ID: e010b119-1ba4-4818-ab33-f8cc8aa203f3 2024-02-27 13:54:40,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-02-27 13:54:40,915 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-27 13:54:40,961 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x761f6445 to 127.0.0.1:60991 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-02-27 13:54:40,996 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@a898e56, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-02-27 13:54:41,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-02-27 13:54:41,023 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2024-02-27 13:54:41,041 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2024-02-27 13:54:41,041 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2024-02-27 13:54:41,043 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-02-27 13:54:41,048 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-02-27 13:54:41,049 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-02-27 13:54:41,085 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/MasterData/data/master/store-tmp 2024-02-27 13:54:41,122 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 13:54:41,122 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-02-27 13:54:41,122 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-27 13:54:41,122 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-27 13:54:41,122 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-02-27 13:54:41,122 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-27 13:54:41,123 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-27 13:54:41,123 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-02-27 13:54:41,125 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/MasterData/WALs/jenkins-hbase4.apache.org,41827,1709042079370 2024-02-27 13:54:41,146 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C41827%2C1709042079370, suffix=, logDir=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/MasterData/WALs/jenkins-hbase4.apache.org,41827,1709042079370, archiveDir=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/MasterData/oldWALs, maxLogs=10 2024-02-27 13:54:41,209 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34401,DS-4a99446b-b165-4467-85b6-d60926d94d4c,DISK] 2024-02-27 13:54:41,209 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43027,DS-3635241f-6e99-4434-b2c4-1dbc903af692,DISK] 2024-02-27 13:54:41,220 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2024-02-27 13:54:41,307 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/MasterData/WALs/jenkins-hbase4.apache.org,41827,1709042079370/jenkins-hbase4.apache.org%2C41827%2C1709042079370.1709042081157 2024-02-27 13:54:41,307 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43027,DS-3635241f-6e99-4434-b2c4-1dbc903af692,DISK], DatanodeInfoWithStorage[127.0.0.1:34401,DS-4a99446b-b165-4467-85b6-d60926d94d4c,DISK]] 2024-02-27 13:54:41,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2024-02-27 13:54:41,308 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 13:54:41,312 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2024-02-27 13:54:41,313 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2024-02-27 13:54:41,372 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2024-02-27 13:54:41,380 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2024-02-27 13:54:41,406 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2024-02-27 13:54:41,421 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 13:54:41,427 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-02-27 13:54:41,429 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-02-27 13:54:41,445 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2024-02-27 13:54:41,449 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-27 13:54:41,450 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63972182, jitterRate=-0.046740204095840454}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-02-27 13:54:41,451 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2024-02-27 13:54:41,452 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2024-02-27 13:54:41,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2024-02-27 13:54:41,473 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(608): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2024-02-27 13:54:41,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2024-02-27 13:54:41,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(628): Recovered RegionProcedureStore lease in 1 msec 2024-02-27 13:54:41,512 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(642): Loaded RegionProcedureStore in 34 msec 2024-02-27 13:54:41,512 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2024-02-27 13:54:41,539 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2024-02-27 13:54:41,545 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2024-02-27 13:54:41,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2024-02-27 13:54:41,574 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2024-02-27 13:54:41,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2024-02-27 13:54:41,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2024-02-27 13:54:41,586 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2024-02-27 13:54:41,590 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-27 13:54:41,592 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2024-02-27 13:54:41,592 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2024-02-27 13:54:41,610 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2024-02-27 13:54:41,615 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): regionserver:33695-0x10010395a8b0002, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-02-27 13:54:41,615 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): regionserver:36357-0x10010395a8b0001, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-02-27 13:54:41,615 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-02-27 13:54:41,616 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-27 13:54:41,617 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(745): Active/primary master=jenkins-hbase4.apache.org,41827,1709042079370, sessionid=0x10010395a8b0000, setting cluster-up flag (Was=false) 2024-02-27 13:54:41,634 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-27 13:54:41,640 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2024-02-27 13:54:41,642 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41827,1709042079370 2024-02-27 13:54:41,647 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-27 13:54:41,654 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2024-02-27 13:54:41,656 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,41827,1709042079370 2024-02-27 13:54:41,658 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.hbase-snapshot/.tmp 2024-02-27 13:54:41,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver loaded, priority=536870911. 2024-02-27 13:54:41,718 INFO [RS:0;jenkins-hbase4:36357] regionserver.HRegionServer(954): ClusterId : e010b119-1ba4-4818-ab33-f8cc8aa203f3 2024-02-27 13:54:41,718 INFO [RS:1;jenkins-hbase4:33695] regionserver.HRegionServer(954): ClusterId : e010b119-1ba4-4818-ab33-f8cc8aa203f3 2024-02-27 13:54:41,723 DEBUG [RS:0;jenkins-hbase4:36357] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-02-27 13:54:41,723 DEBUG [RS:1;jenkins-hbase4:33695] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-02-27 13:54:41,730 DEBUG [RS:0;jenkins-hbase4:36357] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-02-27 13:54:41,730 DEBUG [RS:1;jenkins-hbase4:33695] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-02-27 13:54:41,730 DEBUG [RS:0;jenkins-hbase4:36357] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-02-27 13:54:41,730 DEBUG [RS:1;jenkins-hbase4:33695] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-02-27 13:54:41,734 DEBUG [RS:0;jenkins-hbase4:36357] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-02-27 13:54:41,736 DEBUG [RS:1;jenkins-hbase4:33695] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-02-27 13:54:41,738 DEBUG [RS:0;jenkins-hbase4:36357] zookeeper.ReadOnlyZKClient(139): Connect 0x1b5602ff to 127.0.0.1:60991 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-02-27 13:54:41,741 DEBUG [RS:1;jenkins-hbase4:33695] zookeeper.ReadOnlyZKClient(139): Connect 0x1b810415 to 127.0.0.1:60991 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-02-27 13:54:41,746 DEBUG [RS:0;jenkins-hbase4:36357] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1591ffe5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-02-27 13:54:41,747 DEBUG [RS:0;jenkins-hbase4:36357] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11ae698f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-02-27 13:54:41,747 DEBUG [RS:1;jenkins-hbase4:33695] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1546e915, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-02-27 13:54:41,747 DEBUG [RS:1;jenkins-hbase4:33695] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@11796f65, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-02-27 13:54:41,774 DEBUG [RS:0;jenkins-hbase4:36357] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:36357 2024-02-27 13:54:41,778 INFO [RS:0;jenkins-hbase4:36357] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-02-27 13:54:41,778 INFO [RS:0;jenkins-hbase4:36357] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-02-27 13:54:41,778 DEBUG [RS:0;jenkins-hbase4:36357] regionserver.HRegionServer(1025): About to register with Master. 2024-02-27 13:54:41,779 DEBUG [RS:1;jenkins-hbase4:33695] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:33695 2024-02-27 13:54:41,780 INFO [RS:1;jenkins-hbase4:33695] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-02-27 13:54:41,780 INFO [RS:1;jenkins-hbase4:33695] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-02-27 13:54:41,780 DEBUG [RS:1;jenkins-hbase4:33695] regionserver.HRegionServer(1025): About to register with Master. 2024-02-27 13:54:41,783 INFO [RS:1;jenkins-hbase4:33695] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase4.apache.org,41827,1709042079370 with isa=jenkins-hbase4.apache.org/172.31.14.131:33695, startcode=1709042080686 2024-02-27 13:54:41,783 INFO [RS:0;jenkins-hbase4:36357] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase4.apache.org,41827,1709042079370 with isa=jenkins-hbase4.apache.org/172.31.14.131:36357, startcode=1709042080636 2024-02-27 13:54:41,788 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2024-02-27 13:54:41,798 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-02-27 13:54:41,798 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-02-27 13:54:41,798 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-02-27 13:54:41,798 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-02-27 13:54:41,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2024-02-27 13:54:41,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 13:54:41,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-02-27 13:54:41,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 13:54:41,800 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1709042111800 2024-02-27 13:54:41,800 DEBUG [RS:1;jenkins-hbase4:33695] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-02-27 13:54:41,800 DEBUG [RS:0;jenkins-hbase4:36357] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-02-27 13:54:41,803 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2024-02-27 13:54:41,809 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2024-02-27 13:54:41,809 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2024-02-27 13:54:41,814 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2024-02-27 13:54:41,816 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-02-27 13:54:41,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2024-02-27 13:54:41,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2024-02-27 13:54:41,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2024-02-27 13:54:41,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2024-02-27 13:54:41,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:41,835 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2024-02-27 13:54:41,837 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2024-02-27 13:54:41,838 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2024-02-27 13:54:41,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2024-02-27 13:54:41,842 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2024-02-27 13:54:41,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1709042081844,5,FailOnTimeoutGroup] 2024-02-27 13:54:41,850 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1709042081850,5,FailOnTimeoutGroup] 2024-02-27 13:54:41,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:41,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1466): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2024-02-27 13:54:41,852 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:41,853 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:41,870 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-02-27 13:54:41,871 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-02-27 13:54:41,872 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be 2024-02-27 13:54:41,872 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43129, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2024-02-27 13:54:41,872 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47117, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2024-02-27 13:54:41,889 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41827] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:54:41,894 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 13:54:41,898 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-02-27 13:54:41,901 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/meta/1588230740/info 2024-02-27 13:54:41,902 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-02-27 13:54:41,903 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 13:54:41,903 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-02-27 13:54:41,906 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/meta/1588230740/rep_barrier 2024-02-27 13:54:41,907 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-02-27 13:54:41,908 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 13:54:41,908 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-02-27 13:54:41,908 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=41827] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,33695,1709042080686 2024-02-27 13:54:41,912 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/meta/1588230740/table 2024-02-27 13:54:41,913 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-02-27 13:54:41,914 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 13:54:41,915 DEBUG [RS:1;jenkins-hbase4:33695] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be 2024-02-27 13:54:41,915 DEBUG [RS:0;jenkins-hbase4:36357] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be 2024-02-27 13:54:41,916 DEBUG [RS:0;jenkins-hbase4:36357] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:41495 2024-02-27 13:54:41,916 DEBUG [RS:1;jenkins-hbase4:33695] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:41495 2024-02-27 13:54:41,916 DEBUG [RS:0;jenkins-hbase4:36357] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-02-27 13:54:41,916 DEBUG [RS:1;jenkins-hbase4:33695] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-02-27 13:54:41,916 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/meta/1588230740 2024-02-27 13:54:41,917 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/meta/1588230740 2024-02-27 13:54:41,921 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-02-27 13:54:41,924 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2024-02-27 13:54:41,926 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-02-27 13:54:41,928 DEBUG [RS:1;jenkins-hbase4:33695] zookeeper.ZKUtil(163): regionserver:33695-0x10010395a8b0002, quorum=127.0.0.1:60991, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33695,1709042080686 2024-02-27 13:54:41,928 WARN [RS:1;jenkins-hbase4:33695] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-02-27 13:54:41,929 INFO [RS:1;jenkins-hbase4:33695] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-02-27 13:54:41,930 DEBUG [RS:1;jenkins-hbase4:33695] regionserver.HRegionServer(1950): logDir=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/WALs/jenkins-hbase4.apache.org,33695,1709042080686 2024-02-27 13:54:41,931 DEBUG [RS:0;jenkins-hbase4:36357] zookeeper.ZKUtil(163): regionserver:36357-0x10010395a8b0001, quorum=127.0.0.1:60991, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:54:41,931 WARN [RS:0;jenkins-hbase4:36357] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-02-27 13:54:41,932 INFO [RS:0;jenkins-hbase4:36357] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-02-27 13:54:41,932 DEBUG [RS:0;jenkins-hbase4:36357] regionserver.HRegionServer(1950): logDir=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/WALs/jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:54:41,933 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,33695,1709042080686] 2024-02-27 13:54:41,933 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,36357,1709042080636] 2024-02-27 13:54:41,933 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-27 13:54:41,935 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70486114, jitterRate=0.050324946641922}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-02-27 13:54:41,936 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2024-02-27 13:54:41,936 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-02-27 13:54:41,936 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-02-27 13:54:41,936 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-02-27 13:54:41,936 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-02-27 13:54:41,936 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-02-27 13:54:41,938 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-02-27 13:54:41,939 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-02-27 13:54:41,943 DEBUG [RS:0;jenkins-hbase4:36357] zookeeper.ZKUtil(163): regionserver:36357-0x10010395a8b0001, quorum=127.0.0.1:60991, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33695,1709042080686 2024-02-27 13:54:41,943 DEBUG [RS:1;jenkins-hbase4:33695] zookeeper.ZKUtil(163): regionserver:33695-0x10010395a8b0002, quorum=127.0.0.1:60991, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,33695,1709042080686 2024-02-27 13:54:41,944 DEBUG [RS:0;jenkins-hbase4:36357] zookeeper.ZKUtil(163): regionserver:36357-0x10010395a8b0001, quorum=127.0.0.1:60991, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:54:41,944 DEBUG [RS:1;jenkins-hbase4:33695] zookeeper.ZKUtil(163): regionserver:33695-0x10010395a8b0002, quorum=127.0.0.1:60991, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:54:41,945 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2024-02-27 13:54:41,945 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2024-02-27 13:54:41,953 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2024-02-27 13:54:41,956 DEBUG [RS:1;jenkins-hbase4:33695] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-02-27 13:54:41,956 DEBUG [RS:0;jenkins-hbase4:36357] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-02-27 13:54:41,966 INFO [RS:0;jenkins-hbase4:36357] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-02-27 13:54:41,966 INFO [RS:1;jenkins-hbase4:33695] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-02-27 13:54:41,966 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2024-02-27 13:54:41,969 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2024-02-27 13:54:41,992 INFO [RS:1;jenkins-hbase4:33695] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-02-27 13:54:41,992 INFO [RS:0;jenkins-hbase4:36357] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-02-27 13:54:41,996 INFO [RS:0;jenkins-hbase4:36357] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-02-27 13:54:41,996 INFO [RS:1;jenkins-hbase4:33695] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-02-27 13:54:41,996 INFO [RS:0;jenkins-hbase4:36357] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:41,997 INFO [RS:1;jenkins-hbase4:33695] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:41,998 INFO [RS:1;jenkins-hbase4:33695] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-02-27 13:54:41,998 INFO [RS:0;jenkins-hbase4:36357] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-02-27 13:54:42,006 INFO [RS:0;jenkins-hbase4:36357] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:42,006 INFO [RS:1;jenkins-hbase4:33695] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:42,006 DEBUG [RS:0;jenkins-hbase4:36357] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 13:54:42,007 DEBUG [RS:1;jenkins-hbase4:33695] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 13:54:42,007 DEBUG [RS:0;jenkins-hbase4:36357] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 13:54:42,007 DEBUG [RS:1;jenkins-hbase4:33695] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 13:54:42,007 DEBUG [RS:0;jenkins-hbase4:36357] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 13:54:42,007 DEBUG [RS:1;jenkins-hbase4:33695] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 13:54:42,007 DEBUG [RS:0;jenkins-hbase4:36357] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 13:54:42,007 DEBUG [RS:1;jenkins-hbase4:33695] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 13:54:42,007 DEBUG [RS:0;jenkins-hbase4:36357] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 13:54:42,007 DEBUG [RS:1;jenkins-hbase4:33695] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 13:54:42,007 DEBUG [RS:0;jenkins-hbase4:36357] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-02-27 13:54:42,007 DEBUG [RS:1;jenkins-hbase4:33695] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-02-27 13:54:42,007 DEBUG [RS:0;jenkins-hbase4:36357] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 13:54:42,008 DEBUG [RS:1;jenkins-hbase4:33695] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 13:54:42,008 DEBUG [RS:0;jenkins-hbase4:36357] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 13:54:42,008 DEBUG [RS:1;jenkins-hbase4:33695] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 13:54:42,008 DEBUG [RS:0;jenkins-hbase4:36357] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 13:54:42,008 DEBUG [RS:1;jenkins-hbase4:33695] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 13:54:42,008 DEBUG [RS:0;jenkins-hbase4:36357] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 13:54:42,008 DEBUG [RS:1;jenkins-hbase4:33695] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-02-27 13:54:42,012 INFO [RS:0;jenkins-hbase4:36357] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:42,012 INFO [RS:1;jenkins-hbase4:33695] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:42,012 INFO [RS:0;jenkins-hbase4:36357] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:42,012 INFO [RS:1;jenkins-hbase4:33695] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:42,013 INFO [RS:0;jenkins-hbase4:36357] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:42,013 INFO [RS:1;jenkins-hbase4:33695] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:42,013 INFO [RS:0;jenkins-hbase4:36357] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:42,013 INFO [RS:1;jenkins-hbase4:33695] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:42,031 INFO [RS:1;jenkins-hbase4:33695] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-02-27 13:54:42,031 INFO [RS:0;jenkins-hbase4:36357] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-02-27 13:54:42,034 INFO [RS:1;jenkins-hbase4:33695] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,33695,1709042080686-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:42,034 INFO [RS:0;jenkins-hbase4:36357] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,36357,1709042080636-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:42,053 INFO [RS:1;jenkins-hbase4:33695] regionserver.Replication(203): jenkins-hbase4.apache.org,33695,1709042080686 started 2024-02-27 13:54:42,053 INFO [RS:0;jenkins-hbase4:36357] regionserver.Replication(203): jenkins-hbase4.apache.org,36357,1709042080636 started 2024-02-27 13:54:42,053 INFO [RS:1;jenkins-hbase4:33695] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,33695,1709042080686, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:33695, sessionid=0x10010395a8b0002 2024-02-27 13:54:42,053 INFO [RS:0;jenkins-hbase4:36357] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,36357,1709042080636, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:36357, sessionid=0x10010395a8b0001 2024-02-27 13:54:42,053 DEBUG [RS:1;jenkins-hbase4:33695] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-02-27 13:54:42,053 DEBUG [RS:0;jenkins-hbase4:36357] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-02-27 13:54:42,054 DEBUG [RS:1;jenkins-hbase4:33695] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,33695,1709042080686 2024-02-27 13:54:42,054 DEBUG [RS:0;jenkins-hbase4:36357] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:54:42,054 DEBUG [RS:1;jenkins-hbase4:33695] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33695,1709042080686' 2024-02-27 13:54:42,054 DEBUG [RS:0;jenkins-hbase4:36357] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36357,1709042080636' 2024-02-27 13:54:42,055 DEBUG [RS:0;jenkins-hbase4:36357] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-02-27 13:54:42,055 DEBUG [RS:1;jenkins-hbase4:33695] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-02-27 13:54:42,056 DEBUG [RS:0;jenkins-hbase4:36357] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-02-27 13:54:42,056 DEBUG [RS:1;jenkins-hbase4:33695] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-02-27 13:54:42,057 DEBUG [RS:0;jenkins-hbase4:36357] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-02-27 13:54:42,057 DEBUG [RS:1;jenkins-hbase4:33695] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-02-27 13:54:42,057 DEBUG [RS:0;jenkins-hbase4:36357] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-02-27 13:54:42,057 DEBUG [RS:1;jenkins-hbase4:33695] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-02-27 13:54:42,057 DEBUG [RS:0;jenkins-hbase4:36357] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:54:42,057 DEBUG [RS:1;jenkins-hbase4:33695] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,33695,1709042080686 2024-02-27 13:54:42,058 DEBUG [RS:1;jenkins-hbase4:33695] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,33695,1709042080686' 2024-02-27 13:54:42,058 DEBUG [RS:1;jenkins-hbase4:33695] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-02-27 13:54:42,058 DEBUG [RS:0;jenkins-hbase4:36357] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,36357,1709042080636' 2024-02-27 13:54:42,058 DEBUG [RS:0;jenkins-hbase4:36357] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-02-27 13:54:42,059 DEBUG [RS:1;jenkins-hbase4:33695] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-02-27 13:54:42,059 DEBUG [RS:0;jenkins-hbase4:36357] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-02-27 13:54:42,059 DEBUG [RS:1;jenkins-hbase4:33695] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-02-27 13:54:42,060 DEBUG [RS:0;jenkins-hbase4:36357] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-02-27 13:54:42,060 INFO [RS:1;jenkins-hbase4:33695] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-02-27 13:54:42,060 INFO [RS:0;jenkins-hbase4:36357] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-02-27 13:54:42,063 INFO [RS:0;jenkins-hbase4:36357] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:42,063 INFO [RS:1;jenkins-hbase4:33695] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:42,063 DEBUG [RS:0;jenkins-hbase4:36357] zookeeper.ZKUtil(399): regionserver:36357-0x10010395a8b0001, quorum=127.0.0.1:60991, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-02-27 13:54:42,064 DEBUG [RS:1;jenkins-hbase4:33695] zookeeper.ZKUtil(399): regionserver:33695-0x10010395a8b0002, quorum=127.0.0.1:60991, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-02-27 13:54:42,064 INFO [RS:0;jenkins-hbase4:36357] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-02-27 13:54:42,064 INFO [RS:1;jenkins-hbase4:33695] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-02-27 13:54:42,064 INFO [RS:0;jenkins-hbase4:36357] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:42,064 INFO [RS:1;jenkins-hbase4:33695] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:42,065 INFO [RS:0;jenkins-hbase4:36357] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:42,065 INFO [RS:1;jenkins-hbase4:33695] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:42,121 DEBUG [jenkins-hbase4:41827] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=2, allServersCount=2 2024-02-27 13:54:42,125 DEBUG [jenkins-hbase4:41827] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-02-27 13:54:42,132 DEBUG [jenkins-hbase4:41827] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-02-27 13:54:42,132 DEBUG [jenkins-hbase4:41827] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-02-27 13:54:42,132 DEBUG [jenkins-hbase4:41827] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-02-27 13:54:42,135 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36357,1709042080636, state=OPENING 2024-02-27 13:54:42,143 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2024-02-27 13:54:42,145 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-27 13:54:42,146 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-02-27 13:54:42,149 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36357,1709042080636}] 2024-02-27 13:54:42,181 INFO [RS:0;jenkins-hbase4:36357] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36357%2C1709042080636, suffix=, logDir=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/WALs/jenkins-hbase4.apache.org,36357,1709042080636, archiveDir=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/oldWALs, maxLogs=32 2024-02-27 13:54:42,181 INFO [RS:1;jenkins-hbase4:33695] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C33695%2C1709042080686, suffix=, logDir=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/WALs/jenkins-hbase4.apache.org,33695,1709042080686, archiveDir=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/oldWALs, maxLogs=32 2024-02-27 13:54:42,242 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43027,DS-3635241f-6e99-4434-b2c4-1dbc903af692,DISK] 2024-02-27 13:54:42,242 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34401,DS-4a99446b-b165-4467-85b6-d60926d94d4c,DISK] 2024-02-27 13:54:42,244 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34401,DS-4a99446b-b165-4467-85b6-d60926d94d4c,DISK] 2024-02-27 13:54:42,245 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43027,DS-3635241f-6e99-4434-b2c4-1dbc903af692,DISK] 2024-02-27 13:54:42,255 INFO [RS:0;jenkins-hbase4:36357] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/WALs/jenkins-hbase4.apache.org,36357,1709042080636/jenkins-hbase4.apache.org%2C36357%2C1709042080636.1709042082187 2024-02-27 13:54:42,255 INFO [RS:1;jenkins-hbase4:33695] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/WALs/jenkins-hbase4.apache.org,33695,1709042080686/jenkins-hbase4.apache.org%2C33695%2C1709042080686.1709042082187 2024-02-27 13:54:42,255 DEBUG [RS:0;jenkins-hbase4:36357] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:34401,DS-4a99446b-b165-4467-85b6-d60926d94d4c,DISK], DatanodeInfoWithStorage[127.0.0.1:43027,DS-3635241f-6e99-4434-b2c4-1dbc903af692,DISK]] 2024-02-27 13:54:42,256 DEBUG [RS:1;jenkins-hbase4:33695] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43027,DS-3635241f-6e99-4434-b2c4-1dbc903af692,DISK], DatanodeInfoWithStorage[127.0.0.1:34401,DS-4a99446b-b165-4467-85b6-d60926d94d4c,DISK]] 2024-02-27 13:54:42,336 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:54:42,338 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-02-27 13:54:42,342 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36840, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-02-27 13:54:42,354 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2024-02-27 13:54:42,354 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-02-27 13:54:42,358 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C36357%2C1709042080636.meta, suffix=.meta, logDir=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/WALs/jenkins-hbase4.apache.org,36357,1709042080636, archiveDir=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/oldWALs, maxLogs=32 2024-02-27 13:54:42,376 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:43027,DS-3635241f-6e99-4434-b2c4-1dbc903af692,DISK] 2024-02-27 13:54:42,377 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:34401,DS-4a99446b-b165-4467-85b6-d60926d94d4c,DISK] 2024-02-27 13:54:42,388 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/WALs/jenkins-hbase4.apache.org,36357,1709042080636/jenkins-hbase4.apache.org%2C36357%2C1709042080636.meta.1709042082359.meta 2024-02-27 13:54:42,389 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:43027,DS-3635241f-6e99-4434-b2c4-1dbc903af692,DISK], DatanodeInfoWithStorage[127.0.0.1:34401,DS-4a99446b-b165-4467-85b6-d60926d94d4c,DISK]] 2024-02-27 13:54:42,389 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2024-02-27 13:54:42,391 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2024-02-27 13:54:42,407 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2024-02-27 13:54:42,411 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2024-02-27 13:54:42,416 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2024-02-27 13:54:42,417 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 13:54:42,417 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2024-02-27 13:54:42,417 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2024-02-27 13:54:42,421 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-02-27 13:54:42,423 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/meta/1588230740/info 2024-02-27 13:54:42,423 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/meta/1588230740/info 2024-02-27 13:54:42,424 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-02-27 13:54:42,425 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 13:54:42,425 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-02-27 13:54:42,426 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/meta/1588230740/rep_barrier 2024-02-27 13:54:42,427 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/meta/1588230740/rep_barrier 2024-02-27 13:54:42,427 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-02-27 13:54:42,428 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 13:54:42,428 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-02-27 13:54:42,430 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/meta/1588230740/table 2024-02-27 13:54:42,430 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/meta/1588230740/table 2024-02-27 13:54:42,430 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-02-27 13:54:42,431 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 13:54:42,433 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/meta/1588230740 2024-02-27 13:54:42,437 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/meta/1588230740 2024-02-27 13:54:42,441 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-02-27 13:54:42,444 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2024-02-27 13:54:42,446 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66585816, jitterRate=-0.007794022560119629}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-02-27 13:54:42,446 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2024-02-27 13:54:42,458 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1709042082328 2024-02-27 13:54:42,476 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:meta,,1.1588230740 2024-02-27 13:54:42,477 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2024-02-27 13:54:42,478 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,36357,1709042080636, state=OPEN 2024-02-27 13:54:42,482 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2024-02-27 13:54:42,482 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-02-27 13:54:42,489 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=3, resume processing ppid=2 2024-02-27 13:54:42,489 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,36357,1709042080636 in 333 msec 2024-02-27 13:54:42,495 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=2, resume processing ppid=1 2024-02-27 13:54:42,496 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 538 msec 2024-02-27 13:54:42,501 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 789 msec 2024-02-27 13:54:42,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(954): Wait for region servers to report in: status=null, state=RUNNING, startTime=1709042082501, completionTime=-1 2024-02-27 13:54:42,501 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2024-02-27 13:54:42,502 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2024-02-27 13:54:42,569 DEBUG [hconnection-0x75f2a1f4-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-02-27 13:54:42,572 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36842, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-02-27 13:54:42,589 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=2 2024-02-27 13:54:42,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1709042142590 2024-02-27 13:54:42,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1709042202590 2024-02-27 13:54:42,590 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 87 msec 2024-02-27 13:54:42,614 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41827,1709042079370-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:42,614 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41827,1709042079370-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:42,614 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41827,1709042079370-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:42,616 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:41827, period=300000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:42,617 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:42,623 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2024-02-27 13:54:42,631 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2024-02-27 13:54:42,633 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-02-27 13:54:42,642 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2024-02-27 13:54:42,645 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2024-02-27 13:54:42,648 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-02-27 13:54:42,670 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/hbase/namespace/5f9121330b4c01576fb7dad518004b0a 2024-02-27 13:54:42,673 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/hbase/namespace/5f9121330b4c01576fb7dad518004b0a empty. 2024-02-27 13:54:42,674 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/hbase/namespace/5f9121330b4c01576fb7dad518004b0a 2024-02-27 13:54:42,674 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2024-02-27 13:54:43,110 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2024-02-27 13:54:43,113 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5f9121330b4c01576fb7dad518004b0a, NAME => 'hbase:namespace,,1709042082632.5f9121330b4c01576fb7dad518004b0a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp 2024-02-27 13:54:43,131 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1709042082632.5f9121330b4c01576fb7dad518004b0a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 13:54:43,131 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 5f9121330b4c01576fb7dad518004b0a, disabling compactions & flushes 2024-02-27 13:54:43,131 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1709042082632.5f9121330b4c01576fb7dad518004b0a. 2024-02-27 13:54:43,131 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1709042082632.5f9121330b4c01576fb7dad518004b0a. 2024-02-27 13:54:43,131 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1709042082632.5f9121330b4c01576fb7dad518004b0a. after waiting 0 ms 2024-02-27 13:54:43,131 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1709042082632.5f9121330b4c01576fb7dad518004b0a. 2024-02-27 13:54:43,131 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1709042082632.5f9121330b4c01576fb7dad518004b0a. 2024-02-27 13:54:43,131 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 5f9121330b4c01576fb7dad518004b0a: 2024-02-27 13:54:43,138 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2024-02-27 13:54:43,153 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1709042082632.5f9121330b4c01576fb7dad518004b0a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1709042083141"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709042083141"}]},"ts":"1709042083141"} 2024-02-27 13:54:43,180 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-02-27 13:54:43,182 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-02-27 13:54:43,188 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709042083183"}]},"ts":"1709042083183"} 2024-02-27 13:54:43,192 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2024-02-27 13:54:43,197 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-02-27 13:54:43,199 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-02-27 13:54:43,199 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-02-27 13:54:43,199 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-02-27 13:54:43,201 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5f9121330b4c01576fb7dad518004b0a, ASSIGN}] 2024-02-27 13:54:43,204 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=5f9121330b4c01576fb7dad518004b0a, ASSIGN 2024-02-27 13:54:43,205 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=5f9121330b4c01576fb7dad518004b0a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36357,1709042080636; forceNewPlan=false, retain=false 2024-02-27 13:54:43,359 INFO [jenkins-hbase4:41827] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-02-27 13:54:43,360 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5f9121330b4c01576fb7dad518004b0a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:54:43,361 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1709042082632.5f9121330b4c01576fb7dad518004b0a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1709042083360"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709042083360"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709042083360"}]},"ts":"1709042083360"} 2024-02-27 13:54:43,366 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 5f9121330b4c01576fb7dad518004b0a, server=jenkins-hbase4.apache.org,36357,1709042080636}] 2024-02-27 13:54:43,520 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:54:43,527 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1709042082632.5f9121330b4c01576fb7dad518004b0a. 2024-02-27 13:54:43,528 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5f9121330b4c01576fb7dad518004b0a, NAME => 'hbase:namespace,,1709042082632.5f9121330b4c01576fb7dad518004b0a.', STARTKEY => '', ENDKEY => ''} 2024-02-27 13:54:43,529 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 5f9121330b4c01576fb7dad518004b0a 2024-02-27 13:54:43,529 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1709042082632.5f9121330b4c01576fb7dad518004b0a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 13:54:43,529 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5f9121330b4c01576fb7dad518004b0a 2024-02-27 13:54:43,529 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5f9121330b4c01576fb7dad518004b0a 2024-02-27 13:54:43,532 INFO [StoreOpener-5f9121330b4c01576fb7dad518004b0a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 5f9121330b4c01576fb7dad518004b0a 2024-02-27 13:54:43,535 DEBUG [StoreOpener-5f9121330b4c01576fb7dad518004b0a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/namespace/5f9121330b4c01576fb7dad518004b0a/info 2024-02-27 13:54:43,535 DEBUG [StoreOpener-5f9121330b4c01576fb7dad518004b0a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/namespace/5f9121330b4c01576fb7dad518004b0a/info 2024-02-27 13:54:43,535 INFO [StoreOpener-5f9121330b4c01576fb7dad518004b0a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5f9121330b4c01576fb7dad518004b0a columnFamilyName info 2024-02-27 13:54:43,537 INFO [StoreOpener-5f9121330b4c01576fb7dad518004b0a-1] regionserver.HStore(310): Store=5f9121330b4c01576fb7dad518004b0a/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 13:54:43,538 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/namespace/5f9121330b4c01576fb7dad518004b0a 2024-02-27 13:54:43,540 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/namespace/5f9121330b4c01576fb7dad518004b0a 2024-02-27 13:54:43,546 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5f9121330b4c01576fb7dad518004b0a 2024-02-27 13:54:43,550 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/namespace/5f9121330b4c01576fb7dad518004b0a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-27 13:54:43,552 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5f9121330b4c01576fb7dad518004b0a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63108084, jitterRate=-0.059616267681121826}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-02-27 13:54:43,552 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5f9121330b4c01576fb7dad518004b0a: 2024-02-27 13:54:43,554 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:namespace,,1709042082632.5f9121330b4c01576fb7dad518004b0a., pid=6, masterSystemTime=1709042083520 2024-02-27 13:54:43,559 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:namespace,,1709042082632.5f9121330b4c01576fb7dad518004b0a. 2024-02-27 13:54:43,559 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1709042082632.5f9121330b4c01576fb7dad518004b0a. 2024-02-27 13:54:43,560 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=5f9121330b4c01576fb7dad518004b0a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:54:43,560 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1709042082632.5f9121330b4c01576fb7dad518004b0a.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1709042083559"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1709042083559"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1709042083559"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1709042083559"}]},"ts":"1709042083559"} 2024-02-27 13:54:43,570 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=6, resume processing ppid=5 2024-02-27 13:54:43,570 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 5f9121330b4c01576fb7dad518004b0a, server=jenkins-hbase4.apache.org,36357,1709042080636 in 201 msec 2024-02-27 13:54:43,574 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=5, resume processing ppid=4 2024-02-27 13:54:43,575 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=5f9121330b4c01576fb7dad518004b0a, ASSIGN in 369 msec 2024-02-27 13:54:43,576 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-02-27 13:54:43,576 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709042083576"}]},"ts":"1709042083576"} 2024-02-27 13:54:43,581 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2024-02-27 13:54:43,585 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2024-02-27 13:54:43,588 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 952 msec 2024-02-27 13:54:43,646 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2024-02-27 13:54:43,648 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2024-02-27 13:54:43,648 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-27 13:54:43,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2024-02-27 13:54:43,697 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-02-27 13:54:43,703 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 28 msec 2024-02-27 13:54:43,716 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2024-02-27 13:54:43,728 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-02-27 13:54:43,734 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 17 msec 2024-02-27 13:54:43,742 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2024-02-27 13:54:43,744 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2024-02-27 13:54:43,745 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1084): Master has completed initialization 2.988sec 2024-02-27 13:54:43,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(103): Quota table not found. Creating... 2024-02-27 13:54:43,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-02-27 13:54:43,750 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:quota 2024-02-27 13:54:43,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(107): Initializing quota support 2024-02-27 13:54:43,752 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(59): Namespace State Manager started. 2024-02-27 13:54:43,752 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_PRE_OPERATION 2024-02-27 13:54:43,754 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-02-27 13:54:43,757 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/hbase/quota/c32c23665c326b77f453386d6994983a 2024-02-27 13:54:43,758 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/hbase/quota/c32c23665c326b77f453386d6994983a empty. 2024-02-27 13:54:43,760 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/hbase/quota/c32c23665c326b77f453386d6994983a 2024-02-27 13:54:43,760 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:quota regions 2024-02-27 13:54:43,761 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(222): Finished updating state of 2 namespaces. 2024-02-27 13:54:43,761 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceAuditor(50): NamespaceAuditor started. 2024-02-27 13:54:43,763 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:43,764 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=300000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:43,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2024-02-27 13:54:43,766 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2024-02-27 13:54:43,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41827,1709042079370-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2024-02-27 13:54:43,767 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41827,1709042079370-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2024-02-27 13:54:43,782 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1176): Balancer post startup initialization complete, took 0 seconds 2024-02-27 13:54:43,783 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,41827,1709042079370-OldWALsDirSizeChore, period=300000, unit=MILLISECONDS is enabled. 2024-02-27 13:54:43,786 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/hbase/quota/.tabledesc/.tableinfo.0000000001 2024-02-27 13:54:43,788 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(7675): creating {ENCODED => c32c23665c326b77f453386d6994983a, NAME => 'hbase:quota,,1709042083748.c32c23665c326b77f453386d6994983a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp 2024-02-27 13:54:43,811 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(866): Instantiated hbase:quota,,1709042083748.c32c23665c326b77f453386d6994983a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 13:54:43,811 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1604): Closing c32c23665c326b77f453386d6994983a, disabling compactions & flushes 2024-02-27 13:54:43,811 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1626): Closing region hbase:quota,,1709042083748.c32c23665c326b77f453386d6994983a. 2024-02-27 13:54:43,811 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1709042083748.c32c23665c326b77f453386d6994983a. 2024-02-27 13:54:43,811 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1709042083748.c32c23665c326b77f453386d6994983a. after waiting 0 ms 2024-02-27 13:54:43,811 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1709042083748.c32c23665c326b77f453386d6994983a. 2024-02-27 13:54:43,811 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1838): Closed hbase:quota,,1709042083748.c32c23665c326b77f453386d6994983a. 2024-02-27 13:54:43,811 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1558): Region close journal for c32c23665c326b77f453386d6994983a: 2024-02-27 13:54:43,816 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ADD_TO_META 2024-02-27 13:54:43,818 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:quota,,1709042083748.c32c23665c326b77f453386d6994983a.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1709042083817"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709042083817"}]},"ts":"1709042083817"} 2024-02-27 13:54:43,821 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-02-27 13:54:43,822 ERROR [Listener at localhost/33159] master.TableStateManager(95): Unable to get table hbase:quota state org.apache.hadoop.hbase.TableNotFoundException: No state found for hbase:quota at org.apache.hadoop.hbase.master.TableStateManager.getTableState(TableStateManager.java:155) at org.apache.hadoop.hbase.master.TableStateManager.isTableState(TableStateManager.java:92) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.isTableDisabled(AssignmentManager.java:419) at org.apache.hadoop.hbase.master.assignment.AssignmentManager.getRegionStatesCount(AssignmentManager.java:2351) at org.apache.hadoop.hbase.master.HMaster.getClusterMetricsWithoutCoprocessor(HMaster.java:2622) at org.apache.hadoop.hbase.master.HMaster.getClusterMetrics(HMaster.java:2646) at org.apache.hadoop.hbase.master.HMaster.getClusterMetrics(HMaster.java:2639) at org.apache.hadoop.hbase.MiniHBaseCluster.getClusterMetrics(MiniHBaseCluster.java:710) at org.apache.hadoop.hbase.MiniHBaseCluster.(MiniHBaseCluster.java:111) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniHBaseCluster(HBaseTestingUtility.java:1131) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:1094) at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:1048) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.setUpBeforeClass(TestClusterScopeQuotaThrottle.java:78) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.RunBefores.invokeMethod(RunBefores.java:33) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:24) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) 2024-02-27 13:54:43,823 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-02-27 13:54:43,823 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709042083823"}]},"ts":"1709042083823"} 2024-02-27 13:54:43,826 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLING in hbase:meta 2024-02-27 13:54:43,829 DEBUG [Listener at localhost/33159] zookeeper.ReadOnlyZKClient(139): Connect 0x11b46918 to 127.0.0.1:60991 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-02-27 13:54:43,832 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-02-27 13:54:43,834 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-02-27 13:54:43,834 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-02-27 13:54:43,834 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-02-27 13:54:43,834 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=c32c23665c326b77f453386d6994983a, ASSIGN}] 2024-02-27 13:54:43,835 DEBUG [Listener at localhost/33159] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@58d4a0dc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-02-27 13:54:43,836 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=c32c23665c326b77f453386d6994983a, ASSIGN 2024-02-27 13:54:43,838 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:quota, region=c32c23665c326b77f453386d6994983a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36357,1709042080636; forceNewPlan=false, retain=false 2024-02-27 13:54:43,855 DEBUG [hconnection-0x505566b3-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-02-27 13:54:43,867 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36854, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-02-27 13:54:43,880 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,41827,1709042079370 2024-02-27 13:54:43,882 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:54:43,885 DEBUG [Listener at localhost/33159] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-02-27 13:54:43,988 INFO [jenkins-hbase4:41827] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-02-27 13:54:43,988 DEBUG [Listener at localhost/33159] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-02-27 13:54:43,989 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=c32c23665c326b77f453386d6994983a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:54:43,989 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:quota,,1709042083748.c32c23665c326b77f453386d6994983a.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1709042083989"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709042083989"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709042083989"}]},"ts":"1709042083989"} 2024-02-27 13:54:43,992 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure c32c23665c326b77f453386d6994983a, server=jenkins-hbase4.apache.org,36357,1709042080636}] 2024-02-27 13:54:44,091 DEBUG [Listener at localhost/33159] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-02-27 13:54:44,146 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:54:44,152 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:quota,,1709042083748.c32c23665c326b77f453386d6994983a. 2024-02-27 13:54:44,152 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => c32c23665c326b77f453386d6994983a, NAME => 'hbase:quota,,1709042083748.c32c23665c326b77f453386d6994983a.', STARTKEY => '', ENDKEY => ''} 2024-02-27 13:54:44,152 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table quota c32c23665c326b77f453386d6994983a 2024-02-27 13:54:44,153 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:quota,,1709042083748.c32c23665c326b77f453386d6994983a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 13:54:44,153 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for c32c23665c326b77f453386d6994983a 2024-02-27 13:54:44,153 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for c32c23665c326b77f453386d6994983a 2024-02-27 13:54:44,155 INFO [StoreOpener-c32c23665c326b77f453386d6994983a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family q of region c32c23665c326b77f453386d6994983a 2024-02-27 13:54:44,157 DEBUG [StoreOpener-c32c23665c326b77f453386d6994983a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/quota/c32c23665c326b77f453386d6994983a/q 2024-02-27 13:54:44,158 DEBUG [StoreOpener-c32c23665c326b77f453386d6994983a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/quota/c32c23665c326b77f453386d6994983a/q 2024-02-27 13:54:44,158 INFO [StoreOpener-c32c23665c326b77f453386d6994983a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c32c23665c326b77f453386d6994983a columnFamilyName q 2024-02-27 13:54:44,159 INFO [StoreOpener-c32c23665c326b77f453386d6994983a-1] regionserver.HStore(310): Store=c32c23665c326b77f453386d6994983a/q, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 13:54:44,159 INFO [StoreOpener-c32c23665c326b77f453386d6994983a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family u of region c32c23665c326b77f453386d6994983a 2024-02-27 13:54:44,161 DEBUG [StoreOpener-c32c23665c326b77f453386d6994983a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/quota/c32c23665c326b77f453386d6994983a/u 2024-02-27 13:54:44,161 DEBUG [StoreOpener-c32c23665c326b77f453386d6994983a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/quota/c32c23665c326b77f453386d6994983a/u 2024-02-27 13:54:44,162 INFO [StoreOpener-c32c23665c326b77f453386d6994983a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region c32c23665c326b77f453386d6994983a columnFamilyName u 2024-02-27 13:54:44,163 INFO [StoreOpener-c32c23665c326b77f453386d6994983a-1] regionserver.HStore(310): Store=c32c23665c326b77f453386d6994983a/u, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 13:54:44,165 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/quota/c32c23665c326b77f453386d6994983a 2024-02-27 13:54:44,166 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/quota/c32c23665c326b77f453386d6994983a 2024-02-27 13:54:44,169 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:quota descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2024-02-27 13:54:44,171 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for c32c23665c326b77f453386d6994983a 2024-02-27 13:54:44,174 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/quota/c32c23665c326b77f453386d6994983a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-27 13:54:44,175 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened c32c23665c326b77f453386d6994983a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67206205, jitterRate=0.0014504939317703247}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2024-02-27 13:54:44,175 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for c32c23665c326b77f453386d6994983a: 2024-02-27 13:54:44,176 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:quota,,1709042083748.c32c23665c326b77f453386d6994983a., pid=11, masterSystemTime=1709042084146 2024-02-27 13:54:44,179 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:quota,,1709042083748.c32c23665c326b77f453386d6994983a. 2024-02-27 13:54:44,179 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:quota,,1709042083748.c32c23665c326b77f453386d6994983a. 2024-02-27 13:54:44,180 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=c32c23665c326b77f453386d6994983a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:54:44,180 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:quota,,1709042083748.c32c23665c326b77f453386d6994983a.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1709042084180"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1709042084180"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1709042084180"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1709042084180"}]},"ts":"1709042084180"} 2024-02-27 13:54:44,187 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=11, resume processing ppid=10 2024-02-27 13:54:44,187 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure c32c23665c326b77f453386d6994983a, server=jenkins-hbase4.apache.org,36357,1709042080636 in 191 msec 2024-02-27 13:54:44,190 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=10, resume processing ppid=9 2024-02-27 13:54:44,190 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:quota, region=c32c23665c326b77f453386d6994983a, ASSIGN in 353 msec 2024-02-27 13:54:44,191 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-02-27 13:54:44,192 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709042084191"}]},"ts":"1709042084191"} 2024-02-27 13:54:44,194 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLED in hbase:meta 2024-02-27 13:54:44,194 DEBUG [Listener at localhost/33159] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-02-27 13:54:44,198 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_POST_OPERATION 2024-02-27 13:54:44,201 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:quota in 450 msec 2024-02-27 13:54:44,313 DEBUG [Listener at localhost/33159] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-02-27 13:54:44,316 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42252, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2024-02-27 13:54:44,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-02-27 13:54:44,347 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] procedure2.ProcedureExecutor(1075): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin0 2024-02-27 13:54:44,350 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_PRE_OPERATION 2024-02-27 13:54:44,352 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-02-27 13:54:44,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin0" procId is: 12 2024-02-27 13:54:44,355 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/default/TestQuotaAdmin0/15d33d090e14d2c7e00b9d111cafd014 2024-02-27 13:54:44,356 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/default/TestQuotaAdmin0/15d33d090e14d2c7e00b9d111cafd014 empty. 2024-02-27 13:54:44,357 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/default/TestQuotaAdmin0/15d33d090e14d2c7e00b9d111cafd014 2024-02-27 13:54:44,357 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-02-27 13:54:44,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-02-27 13:54:44,377 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/default/TestQuotaAdmin0/.tabledesc/.tableinfo.0000000001 2024-02-27 13:54:44,379 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(7675): creating {ENCODED => 15d33d090e14d2c7e00b9d111cafd014, NAME => 'TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp 2024-02-27 13:54:44,400 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 13:54:44,400 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1604): Closing 15d33d090e14d2c7e00b9d111cafd014, disabling compactions & flushes 2024-02-27 13:54:44,400 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014. 2024-02-27 13:54:44,400 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014. 2024-02-27 13:54:44,400 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014. after waiting 0 ms 2024-02-27 13:54:44,400 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014. 2024-02-27 13:54:44,401 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014. 2024-02-27 13:54:44,401 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1558): Region close journal for 15d33d090e14d2c7e00b9d111cafd014: 2024-02-27 13:54:44,405 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ADD_TO_META 2024-02-27 13:54:44,407 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709042084407"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709042084407"}]},"ts":"1709042084407"} 2024-02-27 13:54:44,409 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-02-27 13:54:44,411 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-02-27 13:54:44,411 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709042084411"}]},"ts":"1709042084411"} 2024-02-27 13:54:44,413 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLING in hbase:meta 2024-02-27 13:54:44,418 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-02-27 13:54:44,419 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-02-27 13:54:44,419 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-02-27 13:54:44,419 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-02-27 13:54:44,419 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=15d33d090e14d2c7e00b9d111cafd014, ASSIGN}] 2024-02-27 13:54:44,421 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=15d33d090e14d2c7e00b9d111cafd014, ASSIGN 2024-02-27 13:54:44,422 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin0, region=15d33d090e14d2c7e00b9d111cafd014, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33695,1709042080686; forceNewPlan=false, retain=false 2024-02-27 13:54:44,572 INFO [jenkins-hbase4:41827] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-02-27 13:54:44,573 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=15d33d090e14d2c7e00b9d111cafd014, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33695,1709042080686 2024-02-27 13:54:44,574 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709042084573"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709042084573"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709042084573"}]},"ts":"1709042084573"} 2024-02-27 13:54:44,577 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; OpenRegionProcedure 15d33d090e14d2c7e00b9d111cafd014, server=jenkins-hbase4.apache.org,33695,1709042080686}] 2024-02-27 13:54:44,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-02-27 13:54:44,730 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,33695,1709042080686 2024-02-27 13:54:44,731 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-02-27 13:54:44,734 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49508, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-02-27 13:54:44,740 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014. 2024-02-27 13:54:44,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 15d33d090e14d2c7e00b9d111cafd014, NAME => 'TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014.', STARTKEY => '', ENDKEY => ''} 2024-02-27 13:54:44,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin0 15d33d090e14d2c7e00b9d111cafd014 2024-02-27 13:54:44,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 13:54:44,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 15d33d090e14d2c7e00b9d111cafd014 2024-02-27 13:54:44,741 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 15d33d090e14d2c7e00b9d111cafd014 2024-02-27 13:54:44,743 INFO [StoreOpener-15d33d090e14d2c7e00b9d111cafd014-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 15d33d090e14d2c7e00b9d111cafd014 2024-02-27 13:54:44,745 DEBUG [StoreOpener-15d33d090e14d2c7e00b9d111cafd014-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/default/TestQuotaAdmin0/15d33d090e14d2c7e00b9d111cafd014/cf 2024-02-27 13:54:44,745 DEBUG [StoreOpener-15d33d090e14d2c7e00b9d111cafd014-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/default/TestQuotaAdmin0/15d33d090e14d2c7e00b9d111cafd014/cf 2024-02-27 13:54:44,746 INFO [StoreOpener-15d33d090e14d2c7e00b9d111cafd014-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 15d33d090e14d2c7e00b9d111cafd014 columnFamilyName cf 2024-02-27 13:54:44,747 INFO [StoreOpener-15d33d090e14d2c7e00b9d111cafd014-1] regionserver.HStore(310): Store=15d33d090e14d2c7e00b9d111cafd014/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 13:54:44,748 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/default/TestQuotaAdmin0/15d33d090e14d2c7e00b9d111cafd014 2024-02-27 13:54:44,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/default/TestQuotaAdmin0/15d33d090e14d2c7e00b9d111cafd014 2024-02-27 13:54:44,754 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 15d33d090e14d2c7e00b9d111cafd014 2024-02-27 13:54:44,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/default/TestQuotaAdmin0/15d33d090e14d2c7e00b9d111cafd014/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-27 13:54:44,758 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 15d33d090e14d2c7e00b9d111cafd014; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67572682, jitterRate=0.006911426782608032}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-02-27 13:54:44,758 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 15d33d090e14d2c7e00b9d111cafd014: 2024-02-27 13:54:44,760 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014., pid=14, masterSystemTime=1709042084730 2024-02-27 13:54:44,764 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014. 2024-02-27 13:54:44,764 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014. 2024-02-27 13:54:44,765 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=15d33d090e14d2c7e00b9d111cafd014, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33695,1709042080686 2024-02-27 13:54:44,765 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709042084765"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1709042084765"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1709042084765"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1709042084765"}]},"ts":"1709042084765"} 2024-02-27 13:54:44,771 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=14, resume processing ppid=13 2024-02-27 13:54:44,771 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=14, ppid=13, state=SUCCESS; OpenRegionProcedure 15d33d090e14d2c7e00b9d111cafd014, server=jenkins-hbase4.apache.org,33695,1709042080686 in 191 msec 2024-02-27 13:54:44,774 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=13, resume processing ppid=12 2024-02-27 13:54:44,775 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=15d33d090e14d2c7e00b9d111cafd014, ASSIGN in 352 msec 2024-02-27 13:54:44,776 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-02-27 13:54:44,776 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709042084776"}]},"ts":"1709042084776"} 2024-02-27 13:54:44,778 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLED in hbase:meta 2024-02-27 13:54:44,782 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_POST_OPERATION 2024-02-27 13:54:44,784 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=12, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin0 in 437 msec 2024-02-27 13:54:45,122 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-02-27 13:54:45,122 INFO [Listener at localhost/33159] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin0, procId: 12 completed 2024-02-27 13:54:45,122 DEBUG [Listener at localhost/33159] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin0 get assigned. Timeout = 60000ms 2024-02-27 13:54:45,123 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:54:45,127 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin0 assigned to meta. Checking AM states. 2024-02-27 13:54:45,128 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:54:45,128 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin0 assigned. 2024-02-27 13:54:45,128 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:54:45,137 DEBUG [hconnection-0x505566b3-shared-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-02-27 13:54:45,140 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49518, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-02-27 13:54:45,145 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-02-27 13:54:45,147 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42264, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=MasterService 2024-02-27 13:54:45,149 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-02-27 13:54:45,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] procedure2.ProcedureExecutor(1075): Stored pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin1 2024-02-27 13:54:45,153 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_PRE_OPERATION 2024-02-27 13:54:45,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin1" procId is: 15 2024-02-27 13:54:45,156 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-02-27 13:54:45,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-02-27 13:54:45,159 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/default/TestQuotaAdmin1/457e0c5b3b0c6fdb5b124947c571679e 2024-02-27 13:54:45,160 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/default/TestQuotaAdmin1/457e0c5b3b0c6fdb5b124947c571679e empty. 2024-02-27 13:54:45,161 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/default/TestQuotaAdmin1/457e0c5b3b0c6fdb5b124947c571679e 2024-02-27 13:54:45,161 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-02-27 13:54:45,190 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/default/TestQuotaAdmin1/.tabledesc/.tableinfo.0000000001 2024-02-27 13:54:45,192 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 457e0c5b3b0c6fdb5b124947c571679e, NAME => 'TestQuotaAdmin1,,1709042085148.457e0c5b3b0c6fdb5b124947c571679e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp 2024-02-27 13:54:45,208 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1709042085148.457e0c5b3b0c6fdb5b124947c571679e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 13:54:45,208 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1604): Closing 457e0c5b3b0c6fdb5b124947c571679e, disabling compactions & flushes 2024-02-27 13:54:45,208 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1709042085148.457e0c5b3b0c6fdb5b124947c571679e. 2024-02-27 13:54:45,208 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1709042085148.457e0c5b3b0c6fdb5b124947c571679e. 2024-02-27 13:54:45,208 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1709042085148.457e0c5b3b0c6fdb5b124947c571679e. after waiting 0 ms 2024-02-27 13:54:45,208 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1709042085148.457e0c5b3b0c6fdb5b124947c571679e. 2024-02-27 13:54:45,208 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1709042085148.457e0c5b3b0c6fdb5b124947c571679e. 2024-02-27 13:54:45,208 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1558): Region close journal for 457e0c5b3b0c6fdb5b124947c571679e: 2024-02-27 13:54:45,211 DEBUG [hconnection-0x5df6b58b-metaLookup-shared--pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-02-27 13:54:45,214 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36858, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2024-02-27 13:54:45,216 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ADD_TO_META 2024-02-27 13:54:45,218 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1709042085148.457e0c5b3b0c6fdb5b124947c571679e.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709042085217"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709042085217"}]},"ts":"1709042085217"} 2024-02-27 13:54:45,221 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-02-27 13:54:45,222 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-02-27 13:54:45,223 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709042085222"}]},"ts":"1709042085222"} 2024-02-27 13:54:45,225 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLING in hbase:meta 2024-02-27 13:54:45,231 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-02-27 13:54:45,233 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-02-27 13:54:45,233 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-02-27 13:54:45,233 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-02-27 13:54:45,233 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=457e0c5b3b0c6fdb5b124947c571679e, ASSIGN}] 2024-02-27 13:54:45,235 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=457e0c5b3b0c6fdb5b124947c571679e, ASSIGN 2024-02-27 13:54:45,236 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin1, region=457e0c5b3b0c6fdb5b124947c571679e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36357,1709042080636; forceNewPlan=false, retain=false 2024-02-27 13:54:45,386 INFO [jenkins-hbase4:41827] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-02-27 13:54:45,387 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=457e0c5b3b0c6fdb5b124947c571679e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:54:45,388 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1709042085148.457e0c5b3b0c6fdb5b124947c571679e.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709042085387"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709042085387"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709042085387"}]},"ts":"1709042085387"} 2024-02-27 13:54:45,391 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure 457e0c5b3b0c6fdb5b124947c571679e, server=jenkins-hbase4.apache.org,36357,1709042080636}] 2024-02-27 13:54:45,409 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-02-27 13:54:45,544 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:54:45,551 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin1,,1709042085148.457e0c5b3b0c6fdb5b124947c571679e. 2024-02-27 13:54:45,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 457e0c5b3b0c6fdb5b124947c571679e, NAME => 'TestQuotaAdmin1,,1709042085148.457e0c5b3b0c6fdb5b124947c571679e.', STARTKEY => '', ENDKEY => ''} 2024-02-27 13:54:45,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin1 457e0c5b3b0c6fdb5b124947c571679e 2024-02-27 13:54:45,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1709042085148.457e0c5b3b0c6fdb5b124947c571679e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 13:54:45,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 457e0c5b3b0c6fdb5b124947c571679e 2024-02-27 13:54:45,552 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 457e0c5b3b0c6fdb5b124947c571679e 2024-02-27 13:54:45,554 INFO [StoreOpener-457e0c5b3b0c6fdb5b124947c571679e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 457e0c5b3b0c6fdb5b124947c571679e 2024-02-27 13:54:45,557 DEBUG [StoreOpener-457e0c5b3b0c6fdb5b124947c571679e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/default/TestQuotaAdmin1/457e0c5b3b0c6fdb5b124947c571679e/cf 2024-02-27 13:54:45,557 DEBUG [StoreOpener-457e0c5b3b0c6fdb5b124947c571679e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/default/TestQuotaAdmin1/457e0c5b3b0c6fdb5b124947c571679e/cf 2024-02-27 13:54:45,557 INFO [StoreOpener-457e0c5b3b0c6fdb5b124947c571679e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 457e0c5b3b0c6fdb5b124947c571679e columnFamilyName cf 2024-02-27 13:54:45,558 INFO [StoreOpener-457e0c5b3b0c6fdb5b124947c571679e-1] regionserver.HStore(310): Store=457e0c5b3b0c6fdb5b124947c571679e/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 13:54:45,560 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/default/TestQuotaAdmin1/457e0c5b3b0c6fdb5b124947c571679e 2024-02-27 13:54:45,562 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/default/TestQuotaAdmin1/457e0c5b3b0c6fdb5b124947c571679e 2024-02-27 13:54:45,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 457e0c5b3b0c6fdb5b124947c571679e 2024-02-27 13:54:45,573 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/default/TestQuotaAdmin1/457e0c5b3b0c6fdb5b124947c571679e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-27 13:54:45,574 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 457e0c5b3b0c6fdb5b124947c571679e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60567200, jitterRate=-0.09747838973999023}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-02-27 13:54:45,574 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 457e0c5b3b0c6fdb5b124947c571679e: 2024-02-27 13:54:45,575 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin1,,1709042085148.457e0c5b3b0c6fdb5b124947c571679e., pid=17, masterSystemTime=1709042085544 2024-02-27 13:54:45,578 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin1,,1709042085148.457e0c5b3b0c6fdb5b124947c571679e. 2024-02-27 13:54:45,578 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin1,,1709042085148.457e0c5b3b0c6fdb5b124947c571679e. 2024-02-27 13:54:45,579 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=457e0c5b3b0c6fdb5b124947c571679e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:54:45,580 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin1,,1709042085148.457e0c5b3b0c6fdb5b124947c571679e.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709042085579"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1709042085579"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1709042085579"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1709042085579"}]},"ts":"1709042085579"} 2024-02-27 13:54:45,586 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=17, resume processing ppid=16 2024-02-27 13:54:45,586 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure 457e0c5b3b0c6fdb5b124947c571679e, server=jenkins-hbase4.apache.org,36357,1709042080636 in 191 msec 2024-02-27 13:54:45,590 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=16, resume processing ppid=15 2024-02-27 13:54:45,590 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=457e0c5b3b0c6fdb5b124947c571679e, ASSIGN in 353 msec 2024-02-27 13:54:45,591 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-02-27 13:54:45,591 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709042085591"}]},"ts":"1709042085591"} 2024-02-27 13:54:45,593 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLED in hbase:meta 2024-02-27 13:54:45,598 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_POST_OPERATION 2024-02-27 13:54:45,600 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=15, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin1 in 449 msec 2024-02-27 13:54:45,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-02-27 13:54:45,912 INFO [Listener at localhost/33159] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin1, procId: 15 completed 2024-02-27 13:54:45,912 DEBUG [Listener at localhost/33159] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin1 get assigned. Timeout = 60000ms 2024-02-27 13:54:45,912 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:54:45,915 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin1 assigned to meta. Checking AM states. 2024-02-27 13:54:45,915 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:54:45,916 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin1 assigned. 2024-02-27 13:54:45,916 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:54:45,926 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-02-27 13:54:45,931 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:57636, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService 2024-02-27 13:54:45,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-02-27 13:54:45,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] procedure2.ProcedureExecutor(1075): Stored pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin2 2024-02-27 13:54:45,935 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_PRE_OPERATION 2024-02-27 13:54:45,935 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin2" procId is: 18 2024-02-27 13:54:45,937 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-02-27 13:54:45,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-02-27 13:54:45,940 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/default/TestQuotaAdmin2/7d35db972a5a8c020a495a982c6dc95a 2024-02-27 13:54:45,941 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/default/TestQuotaAdmin2/7d35db972a5a8c020a495a982c6dc95a empty. 2024-02-27 13:54:45,942 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/default/TestQuotaAdmin2/7d35db972a5a8c020a495a982c6dc95a 2024-02-27 13:54:45,942 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-02-27 13:54:45,961 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/default/TestQuotaAdmin2/.tabledesc/.tableinfo.0000000001 2024-02-27 13:54:45,963 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7d35db972a5a8c020a495a982c6dc95a, NAME => 'TestQuotaAdmin2,,1709042085930.7d35db972a5a8c020a495a982c6dc95a.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp 2024-02-27 13:54:45,977 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1709042085930.7d35db972a5a8c020a495a982c6dc95a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 13:54:45,977 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1604): Closing 7d35db972a5a8c020a495a982c6dc95a, disabling compactions & flushes 2024-02-27 13:54:45,977 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1709042085930.7d35db972a5a8c020a495a982c6dc95a. 2024-02-27 13:54:45,977 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1709042085930.7d35db972a5a8c020a495a982c6dc95a. 2024-02-27 13:54:45,977 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1709042085930.7d35db972a5a8c020a495a982c6dc95a. after waiting 0 ms 2024-02-27 13:54:45,977 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1709042085930.7d35db972a5a8c020a495a982c6dc95a. 2024-02-27 13:54:45,977 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1709042085930.7d35db972a5a8c020a495a982c6dc95a. 2024-02-27 13:54:45,977 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1558): Region close journal for 7d35db972a5a8c020a495a982c6dc95a: 2024-02-27 13:54:45,981 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ADD_TO_META 2024-02-27 13:54:45,983 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1709042085930.7d35db972a5a8c020a495a982c6dc95a.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709042085983"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709042085983"}]},"ts":"1709042085983"} 2024-02-27 13:54:45,985 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-02-27 13:54:45,986 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-02-27 13:54:45,987 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709042085986"}]},"ts":"1709042085986"} 2024-02-27 13:54:45,988 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLING in hbase:meta 2024-02-27 13:54:45,994 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-02-27 13:54:45,995 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-02-27 13:54:45,995 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-02-27 13:54:45,995 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-02-27 13:54:45,995 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=7d35db972a5a8c020a495a982c6dc95a, ASSIGN}] 2024-02-27 13:54:45,997 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=7d35db972a5a8c020a495a982c6dc95a, ASSIGN 2024-02-27 13:54:45,998 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin2, region=7d35db972a5a8c020a495a982c6dc95a, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36357,1709042080636; forceNewPlan=false, retain=false 2024-02-27 13:54:46,148 INFO [jenkins-hbase4:41827] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-02-27 13:54:46,149 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=7d35db972a5a8c020a495a982c6dc95a, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:54:46,150 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1709042085930.7d35db972a5a8c020a495a982c6dc95a.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709042086149"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709042086149"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709042086149"}]},"ts":"1709042086149"} 2024-02-27 13:54:46,153 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE; OpenRegionProcedure 7d35db972a5a8c020a495a982c6dc95a, server=jenkins-hbase4.apache.org,36357,1709042080636}] 2024-02-27 13:54:46,189 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-02-27 13:54:46,305 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:54:46,312 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin2,,1709042085930.7d35db972a5a8c020a495a982c6dc95a. 2024-02-27 13:54:46,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7d35db972a5a8c020a495a982c6dc95a, NAME => 'TestQuotaAdmin2,,1709042085930.7d35db972a5a8c020a495a982c6dc95a.', STARTKEY => '', ENDKEY => ''} 2024-02-27 13:54:46,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin2 7d35db972a5a8c020a495a982c6dc95a 2024-02-27 13:54:46,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1709042085930.7d35db972a5a8c020a495a982c6dc95a.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 13:54:46,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7d35db972a5a8c020a495a982c6dc95a 2024-02-27 13:54:46,313 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7d35db972a5a8c020a495a982c6dc95a 2024-02-27 13:54:46,315 INFO [StoreOpener-7d35db972a5a8c020a495a982c6dc95a-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7d35db972a5a8c020a495a982c6dc95a 2024-02-27 13:54:46,317 DEBUG [StoreOpener-7d35db972a5a8c020a495a982c6dc95a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/default/TestQuotaAdmin2/7d35db972a5a8c020a495a982c6dc95a/cf 2024-02-27 13:54:46,317 DEBUG [StoreOpener-7d35db972a5a8c020a495a982c6dc95a-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/default/TestQuotaAdmin2/7d35db972a5a8c020a495a982c6dc95a/cf 2024-02-27 13:54:46,317 INFO [StoreOpener-7d35db972a5a8c020a495a982c6dc95a-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7d35db972a5a8c020a495a982c6dc95a columnFamilyName cf 2024-02-27 13:54:46,318 INFO [StoreOpener-7d35db972a5a8c020a495a982c6dc95a-1] regionserver.HStore(310): Store=7d35db972a5a8c020a495a982c6dc95a/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 13:54:46,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/default/TestQuotaAdmin2/7d35db972a5a8c020a495a982c6dc95a 2024-02-27 13:54:46,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/default/TestQuotaAdmin2/7d35db972a5a8c020a495a982c6dc95a 2024-02-27 13:54:46,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7d35db972a5a8c020a495a982c6dc95a 2024-02-27 13:54:46,329 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/default/TestQuotaAdmin2/7d35db972a5a8c020a495a982c6dc95a/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-27 13:54:46,330 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7d35db972a5a8c020a495a982c6dc95a; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68431105, jitterRate=0.01970292627811432}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-02-27 13:54:46,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7d35db972a5a8c020a495a982c6dc95a: 2024-02-27 13:54:46,332 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin2,,1709042085930.7d35db972a5a8c020a495a982c6dc95a., pid=20, masterSystemTime=1709042086305 2024-02-27 13:54:46,335 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin2,,1709042085930.7d35db972a5a8c020a495a982c6dc95a. 2024-02-27 13:54:46,335 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin2,,1709042085930.7d35db972a5a8c020a495a982c6dc95a. 2024-02-27 13:54:46,336 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=7d35db972a5a8c020a495a982c6dc95a, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:54:46,336 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin2,,1709042085930.7d35db972a5a8c020a495a982c6dc95a.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709042086336"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1709042086336"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1709042086336"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1709042086336"}]},"ts":"1709042086336"} 2024-02-27 13:54:46,341 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=20, resume processing ppid=19 2024-02-27 13:54:46,341 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=20, ppid=19, state=SUCCESS; OpenRegionProcedure 7d35db972a5a8c020a495a982c6dc95a, server=jenkins-hbase4.apache.org,36357,1709042080636 in 185 msec 2024-02-27 13:54:46,344 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=19, resume processing ppid=18 2024-02-27 13:54:46,345 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=19, ppid=18, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=7d35db972a5a8c020a495a982c6dc95a, ASSIGN in 346 msec 2024-02-27 13:54:46,346 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-02-27 13:54:46,346 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709042086346"}]},"ts":"1709042086346"} 2024-02-27 13:54:46,348 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLED in hbase:meta 2024-02-27 13:54:46,351 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_POST_OPERATION 2024-02-27 13:54:46,353 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=18, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin2 in 420 msec 2024-02-27 13:54:46,691 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-02-27 13:54:46,691 INFO [Listener at localhost/33159] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin2, procId: 18 completed 2024-02-27 13:54:46,692 DEBUG [Listener at localhost/33159] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin2 get assigned. Timeout = 60000ms 2024-02-27 13:54:46,692 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:54:46,696 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin2 assigned to meta. Checking AM states. 2024-02-27 13:54:46,696 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:54:46,696 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin2 assigned. 2024-02-27 13:54:46,697 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:54:46,711 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.HMaster$15(3020): Client=jenkins//172.31.14.131 creating {NAME => 'TestNs'} 2024-02-27 13:54:46,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] procedure2.ProcedureExecutor(1075): Stored pid=21, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=TestNs 2024-02-27 13:54:46,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-02-27 13:54:46,728 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-02-27 13:54:46,733 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=21, state=SUCCESS; CreateNamespaceProcedure, namespace=TestNs in 19 msec 2024-02-27 13:54:46,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-02-27 13:54:46,976 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-02-27 13:54:46,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] procedure2.ProcedureExecutor(1075): Stored pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestNs:TestTable 2024-02-27 13:54:46,979 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_PRE_OPERATION 2024-02-27 13:54:46,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "TestNs" qualifier: "TestTable" procId is: 22 2024-02-27 13:54:46,981 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-02-27 13:54:46,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-02-27 13:54:46,985 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/TestNs/TestTable/6a22c6b91ba285f9c0135f27487952a6 2024-02-27 13:54:46,985 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/TestNs/TestTable/7c31adc03fd9b4bb2274da60b6194537 2024-02-27 13:54:46,985 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/TestNs/TestTable/6a22c6b91ba285f9c0135f27487952a6 empty. 2024-02-27 13:54:46,986 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/TestNs/TestTable/7c31adc03fd9b4bb2274da60b6194537 empty. 2024-02-27 13:54:46,986 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/TestNs/TestTable/6a22c6b91ba285f9c0135f27487952a6 2024-02-27 13:54:46,986 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/TestNs/TestTable/7c31adc03fd9b4bb2274da60b6194537 2024-02-27 13:54:46,986 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-02-27 13:54:47,005 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/TestNs/TestTable/.tabledesc/.tableinfo.0000000001 2024-02-27 13:54:47,007 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(7675): creating {ENCODED => 7c31adc03fd9b4bb2274da60b6194537, NAME => 'TestNs:TestTable,1,1709042086975.7c31adc03fd9b4bb2274da60b6194537.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp 2024-02-27 13:54:47,007 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6a22c6b91ba285f9c0135f27487952a6, NAME => 'TestNs:TestTable,,1709042086975.6a22c6b91ba285f9c0135f27487952a6.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp 2024-02-27 13:54:47,029 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1709042086975.7c31adc03fd9b4bb2274da60b6194537.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 13:54:47,029 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1604): Closing 7c31adc03fd9b4bb2274da60b6194537, disabling compactions & flushes 2024-02-27 13:54:47,030 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1709042086975.7c31adc03fd9b4bb2274da60b6194537. 2024-02-27 13:54:47,030 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1709042086975.7c31adc03fd9b4bb2274da60b6194537. 2024-02-27 13:54:47,030 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1709042086975.7c31adc03fd9b4bb2274da60b6194537. after waiting 0 ms 2024-02-27 13:54:47,030 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1709042086975.7c31adc03fd9b4bb2274da60b6194537. 2024-02-27 13:54:47,030 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1709042086975.7c31adc03fd9b4bb2274da60b6194537. 2024-02-27 13:54:47,030 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1558): Region close journal for 7c31adc03fd9b4bb2274da60b6194537: 2024-02-27 13:54:47,031 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1709042086975.6a22c6b91ba285f9c0135f27487952a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 13:54:47,032 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1604): Closing 6a22c6b91ba285f9c0135f27487952a6, disabling compactions & flushes 2024-02-27 13:54:47,032 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1709042086975.6a22c6b91ba285f9c0135f27487952a6. 2024-02-27 13:54:47,032 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1709042086975.6a22c6b91ba285f9c0135f27487952a6. 2024-02-27 13:54:47,032 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1709042086975.6a22c6b91ba285f9c0135f27487952a6. after waiting 0 ms 2024-02-27 13:54:47,032 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1709042086975.6a22c6b91ba285f9c0135f27487952a6. 2024-02-27 13:54:47,032 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1709042086975.6a22c6b91ba285f9c0135f27487952a6. 2024-02-27 13:54:47,032 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1558): Region close journal for 6a22c6b91ba285f9c0135f27487952a6: 2024-02-27 13:54:47,036 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ADD_TO_META 2024-02-27 13:54:47,038 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1709042086975.7c31adc03fd9b4bb2274da60b6194537.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709042087038"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709042087038"}]},"ts":"1709042087038"} 2024-02-27 13:54:47,038 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,,1709042086975.6a22c6b91ba285f9c0135f27487952a6.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709042087038"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709042087038"}]},"ts":"1709042087038"} 2024-02-27 13:54:47,045 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2024-02-27 13:54:47,046 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-02-27 13:54:47,046 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709042087046"}]},"ts":"1709042087046"} 2024-02-27 13:54:47,048 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLING in hbase:meta 2024-02-27 13:54:47,054 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-02-27 13:54:47,056 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-02-27 13:54:47,056 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-02-27 13:54:47,056 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-02-27 13:54:47,057 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=6a22c6b91ba285f9c0135f27487952a6, ASSIGN}, {pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=7c31adc03fd9b4bb2274da60b6194537, ASSIGN}] 2024-02-27 13:54:47,059 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=7c31adc03fd9b4bb2274da60b6194537, ASSIGN 2024-02-27 13:54:47,059 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=6a22c6b91ba285f9c0135f27487952a6, ASSIGN 2024-02-27 13:54:47,060 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=7c31adc03fd9b4bb2274da60b6194537, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,36357,1709042080636; forceNewPlan=false, retain=false 2024-02-27 13:54:47,060 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=6a22c6b91ba285f9c0135f27487952a6, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,33695,1709042080686; forceNewPlan=false, retain=false 2024-02-27 13:54:47,210 INFO [jenkins-hbase4:41827] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2024-02-27 13:54:47,212 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=7c31adc03fd9b4bb2274da60b6194537, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:54:47,212 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=6a22c6b91ba285f9c0135f27487952a6, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,33695,1709042080686 2024-02-27 13:54:47,212 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1709042086975.7c31adc03fd9b4bb2274da60b6194537.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709042087212"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709042087212"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709042087212"}]},"ts":"1709042087212"} 2024-02-27 13:54:47,212 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1709042086975.6a22c6b91ba285f9c0135f27487952a6.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709042087212"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709042087212"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709042087212"}]},"ts":"1709042087212"} 2024-02-27 13:54:47,215 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 7c31adc03fd9b4bb2274da60b6194537, server=jenkins-hbase4.apache.org,36357,1709042080636}] 2024-02-27 13:54:47,217 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=26, ppid=23, state=RUNNABLE; OpenRegionProcedure 6a22c6b91ba285f9c0135f27487952a6, server=jenkins-hbase4.apache.org,33695,1709042080686}] 2024-02-27 13:54:47,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-02-27 13:54:47,368 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:54:47,371 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,33695,1709042080686 2024-02-27 13:54:47,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,1,1709042086975.7c31adc03fd9b4bb2274da60b6194537. 2024-02-27 13:54:47,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7c31adc03fd9b4bb2274da60b6194537, NAME => 'TestNs:TestTable,1,1709042086975.7c31adc03fd9b4bb2274da60b6194537.', STARTKEY => '1', ENDKEY => ''} 2024-02-27 13:54:47,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable 7c31adc03fd9b4bb2274da60b6194537 2024-02-27 13:54:47,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1709042086975.7c31adc03fd9b4bb2274da60b6194537.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 13:54:47,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7c31adc03fd9b4bb2274da60b6194537 2024-02-27 13:54:47,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7c31adc03fd9b4bb2274da60b6194537 2024-02-27 13:54:47,376 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,,1709042086975.6a22c6b91ba285f9c0135f27487952a6. 2024-02-27 13:54:47,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6a22c6b91ba285f9c0135f27487952a6, NAME => 'TestNs:TestTable,,1709042086975.6a22c6b91ba285f9c0135f27487952a6.', STARTKEY => '', ENDKEY => '1'} 2024-02-27 13:54:47,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable 6a22c6b91ba285f9c0135f27487952a6 2024-02-27 13:54:47,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1709042086975.6a22c6b91ba285f9c0135f27487952a6.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-02-27 13:54:47,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6a22c6b91ba285f9c0135f27487952a6 2024-02-27 13:54:47,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6a22c6b91ba285f9c0135f27487952a6 2024-02-27 13:54:47,378 INFO [StoreOpener-7c31adc03fd9b4bb2274da60b6194537-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7c31adc03fd9b4bb2274da60b6194537 2024-02-27 13:54:47,378 INFO [StoreOpener-6a22c6b91ba285f9c0135f27487952a6-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 6a22c6b91ba285f9c0135f27487952a6 2024-02-27 13:54:47,380 DEBUG [StoreOpener-7c31adc03fd9b4bb2274da60b6194537-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/TestNs/TestTable/7c31adc03fd9b4bb2274da60b6194537/cf 2024-02-27 13:54:47,380 DEBUG [StoreOpener-7c31adc03fd9b4bb2274da60b6194537-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/TestNs/TestTable/7c31adc03fd9b4bb2274da60b6194537/cf 2024-02-27 13:54:47,380 DEBUG [StoreOpener-6a22c6b91ba285f9c0135f27487952a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/TestNs/TestTable/6a22c6b91ba285f9c0135f27487952a6/cf 2024-02-27 13:54:47,380 DEBUG [StoreOpener-6a22c6b91ba285f9c0135f27487952a6-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/TestNs/TestTable/6a22c6b91ba285f9c0135f27487952a6/cf 2024-02-27 13:54:47,381 INFO [StoreOpener-6a22c6b91ba285f9c0135f27487952a6-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6a22c6b91ba285f9c0135f27487952a6 columnFamilyName cf 2024-02-27 13:54:47,381 INFO [StoreOpener-7c31adc03fd9b4bb2274da60b6194537-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7c31adc03fd9b4bb2274da60b6194537 columnFamilyName cf 2024-02-27 13:54:47,382 INFO [StoreOpener-6a22c6b91ba285f9c0135f27487952a6-1] regionserver.HStore(310): Store=6a22c6b91ba285f9c0135f27487952a6/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 13:54:47,382 INFO [StoreOpener-7c31adc03fd9b4bb2274da60b6194537-1] regionserver.HStore(310): Store=7c31adc03fd9b4bb2274da60b6194537/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-02-27 13:54:47,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/TestNs/TestTable/6a22c6b91ba285f9c0135f27487952a6 2024-02-27 13:54:47,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/TestNs/TestTable/7c31adc03fd9b4bb2274da60b6194537 2024-02-27 13:54:47,385 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/TestNs/TestTable/6a22c6b91ba285f9c0135f27487952a6 2024-02-27 13:54:47,386 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/TestNs/TestTable/7c31adc03fd9b4bb2274da60b6194537 2024-02-27 13:54:47,390 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6a22c6b91ba285f9c0135f27487952a6 2024-02-27 13:54:47,392 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7c31adc03fd9b4bb2274da60b6194537 2024-02-27 13:54:47,394 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/TestNs/TestTable/6a22c6b91ba285f9c0135f27487952a6/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-27 13:54:47,395 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6a22c6b91ba285f9c0135f27487952a6; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74224457, jitterRate=0.10603059828281403}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-02-27 13:54:47,395 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6a22c6b91ba285f9c0135f27487952a6: 2024-02-27 13:54:47,396 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/TestNs/TestTable/7c31adc03fd9b4bb2274da60b6194537/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-02-27 13:54:47,396 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestNs:TestTable,,1709042086975.6a22c6b91ba285f9c0135f27487952a6., pid=26, masterSystemTime=1709042087371 2024-02-27 13:54:47,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7c31adc03fd9b4bb2274da60b6194537; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63245281, jitterRate=-0.05757187306880951}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-02-27 13:54:47,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7c31adc03fd9b4bb2274da60b6194537: 2024-02-27 13:54:47,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestNs:TestTable,,1709042086975.6a22c6b91ba285f9c0135f27487952a6. 2024-02-27 13:54:47,400 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,,1709042086975.6a22c6b91ba285f9c0135f27487952a6. 2024-02-27 13:54:47,400 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestNs:TestTable,1,1709042086975.7c31adc03fd9b4bb2274da60b6194537., pid=25, masterSystemTime=1709042087368 2024-02-27 13:54:47,400 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=6a22c6b91ba285f9c0135f27487952a6, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,33695,1709042080686 2024-02-27 13:54:47,400 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,,1709042086975.6a22c6b91ba285f9c0135f27487952a6.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709042087400"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1709042087400"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1709042087400"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1709042087400"}]},"ts":"1709042087400"} 2024-02-27 13:54:47,403 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestNs:TestTable,1,1709042086975.7c31adc03fd9b4bb2274da60b6194537. 2024-02-27 13:54:47,403 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,1,1709042086975.7c31adc03fd9b4bb2274da60b6194537. 2024-02-27 13:54:47,404 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=7c31adc03fd9b4bb2274da60b6194537, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:54:47,405 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,1,1709042086975.7c31adc03fd9b4bb2274da60b6194537.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709042087404"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1709042087404"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1709042087404"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1709042087404"}]},"ts":"1709042087404"} 2024-02-27 13:54:47,408 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=26, resume processing ppid=23 2024-02-27 13:54:47,408 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=26, ppid=23, state=SUCCESS; OpenRegionProcedure 6a22c6b91ba285f9c0135f27487952a6, server=jenkins-hbase4.apache.org,33695,1709042080686 in 186 msec 2024-02-27 13:54:47,410 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=23, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=6a22c6b91ba285f9c0135f27487952a6, ASSIGN in 352 msec 2024-02-27 13:54:47,413 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=25, resume processing ppid=24 2024-02-27 13:54:47,413 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 7c31adc03fd9b4bb2274da60b6194537, server=jenkins-hbase4.apache.org,36357,1709042080636 in 193 msec 2024-02-27 13:54:47,416 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=24, resume processing ppid=22 2024-02-27 13:54:47,416 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=24, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=7c31adc03fd9b4bb2274da60b6194537, ASSIGN in 357 msec 2024-02-27 13:54:47,417 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-02-27 13:54:47,418 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709042087418"}]},"ts":"1709042087418"} 2024-02-27 13:54:47,420 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLED in hbase:meta 2024-02-27 13:54:47,424 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_POST_OPERATION 2024-02-27 13:54:47,434 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=22, state=SUCCESS; CreateTableProcedure table=TestNs:TestTable in 448 msec 2024-02-27 13:54:47,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-02-27 13:54:47,736 INFO [Listener at localhost/33159] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: TestNs:TestTable, procId: 22 completed 2024-02-27 13:54:47,736 DEBUG [Listener at localhost/33159] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestNs:TestTable get assigned. Timeout = 60000ms 2024-02-27 13:54:47,736 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:54:47,741 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(3484): All regions for table TestNs:TestTable assigned to meta. Checking AM states. 2024-02-27 13:54:47,741 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:54:47,741 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(3504): All regions for table TestNs:TestTable assigned. 2024-02-27 13:54:47,741 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:54:47,819 INFO [Listener at localhost/33159] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=306, OpenFileDescriptor=627, MaxFileDescriptor=60000, SystemLoadAverage=268, ProcessCount=172, AvailableMemoryMB=6665 2024-02-27 13:54:47,943 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2024-02-27 13:54:47,997 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin0' 2024-02-27 13:54:47,998 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestNs:TestTable' 2024-02-27 13:54:47,999 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2024-02-27 13:54:48,000 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2024-02-27 13:54:48,000 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin2' 2024-02-27 13:54:48,001 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin1' 2024-02-27 13:54:48,001 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:quota' 2024-02-27 13:54:48,110 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:54:48,110 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 13:54:48,111 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709045687859 bypass), TestNs=QuotaState(ts=1709045687859 bypass)} 2024-02-27 13:54:48,111 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709045687859 bypass), TestQuotaAdmin2=QuotaState(ts=1709045687859 bypass), TestQuotaAdmin1=QuotaState(ts=1709045687859 bypass)} 2024-02-27 13:54:48,111 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709045687859 [ TestNs:TestTable ])} 2024-02-27 13:54:48,111 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709045687859 bypass)} 2024-02-27 13:54:48,361 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:54:48,361 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 13:54:48,361 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709045687859 bypass), TestNs=QuotaState(ts=1709045687859 bypass)} 2024-02-27 13:54:48,361 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709045687859 bypass), TestNs:TestTable=QuotaState(ts=1709045687859 bypass)} 2024-02-27 13:54:48,361 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709045687859 [ TestNs:TestTable ])} 2024-02-27 13:54:48,361 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709045687859 bypass)} 2024-02-27 13:54:48,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:54:48,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] ipc.CallRunner(144): callId: 90 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:36854 deadline: 1709042098377, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:54:48,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:54:48,652 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] ipc.CallRunner(144): callId: 92 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:36854 deadline: 1709042098377, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:54:49,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:54:49,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] ipc.CallRunner(144): callId: 94 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:36854 deadline: 1709042098378, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:54:49,542 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-02-27 13:54:49,542 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver Metrics about HBase MasterObservers 2024-02-27 13:54:49,543 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-02-27 13:54:49,543 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2024-02-27 13:54:49,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:54:49,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] ipc.CallRunner(144): callId: 96 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:36854 deadline: 1709042098378, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:54:51,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:54:51,175 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] ipc.CallRunner(144): callId: 98 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:36854 deadline: 1709042098378, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:54:52,878 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2024-02-27 13:54:53,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:54:53,687 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] ipc.CallRunner(144): callId: 100 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:36854 deadline: 1709042098378, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:54:53,688 ERROR [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10319: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1709042086975.7c31adc03fd9b4bb2274da60b6194537., hostname=jenkins-hbase4.apache.org,36357,1709042080636, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-27 13:54:53,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:54:53,692 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] ipc.CallRunner(144): callId: 101 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:36854 deadline: 1709042103691, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:54:53,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:54:53,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] ipc.CallRunner(144): callId: 103 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:36854 deadline: 1709042103691, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:54:54,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:54:54,455 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] ipc.CallRunner(144): callId: 105 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:36854 deadline: 1709042103691, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:54:55,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:54:55,216 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] ipc.CallRunner(144): callId: 107 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:36854 deadline: 1709042103691, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:54:56,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:54:56,479 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] ipc.CallRunner(144): callId: 109 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:36854 deadline: 1709042103692, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:54:58,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:54:58,989 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] ipc.CallRunner(144): callId: 111 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:36854 deadline: 1709042103692, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:54:58,990 ERROR [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10341: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1709042086975.7c31adc03fd9b4bb2274da60b6194537., hostname=jenkins-hbase4.apache.org,36357,1709042080636, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-27 13:54:59,252 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:54:59,252 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 13:54:59,252 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709049287859 bypass), TestNs=QuotaState(ts=1709049287859 bypass)} 2024-02-27 13:54:59,252 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709049287859 bypass), TestQuotaAdmin2=QuotaState(ts=1709049287859 bypass), TestQuotaAdmin1=QuotaState(ts=1709049287859 bypass)} 2024-02-27 13:54:59,252 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709049287859 bypass)} 2024-02-27 13:54:59,252 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709049287859 bypass)} 2024-02-27 13:54:59,502 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:54:59,503 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 13:54:59,503 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709049287859 bypass), TestNs=QuotaState(ts=1709049287859 bypass)} 2024-02-27 13:54:59,503 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709049287859 bypass), TestNs:TestTable=QuotaState(ts=1709049287859 bypass)} 2024-02-27 13:54:59,503 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709049287859 bypass)} 2024-02-27 13:54:59,503 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709049287859 bypass)} 2024-02-27 13:54:59,519 INFO [Listener at localhost/33159] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=290 (was 306), OpenFileDescriptor=599 (was 627), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=242 (was 268), ProcessCount=172 (was 172), AvailableMemoryMB=6651 (was 6665) 2024-02-27 13:54:59,532 INFO [Listener at localhost/33159] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=290, OpenFileDescriptor=599, MaxFileDescriptor=60000, SystemLoadAverage=242, ProcessCount=172, AvailableMemoryMB=6651 2024-02-27 13:54:59,797 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:54:59,798 INFO [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-02-27 13:55:00,048 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 13:55:00,049 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709052887959 bypass), TestNs=QuotaState(ts=1709052887959 bypass)} 2024-02-27 13:55:00,050 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709052887959 bypass), TestQuotaAdmin2=QuotaState(ts=1709052887959 bypass), TestQuotaAdmin1=QuotaState(ts=1709052887959 bypass)} 2024-02-27 13:55:00,050 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709052887959 [ default ])} 2024-02-27 13:55:00,050 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709052887959 bypass)} 2024-02-27 13:55:00,300 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:55:00,301 INFO [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-02-27 13:55:00,551 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 13:55:00,552 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709052888059 bypass), TestNs=QuotaState(ts=1709052888059 bypass)} 2024-02-27 13:55:00,553 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709052888059 bypass), TestNs:TestTable=QuotaState(ts=1709052888059 bypass)} 2024-02-27 13:55:00,553 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709052888059 [ default ])} 2024-02-27 13:55:00,553 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709052888059 bypass)} 2024-02-27 13:55:00,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-02-27 13:55:00,563 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 123 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:49518 deadline: 1709042110563, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-02-27 13:55:00,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-02-27 13:55:00,819 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 125 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:49518 deadline: 1709042110562, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-02-27 13:55:01,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-02-27 13:55:01,327 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 127 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:49518 deadline: 1709042110562, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-02-27 13:55:02,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-02-27 13:55:02,086 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 129 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:49518 deadline: 1709042110563, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-02-27 13:55:03,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-02-27 13:55:03,343 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 131 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:49518 deadline: 1709042110563, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-02-27 13:55:05,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-02-27 13:55:05,863 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 133 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:49518 deadline: 1709042110562, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-02-27 13:55:05,865 ERROR [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10325: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014., hostname=jenkins-hbase4.apache.org,33695,1709042080686, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:199) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-27 13:55:05,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:05,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 140 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:49518 deadline: 1709042115882, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:06,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:06,139 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 142 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:49518 deadline: 1709042115882, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:06,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:06,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 144 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:49518 deadline: 1709042115882, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:07,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:07,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 146 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:49518 deadline: 1709042115882, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:08,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:08,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 148 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:49518 deadline: 1709042115882, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:11,184 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:11,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 150 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:49518 deadline: 1709042115883, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:11,186 ERROR [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10325: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014., hostname=jenkins-hbase4.apache.org,33695,1709042080686, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:200) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-27 13:55:11,444 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:55:11,444 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 13:55:11,444 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709056488059 bypass), TestNs=QuotaState(ts=1709056488059 bypass)} 2024-02-27 13:55:11,444 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709056488059 bypass), TestQuotaAdmin2=QuotaState(ts=1709056488059 bypass), TestQuotaAdmin1=QuotaState(ts=1709056488059 bypass)} 2024-02-27 13:55:11,444 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709056488059 bypass)} 2024-02-27 13:55:11,444 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709056488059 bypass)} 2024-02-27 13:55:11,695 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:55:11,696 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 13:55:11,696 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709056488059 bypass), TestNs=QuotaState(ts=1709056488059 bypass)} 2024-02-27 13:55:11,696 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709056488059 bypass), TestNs:TestTable=QuotaState(ts=1709056488059 bypass)} 2024-02-27 13:55:11,696 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709056488059 bypass)} 2024-02-27 13:55:11,696 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709056488059 bypass)} 2024-02-27 13:55:11,710 INFO [Listener at localhost/33159] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=290 (was 290), OpenFileDescriptor=595 (was 599), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=220 (was 242), ProcessCount=172 (was 172), AvailableMemoryMB=6646 (was 6651) 2024-02-27 13:55:11,723 INFO [Listener at localhost/33159] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=290, OpenFileDescriptor=595, MaxFileDescriptor=60000, SystemLoadAverage=220, ProcessCount=172, AvailableMemoryMB=6645 2024-02-27 13:55:11,986 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:55:11,986 INFO [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-02-27 13:55:12,236 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 13:55:12,237 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709060088159 bypass), TestNs=QuotaState(ts=1709060088159 bypass)} 2024-02-27 13:55:12,238 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709060088159 bypass), TestQuotaAdmin2=QuotaState(ts=1709060088159 bypass), TestQuotaAdmin1=QuotaState(ts=1709060088159 bypass)} 2024-02-27 13:55:12,238 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709060088159 global-limiter)} 2024-02-27 13:55:12,238 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709060088159 bypass)} 2024-02-27 13:55:12,489 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:55:12,489 INFO [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-02-27 13:55:12,739 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 13:55:12,741 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709060088259 bypass), TestNs=QuotaState(ts=1709060088259 bypass)} 2024-02-27 13:55:12,741 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709060088259 bypass), TestNs:TestTable=QuotaState(ts=1709060088259 bypass)} 2024-02-27 13:55:12,741 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709060088259 global-limiter)} 2024-02-27 13:55:12,742 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709060088259 bypass)} 2024-02-27 13:55:12,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:12,758 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 163 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:49518 deadline: 1709042122758, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:13,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:13,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 165 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:49518 deadline: 1709042122758, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:13,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:13,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 167 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:49518 deadline: 1709042122757, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:14,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:14,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 169 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:49518 deadline: 1709042122757, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:15,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:15,540 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 171 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:49518 deadline: 1709042122758, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:18,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:18,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 173 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:49518 deadline: 1709042122757, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:18,066 ERROR [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10317: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014., hostname=jenkins-hbase4.apache.org,33695,1709042080686, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:178) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-27 13:55:18,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-02-27 13:55:18,073 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 177 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:49518 deadline: 1709042128073, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-02-27 13:55:18,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-02-27 13:55:18,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 179 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:49518 deadline: 1709042128073, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-02-27 13:55:18,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-02-27 13:55:18,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 181 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:49518 deadline: 1709042128072, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-02-27 13:55:19,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-02-27 13:55:19,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 183 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:49518 deadline: 1709042128073, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-02-27 13:55:20,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-02-27 13:55:20,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 185 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:49518 deadline: 1709042128073, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-02-27 13:55:23,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-02-27 13:55:23,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 187 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:49518 deadline: 1709042128073, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-02-27 13:55:23,384 ERROR [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=3 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10329: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-3' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014., hostname=jenkins-hbase4.apache.org,33695,1709042080686, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-27 13:55:23,640 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:55:23,640 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 13:55:23,641 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709063688259 bypass), TestNs=QuotaState(ts=1709063688259 bypass)} 2024-02-27 13:55:23,641 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709063688259 bypass), TestQuotaAdmin2=QuotaState(ts=1709063688259 bypass), TestQuotaAdmin1=QuotaState(ts=1709063688259 bypass)} 2024-02-27 13:55:23,641 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709063688259 bypass)} 2024-02-27 13:55:23,641 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709063688259 bypass)} 2024-02-27 13:55:23,891 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:55:23,891 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 13:55:23,891 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709063688259 bypass), TestNs=QuotaState(ts=1709063688259 bypass)} 2024-02-27 13:55:23,891 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709063688259 bypass), TestNs:TestTable=QuotaState(ts=1709063688259 bypass)} 2024-02-27 13:55:23,891 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709063688259 bypass)} 2024-02-27 13:55:23,891 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709063688259 bypass)} 2024-02-27 13:55:23,905 INFO [Listener at localhost/33159] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=281 (was 290), OpenFileDescriptor=593 (was 595), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=194 (was 220), ProcessCount=172 (was 172), AvailableMemoryMB=7074 (was 6645) - AvailableMemoryMB LEAK? - 2024-02-27 13:55:23,918 INFO [Listener at localhost/33159] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=281, OpenFileDescriptor=593, MaxFileDescriptor=60000, SystemLoadAverage=194, ProcessCount=172, AvailableMemoryMB=7073 2024-02-27 13:55:24,176 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:55:24,177 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 13:55:24,177 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709067288259 bypass), TestNs=QuotaState(ts=1709067288259 bypass)} 2024-02-27 13:55:24,179 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709067288259 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin2=QuotaState(ts=1709067288259 bypass), TestQuotaAdmin1=QuotaState(ts=1709067288259 bypass)} 2024-02-27 13:55:24,179 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(218): {} 2024-02-27 13:55:24,180 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709067288259 bypass)} 2024-02-27 13:55:24,430 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:55:24,430 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 13:55:24,430 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709067288259 bypass), TestNs=QuotaState(ts=1709067288259 bypass)} 2024-02-27 13:55:24,431 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709067288259 bypass), TestNs:TestTable=QuotaState(ts=1709067288259 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000)))} 2024-02-27 13:55:24,431 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(218): {} 2024-02-27 13:55:24,431 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709067288259 bypass)} 2024-02-27 13:55:24,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:55:24,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] ipc.CallRunner(144): callId: 202 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:36854 deadline: 1709042134447, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:55:24,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:55:24,701 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] ipc.CallRunner(144): callId: 204 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:36854 deadline: 1709042134447, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:55:25,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:55:25,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] ipc.CallRunner(144): callId: 206 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:36854 deadline: 1709042134447, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:55:25,965 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:55:25,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] ipc.CallRunner(144): callId: 208 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:36854 deadline: 1709042134446, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:55:27,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:55:27,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] ipc.CallRunner(144): callId: 210 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:36854 deadline: 1709042134447, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:55:29,748 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:55:29,749 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] ipc.CallRunner(144): callId: 212 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:36854 deadline: 1709042134446, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:55:29,749 ERROR [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10310: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1709042086975.7c31adc03fd9b4bb2274da60b6194537., hostname=jenkins-hbase4.apache.org,36357,1709042080636, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-27 13:55:29,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:55:29,751 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] ipc.CallRunner(144): callId: 213 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:36854 deadline: 1709042139751, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:55:30,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:55:30,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] ipc.CallRunner(144): callId: 215 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:36854 deadline: 1709042139751, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:55:30,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:55:30,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] ipc.CallRunner(144): callId: 217 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:36854 deadline: 1709042139750, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:55:31,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:55:31,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] ipc.CallRunner(144): callId: 219 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:36854 deadline: 1709042139751, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:55:32,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:55:32,534 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] ipc.CallRunner(144): callId: 221 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:36854 deadline: 1709042139750, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:55:35,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:55:35,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=36357] ipc.CallRunner(144): callId: 223 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:36854 deadline: 1709042139751, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-02-27 13:55:35,056 ERROR [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10348: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1709042086975.7c31adc03fd9b4bb2274da60b6194537., hostname=jenkins-hbase4.apache.org,36357,1709042080636, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-27 13:55:35,315 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:55:35,316 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 13:55:35,316 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709070888259 bypass), TestNs=QuotaState(ts=1709070888259 bypass)} 2024-02-27 13:55:35,316 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709070888259 bypass), TestQuotaAdmin2=QuotaState(ts=1709070888259 bypass), TestQuotaAdmin1=QuotaState(ts=1709070888259 bypass)} 2024-02-27 13:55:35,316 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709070888259 bypass)} 2024-02-27 13:55:35,316 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709070888259 bypass)} 2024-02-27 13:55:35,566 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:55:35,566 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 13:55:35,566 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709070888259 bypass), TestNs=QuotaState(ts=1709070888259 bypass)} 2024-02-27 13:55:35,566 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709070888259 bypass), TestNs:TestTable=QuotaState(ts=1709070888259 bypass)} 2024-02-27 13:55:35,567 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(218): {} 2024-02-27 13:55:35,567 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709070888259 bypass)} 2024-02-27 13:55:35,583 INFO [Listener at localhost/33159] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=280 (was 281), OpenFileDescriptor=593 (was 593), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=172 (was 194), ProcessCount=172 (was 172), AvailableMemoryMB=6967 (was 7073) 2024-02-27 13:55:35,597 INFO [Listener at localhost/33159] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=280, OpenFileDescriptor=593, MaxFileDescriptor=60000, SystemLoadAverage=172, ProcessCount=172, AvailableMemoryMB=6963 2024-02-27 13:55:35,858 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:55:35,858 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 13:55:35,859 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709074488259 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1709074488259 bypass)} 2024-02-27 13:55:35,859 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709074488259 bypass), TestQuotaAdmin2=QuotaState(ts=1709074488259 bypass), TestQuotaAdmin1=QuotaState(ts=1709074488259 bypass)} 2024-02-27 13:55:35,859 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(218): {} 2024-02-27 13:55:35,860 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709074488259 bypass)} 2024-02-27 13:55:36,110 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:55:36,110 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 13:55:36,112 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709074488259 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1709074488259 bypass)} 2024-02-27 13:55:36,112 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709074488259 bypass), TestNs:TestTable=QuotaState(ts=1709074488259 bypass)} 2024-02-27 13:55:36,112 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(218): {} 2024-02-27 13:55:36,112 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709074488259 bypass)} 2024-02-27 13:55:36,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-02-27 13:55:36,129 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 235 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:49518 deadline: 1709042146129, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-02-27 13:55:36,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-02-27 13:55:36,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 237 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:49518 deadline: 1709042146128, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-02-27 13:55:36,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-02-27 13:55:36,893 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 239 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:49518 deadline: 1709042146129, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-02-27 13:55:37,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-02-27 13:55:37,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 241 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:49518 deadline: 1709042146129, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-02-27 13:55:38,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-02-27 13:55:38,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 243 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:49518 deadline: 1709042146129, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-02-27 13:55:41,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-02-27 13:55:41,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 245 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:49518 deadline: 1709042146128, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-02-27 13:55:41,414 ERROR [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10306: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014., hostname=jenkins-hbase4.apache.org,33695,1709042080686, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:128) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-27 13:55:41,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:41,425 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 252 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:49518 deadline: 1709042151425, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:41,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:41,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 254 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:49518 deadline: 1709042151424, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:42,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:42,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 256 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:49518 deadline: 1709042151425, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:42,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:42,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 258 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:49518 deadline: 1709042151425, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:44,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:44,201 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 260 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:49518 deadline: 1709042151425, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:46,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:46,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=33695] ipc.CallRunner(144): callId: 262 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:49518 deadline: 1709042151424, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-02-27 13:55:46,708 ERROR [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10333: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014., hostname=jenkins-hbase4.apache.org,33695,1709042080686, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-02-27 13:55:46,965 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:55:46,966 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 13:55:46,966 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709078088259 bypass), TestNs=QuotaState(ts=1709078088259 bypass)} 2024-02-27 13:55:46,966 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1709078088259 bypass), TestQuotaAdmin2=QuotaState(ts=1709078088259 bypass), TestQuotaAdmin1=QuotaState(ts=1709078088259 bypass)} 2024-02-27 13:55:46,966 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(218): {} 2024-02-27 13:55:46,966 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709078088259 bypass)} 2024-02-27 13:55:47,216 INFO [Listener at localhost/33159] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-02-27 13:55:47,216 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-02-27 13:55:47,216 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1709078088259 bypass), TestNs=QuotaState(ts=1709078088259 bypass)} 2024-02-27 13:55:47,216 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1709078088259 bypass), TestNs:TestTable=QuotaState(ts=1709078088259 bypass)} 2024-02-27 13:55:47,216 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1709078088259 bypass)} 2024-02-27 13:55:47,216 DEBUG [Listener at localhost/33159] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1709078088259 bypass)} 2024-02-27 13:55:47,230 INFO [Listener at localhost/33159] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=266 (was 280), OpenFileDescriptor=584 (was 593), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=155 (was 172), ProcessCount=168 (was 172), AvailableMemoryMB=6500 (was 6963) 2024-02-27 13:55:47,233 INFO [Listener at localhost/33159] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin0 2024-02-27 13:55:47,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin0 2024-02-27 13:55:47,244 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] procedure2.ProcedureExecutor(1075): Stored pid=27, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin0 2024-02-27 13:55:47,248 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709042147248"}]},"ts":"1709042147248"} 2024-02-27 13:55:47,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-02-27 13:55:47,250 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLING in hbase:meta 2024-02-27 13:55:47,252 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set TestQuotaAdmin0 to state=DISABLING 2024-02-27 13:55:47,254 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=15d33d090e14d2c7e00b9d111cafd014, UNASSIGN}] 2024-02-27 13:55:47,256 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=15d33d090e14d2c7e00b9d111cafd014, UNASSIGN 2024-02-27 13:55:47,256 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=15d33d090e14d2c7e00b9d111cafd014, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33695,1709042080686 2024-02-27 13:55:47,257 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709042147256"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709042147256"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709042147256"}]},"ts":"1709042147256"} 2024-02-27 13:55:47,259 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure 15d33d090e14d2c7e00b9d111cafd014, server=jenkins-hbase4.apache.org,33695,1709042080686}] 2024-02-27 13:55:47,371 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase4.apache.org,33695,1709042080686, timeout=1709042147414, delay=43, operations=[pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure 15d33d090e14d2c7e00b9d111cafd014, server=jenkins-hbase4.apache.org,33695,1709042080686]] 2024-02-27 13:55:47,417 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,33695,1709042080686 2024-02-27 13:55:47,419 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 15d33d090e14d2c7e00b9d111cafd014 2024-02-27 13:55:47,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 15d33d090e14d2c7e00b9d111cafd014, disabling compactions & flushes 2024-02-27 13:55:47,421 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014. 2024-02-27 13:55:47,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014. 2024-02-27 13:55:47,421 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014. after waiting 0 ms 2024-02-27 13:55:47,422 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014. 2024-02-27 13:55:47,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 15d33d090e14d2c7e00b9d111cafd014 1/1 column families, dataSize=578 B heapSize=2.11 KB 2024-02-27 13:55:47,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-02-27 13:55:47,514 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=578 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/default/TestQuotaAdmin0/15d33d090e14d2c7e00b9d111cafd014/.tmp/cf/7f9d0817794447928c18a4cb599e48ab 2024-02-27 13:55:47,566 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/default/TestQuotaAdmin0/15d33d090e14d2c7e00b9d111cafd014/.tmp/cf/7f9d0817794447928c18a4cb599e48ab as hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/default/TestQuotaAdmin0/15d33d090e14d2c7e00b9d111cafd014/cf/7f9d0817794447928c18a4cb599e48ab 2024-02-27 13:55:47,578 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/default/TestQuotaAdmin0/15d33d090e14d2c7e00b9d111cafd014/cf/7f9d0817794447928c18a4cb599e48ab, entries=6, sequenceid=21, filesize=4.7 K 2024-02-27 13:55:47,582 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~578 B/578, heapSize ~2.09 KB/2144, currentSize=0 B/0 for 15d33d090e14d2c7e00b9d111cafd014 in 160ms, sequenceid=21, compaction requested=false 2024-02-27 13:55:47,591 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/default/TestQuotaAdmin0/15d33d090e14d2c7e00b9d111cafd014/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2024-02-27 13:55:47,593 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014. 2024-02-27 13:55:47,593 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 15d33d090e14d2c7e00b9d111cafd014: 2024-02-27 13:55:47,596 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 15d33d090e14d2c7e00b9d111cafd014 2024-02-27 13:55:47,597 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=15d33d090e14d2c7e00b9d111cafd014, regionState=CLOSED 2024-02-27 13:55:47,597 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709042147597"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709042147597"}]},"ts":"1709042147597"} 2024-02-27 13:55:47,601 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=29, resume processing ppid=28 2024-02-27 13:55:47,601 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=29, ppid=28, state=SUCCESS; CloseRegionProcedure 15d33d090e14d2c7e00b9d111cafd014, server=jenkins-hbase4.apache.org,33695,1709042080686 in 340 msec 2024-02-27 13:55:47,604 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=28, resume processing ppid=27 2024-02-27 13:55:47,604 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=15d33d090e14d2c7e00b9d111cafd014, UNASSIGN in 347 msec 2024-02-27 13:55:47,605 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709042147605"}]},"ts":"1709042147605"} 2024-02-27 13:55:47,607 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLED in hbase:meta 2024-02-27 13:55:47,609 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set TestQuotaAdmin0 to state=DISABLED 2024-02-27 13:55:47,612 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=27, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin0 in 371 msec 2024-02-27 13:55:48,002 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-02-27 13:55:48,002 INFO [Listener at localhost/33159] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin0, procId: 27 completed 2024-02-27 13:55:48,007 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin0 2024-02-27 13:55:48,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] procedure2.ProcedureExecutor(1075): Stored pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin0 2024-02-27 13:55:48,016 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-02-27 13:55:48,017 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=30, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-02-27 13:55:48,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-02-27 13:55:48,024 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/default/TestQuotaAdmin0/15d33d090e14d2c7e00b9d111cafd014 2024-02-27 13:55:48,028 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/default/TestQuotaAdmin0/15d33d090e14d2c7e00b9d111cafd014/cf, FileablePath, hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/default/TestQuotaAdmin0/15d33d090e14d2c7e00b9d111cafd014/recovered.edits] 2024-02-27 13:55:48,039 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/default/TestQuotaAdmin0/15d33d090e14d2c7e00b9d111cafd014/cf/7f9d0817794447928c18a4cb599e48ab to hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/archive/data/default/TestQuotaAdmin0/15d33d090e14d2c7e00b9d111cafd014/cf/7f9d0817794447928c18a4cb599e48ab 2024-02-27 13:55:48,045 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/default/TestQuotaAdmin0/15d33d090e14d2c7e00b9d111cafd014/recovered.edits/24.seqid to hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/archive/data/default/TestQuotaAdmin0/15d33d090e14d2c7e00b9d111cafd014/recovered.edits/24.seqid 2024-02-27 13:55:48,046 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/default/TestQuotaAdmin0/15d33d090e14d2c7e00b9d111cafd014 2024-02-27 13:55:48,046 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-02-27 13:55:48,050 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=30, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-02-27 13:55:48,070 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin0 from hbase:meta 2024-02-27 13:55:48,073 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin0' descriptor. 2024-02-27 13:55:48,075 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=30, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-02-27 13:55:48,075 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin0' from region states. 2024-02-27 13:55:48,075 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1709042148075"}]},"ts":"9223372036854775807"} 2024-02-27 13:55:48,077 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-02-27 13:55:48,077 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 15d33d090e14d2c7e00b9d111cafd014, NAME => 'TestQuotaAdmin0,,1709042084341.15d33d090e14d2c7e00b9d111cafd014.', STARTKEY => '', ENDKEY => ''}] 2024-02-27 13:55:48,077 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin0' as deleted. 2024-02-27 13:55:48,077 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1709042148077"}]},"ts":"9223372036854775807"} 2024-02-27 13:55:48,079 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin0 state from META 2024-02-27 13:55:48,082 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=30, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-02-27 13:55:48,083 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=30, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin0 in 74 msec 2024-02-27 13:55:48,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-02-27 13:55:48,273 INFO [Listener at localhost/33159] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin0, procId: 30 completed 2024-02-27 13:55:48,273 INFO [Listener at localhost/33159] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin1 2024-02-27 13:55:48,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin1 2024-02-27 13:55:48,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] procedure2.ProcedureExecutor(1075): Stored pid=31, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin1 2024-02-27 13:55:48,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-02-27 13:55:48,279 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709042148279"}]},"ts":"1709042148279"} 2024-02-27 13:55:48,281 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLING in hbase:meta 2024-02-27 13:55:48,283 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set TestQuotaAdmin1 to state=DISABLING 2024-02-27 13:55:48,284 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=457e0c5b3b0c6fdb5b124947c571679e, UNASSIGN}] 2024-02-27 13:55:48,285 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=457e0c5b3b0c6fdb5b124947c571679e, UNASSIGN 2024-02-27 13:55:48,286 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=457e0c5b3b0c6fdb5b124947c571679e, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:55:48,286 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1709042085148.457e0c5b3b0c6fdb5b124947c571679e.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709042148286"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709042148286"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709042148286"}]},"ts":"1709042148286"} 2024-02-27 13:55:48,288 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=33, ppid=32, state=RUNNABLE; CloseRegionProcedure 457e0c5b3b0c6fdb5b124947c571679e, server=jenkins-hbase4.apache.org,36357,1709042080636}] 2024-02-27 13:55:48,440 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:55:48,441 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 457e0c5b3b0c6fdb5b124947c571679e 2024-02-27 13:55:48,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 457e0c5b3b0c6fdb5b124947c571679e, disabling compactions & flushes 2024-02-27 13:55:48,442 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1709042085148.457e0c5b3b0c6fdb5b124947c571679e. 2024-02-27 13:55:48,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1709042085148.457e0c5b3b0c6fdb5b124947c571679e. 2024-02-27 13:55:48,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1709042085148.457e0c5b3b0c6fdb5b124947c571679e. after waiting 0 ms 2024-02-27 13:55:48,442 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1709042085148.457e0c5b3b0c6fdb5b124947c571679e. 2024-02-27 13:55:48,450 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/default/TestQuotaAdmin1/457e0c5b3b0c6fdb5b124947c571679e/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-02-27 13:55:48,451 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1709042085148.457e0c5b3b0c6fdb5b124947c571679e. 2024-02-27 13:55:48,451 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 457e0c5b3b0c6fdb5b124947c571679e: 2024-02-27 13:55:48,454 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 457e0c5b3b0c6fdb5b124947c571679e 2024-02-27 13:55:48,454 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=457e0c5b3b0c6fdb5b124947c571679e, regionState=CLOSED 2024-02-27 13:55:48,455 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1709042085148.457e0c5b3b0c6fdb5b124947c571679e.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709042148454"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709042148454"}]},"ts":"1709042148454"} 2024-02-27 13:55:48,459 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=33, resume processing ppid=32 2024-02-27 13:55:48,459 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=33, ppid=32, state=SUCCESS; CloseRegionProcedure 457e0c5b3b0c6fdb5b124947c571679e, server=jenkins-hbase4.apache.org,36357,1709042080636 in 168 msec 2024-02-27 13:55:48,461 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=32, resume processing ppid=31 2024-02-27 13:55:48,462 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=32, ppid=31, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=457e0c5b3b0c6fdb5b124947c571679e, UNASSIGN in 175 msec 2024-02-27 13:55:48,462 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709042148462"}]},"ts":"1709042148462"} 2024-02-27 13:55:48,464 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLED in hbase:meta 2024-02-27 13:55:48,465 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set TestQuotaAdmin1 to state=DISABLED 2024-02-27 13:55:48,468 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=31, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin1 in 192 msec 2024-02-27 13:55:48,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-02-27 13:55:48,530 INFO [Listener at localhost/33159] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin1, procId: 31 completed 2024-02-27 13:55:48,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin1 2024-02-27 13:55:48,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] procedure2.ProcedureExecutor(1075): Stored pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin1 2024-02-27 13:55:48,534 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-02-27 13:55:48,535 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=34, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-02-27 13:55:48,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-02-27 13:55:48,539 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/default/TestQuotaAdmin1/457e0c5b3b0c6fdb5b124947c571679e 2024-02-27 13:55:48,541 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/default/TestQuotaAdmin1/457e0c5b3b0c6fdb5b124947c571679e/cf, FileablePath, hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/default/TestQuotaAdmin1/457e0c5b3b0c6fdb5b124947c571679e/recovered.edits] 2024-02-27 13:55:48,550 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/default/TestQuotaAdmin1/457e0c5b3b0c6fdb5b124947c571679e/recovered.edits/4.seqid to hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/archive/data/default/TestQuotaAdmin1/457e0c5b3b0c6fdb5b124947c571679e/recovered.edits/4.seqid 2024-02-27 13:55:48,550 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/default/TestQuotaAdmin1/457e0c5b3b0c6fdb5b124947c571679e 2024-02-27 13:55:48,550 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-02-27 13:55:48,554 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=34, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-02-27 13:55:48,556 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin1 from hbase:meta 2024-02-27 13:55:48,558 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin1' descriptor. 2024-02-27 13:55:48,559 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=34, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-02-27 13:55:48,559 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin1' from region states. 2024-02-27 13:55:48,560 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1,,1709042085148.457e0c5b3b0c6fdb5b124947c571679e.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1709042148559"}]},"ts":"9223372036854775807"} 2024-02-27 13:55:48,561 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-02-27 13:55:48,561 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 457e0c5b3b0c6fdb5b124947c571679e, NAME => 'TestQuotaAdmin1,,1709042085148.457e0c5b3b0c6fdb5b124947c571679e.', STARTKEY => '', ENDKEY => ''}] 2024-02-27 13:55:48,561 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin1' as deleted. 2024-02-27 13:55:48,561 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1709042148561"}]},"ts":"9223372036854775807"} 2024-02-27 13:55:48,563 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin1 state from META 2024-02-27 13:55:48,565 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=34, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-02-27 13:55:48,567 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=34, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin1 in 34 msec 2024-02-27 13:55:48,788 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-02-27 13:55:48,788 INFO [Listener at localhost/33159] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin1, procId: 34 completed 2024-02-27 13:55:48,789 INFO [Listener at localhost/33159] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin2 2024-02-27 13:55:48,789 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin2 2024-02-27 13:55:48,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] procedure2.ProcedureExecutor(1075): Stored pid=35, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin2 2024-02-27 13:55:48,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-02-27 13:55:48,794 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709042148794"}]},"ts":"1709042148794"} 2024-02-27 13:55:48,796 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLING in hbase:meta 2024-02-27 13:55:48,798 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set TestQuotaAdmin2 to state=DISABLING 2024-02-27 13:55:48,798 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=7d35db972a5a8c020a495a982c6dc95a, UNASSIGN}] 2024-02-27 13:55:48,799 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=7d35db972a5a8c020a495a982c6dc95a, UNASSIGN 2024-02-27 13:55:48,800 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=7d35db972a5a8c020a495a982c6dc95a, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:55:48,800 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1709042085930.7d35db972a5a8c020a495a982c6dc95a.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709042148800"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709042148800"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709042148800"}]},"ts":"1709042148800"} 2024-02-27 13:55:48,802 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; CloseRegionProcedure 7d35db972a5a8c020a495a982c6dc95a, server=jenkins-hbase4.apache.org,36357,1709042080636}] 2024-02-27 13:55:48,954 DEBUG [RSProcedureDispatcher-pool-5] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:55:48,955 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7d35db972a5a8c020a495a982c6dc95a 2024-02-27 13:55:48,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7d35db972a5a8c020a495a982c6dc95a, disabling compactions & flushes 2024-02-27 13:55:48,956 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1709042085930.7d35db972a5a8c020a495a982c6dc95a. 2024-02-27 13:55:48,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1709042085930.7d35db972a5a8c020a495a982c6dc95a. 2024-02-27 13:55:48,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1709042085930.7d35db972a5a8c020a495a982c6dc95a. after waiting 0 ms 2024-02-27 13:55:48,956 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1709042085930.7d35db972a5a8c020a495a982c6dc95a. 2024-02-27 13:55:48,961 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/default/TestQuotaAdmin2/7d35db972a5a8c020a495a982c6dc95a/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-02-27 13:55:48,962 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1709042085930.7d35db972a5a8c020a495a982c6dc95a. 2024-02-27 13:55:48,962 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7d35db972a5a8c020a495a982c6dc95a: 2024-02-27 13:55:48,964 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7d35db972a5a8c020a495a982c6dc95a 2024-02-27 13:55:48,965 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=7d35db972a5a8c020a495a982c6dc95a, regionState=CLOSED 2024-02-27 13:55:48,965 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1709042085930.7d35db972a5a8c020a495a982c6dc95a.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1709042148965"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709042148965"}]},"ts":"1709042148965"} 2024-02-27 13:55:48,969 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=37, resume processing ppid=36 2024-02-27 13:55:48,970 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=37, ppid=36, state=SUCCESS; CloseRegionProcedure 7d35db972a5a8c020a495a982c6dc95a, server=jenkins-hbase4.apache.org,36357,1709042080636 in 165 msec 2024-02-27 13:55:48,971 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=36, resume processing ppid=35 2024-02-27 13:55:48,972 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=7d35db972a5a8c020a495a982c6dc95a, UNASSIGN in 171 msec 2024-02-27 13:55:48,972 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709042148972"}]},"ts":"1709042148972"} 2024-02-27 13:55:48,974 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLED in hbase:meta 2024-02-27 13:55:48,976 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set TestQuotaAdmin2 to state=DISABLED 2024-02-27 13:55:48,978 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=35, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin2 in 188 msec 2024-02-27 13:55:49,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-02-27 13:55:49,045 INFO [Listener at localhost/33159] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin2, procId: 35 completed 2024-02-27 13:55:49,046 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin2 2024-02-27 13:55:49,047 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] procedure2.ProcedureExecutor(1075): Stored pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin2 2024-02-27 13:55:49,049 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-02-27 13:55:49,050 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=38, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-02-27 13:55:49,052 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-02-27 13:55:49,055 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/default/TestQuotaAdmin2/7d35db972a5a8c020a495a982c6dc95a 2024-02-27 13:55:49,057 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/default/TestQuotaAdmin2/7d35db972a5a8c020a495a982c6dc95a/cf, FileablePath, hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/default/TestQuotaAdmin2/7d35db972a5a8c020a495a982c6dc95a/recovered.edits] 2024-02-27 13:55:49,065 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/default/TestQuotaAdmin2/7d35db972a5a8c020a495a982c6dc95a/recovered.edits/4.seqid to hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/archive/data/default/TestQuotaAdmin2/7d35db972a5a8c020a495a982c6dc95a/recovered.edits/4.seqid 2024-02-27 13:55:49,066 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/default/TestQuotaAdmin2/7d35db972a5a8c020a495a982c6dc95a 2024-02-27 13:55:49,066 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-02-27 13:55:49,069 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=38, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-02-27 13:55:49,071 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin2 from hbase:meta 2024-02-27 13:55:49,073 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin2' descriptor. 2024-02-27 13:55:49,074 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=38, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-02-27 13:55:49,074 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin2' from region states. 2024-02-27 13:55:49,074 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2,,1709042085930.7d35db972a5a8c020a495a982c6dc95a.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1709042149074"}]},"ts":"9223372036854775807"} 2024-02-27 13:55:49,076 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-02-27 13:55:49,076 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7d35db972a5a8c020a495a982c6dc95a, NAME => 'TestQuotaAdmin2,,1709042085930.7d35db972a5a8c020a495a982c6dc95a.', STARTKEY => '', ENDKEY => ''}] 2024-02-27 13:55:49,076 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin2' as deleted. 2024-02-27 13:55:49,076 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1709042149076"}]},"ts":"9223372036854775807"} 2024-02-27 13:55:49,078 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin2 state from META 2024-02-27 13:55:49,080 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=38, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-02-27 13:55:49,082 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=38, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin2 in 34 msec 2024-02-27 13:55:49,303 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-02-27 13:55:49,304 INFO [Listener at localhost/33159] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin2, procId: 38 completed 2024-02-27 13:55:49,304 INFO [Listener at localhost/33159] client.HBaseAdmin$15(890): Started disable of TestNs:TestTable 2024-02-27 13:55:49,305 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestNs:TestTable 2024-02-27 13:55:49,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] procedure2.ProcedureExecutor(1075): Stored pid=39, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestNs:TestTable 2024-02-27 13:55:49,309 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-02-27 13:55:49,309 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709042149309"}]},"ts":"1709042149309"} 2024-02-27 13:55:49,311 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLING in hbase:meta 2024-02-27 13:55:49,313 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set TestNs:TestTable to state=DISABLING 2024-02-27 13:55:49,314 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=6a22c6b91ba285f9c0135f27487952a6, UNASSIGN}, {pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=7c31adc03fd9b4bb2274da60b6194537, UNASSIGN}] 2024-02-27 13:55:49,315 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=6a22c6b91ba285f9c0135f27487952a6, UNASSIGN 2024-02-27 13:55:49,315 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=7c31adc03fd9b4bb2274da60b6194537, UNASSIGN 2024-02-27 13:55:49,316 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=6a22c6b91ba285f9c0135f27487952a6, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,33695,1709042080686 2024-02-27 13:55:49,316 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=7c31adc03fd9b4bb2274da60b6194537, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:55:49,316 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1709042086975.6a22c6b91ba285f9c0135f27487952a6.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709042149316"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709042149316"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709042149316"}]},"ts":"1709042149316"} 2024-02-27 13:55:49,316 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1709042086975.7c31adc03fd9b4bb2274da60b6194537.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709042149316"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1709042149316"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1709042149316"}]},"ts":"1709042149316"} 2024-02-27 13:55:49,317 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=42, ppid=40, state=RUNNABLE; CloseRegionProcedure 6a22c6b91ba285f9c0135f27487952a6, server=jenkins-hbase4.apache.org,33695,1709042080686}] 2024-02-27 13:55:49,318 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=43, ppid=41, state=RUNNABLE; CloseRegionProcedure 7c31adc03fd9b4bb2274da60b6194537, server=jenkins-hbase4.apache.org,36357,1709042080636}] 2024-02-27 13:55:49,469 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,33695,1709042080686 2024-02-27 13:55:49,470 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 6a22c6b91ba285f9c0135f27487952a6 2024-02-27 13:55:49,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6a22c6b91ba285f9c0135f27487952a6, disabling compactions & flushes 2024-02-27 13:55:49,471 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1709042086975.6a22c6b91ba285f9c0135f27487952a6. 2024-02-27 13:55:49,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1709042086975.6a22c6b91ba285f9c0135f27487952a6. 2024-02-27 13:55:49,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1709042086975.6a22c6b91ba285f9c0135f27487952a6. after waiting 0 ms 2024-02-27 13:55:49,471 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1709042086975.6a22c6b91ba285f9c0135f27487952a6. 2024-02-27 13:55:49,471 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:55:49,472 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7c31adc03fd9b4bb2274da60b6194537 2024-02-27 13:55:49,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7c31adc03fd9b4bb2274da60b6194537, disabling compactions & flushes 2024-02-27 13:55:49,473 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1709042086975.7c31adc03fd9b4bb2274da60b6194537. 2024-02-27 13:55:49,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1709042086975.7c31adc03fd9b4bb2274da60b6194537. 2024-02-27 13:55:49,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1709042086975.7c31adc03fd9b4bb2274da60b6194537. after waiting 0 ms 2024-02-27 13:55:49,473 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1709042086975.7c31adc03fd9b4bb2274da60b6194537. 2024-02-27 13:55:49,480 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/TestNs/TestTable/6a22c6b91ba285f9c0135f27487952a6/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-02-27 13:55:49,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/TestNs/TestTable/7c31adc03fd9b4bb2274da60b6194537/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-02-27 13:55:49,481 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1709042086975.6a22c6b91ba285f9c0135f27487952a6. 2024-02-27 13:55:49,481 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6a22c6b91ba285f9c0135f27487952a6: 2024-02-27 13:55:49,482 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1709042086975.7c31adc03fd9b4bb2274da60b6194537. 2024-02-27 13:55:49,482 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7c31adc03fd9b4bb2274da60b6194537: 2024-02-27 13:55:49,484 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 6a22c6b91ba285f9c0135f27487952a6 2024-02-27 13:55:49,484 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=6a22c6b91ba285f9c0135f27487952a6, regionState=CLOSED 2024-02-27 13:55:49,485 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,,1709042086975.6a22c6b91ba285f9c0135f27487952a6.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709042149484"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709042149484"}]},"ts":"1709042149484"} 2024-02-27 13:55:49,485 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7c31adc03fd9b4bb2274da60b6194537 2024-02-27 13:55:49,485 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=7c31adc03fd9b4bb2274da60b6194537, regionState=CLOSED 2024-02-27 13:55:49,485 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1709042086975.7c31adc03fd9b4bb2274da60b6194537.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1709042149485"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1709042149485"}]},"ts":"1709042149485"} 2024-02-27 13:55:49,488 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=42, resume processing ppid=40 2024-02-27 13:55:49,488 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=42, ppid=40, state=SUCCESS; CloseRegionProcedure 6a22c6b91ba285f9c0135f27487952a6, server=jenkins-hbase4.apache.org,33695,1709042080686 in 169 msec 2024-02-27 13:55:49,489 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=43, resume processing ppid=41 2024-02-27 13:55:49,489 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=43, ppid=41, state=SUCCESS; CloseRegionProcedure 7c31adc03fd9b4bb2274da60b6194537, server=jenkins-hbase4.apache.org,36357,1709042080636 in 169 msec 2024-02-27 13:55:49,490 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=6a22c6b91ba285f9c0135f27487952a6, UNASSIGN in 174 msec 2024-02-27 13:55:49,491 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=41, resume processing ppid=39 2024-02-27 13:55:49,491 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=41, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=7c31adc03fd9b4bb2274da60b6194537, UNASSIGN in 175 msec 2024-02-27 13:55:49,492 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1709042149492"}]},"ts":"1709042149492"} 2024-02-27 13:55:49,493 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLED in hbase:meta 2024-02-27 13:55:49,495 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set TestNs:TestTable to state=DISABLED 2024-02-27 13:55:49,497 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=39, state=SUCCESS; DisableTableProcedure table=TestNs:TestTable in 191 msec 2024-02-27 13:55:49,560 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-02-27 13:55:49,560 INFO [Listener at localhost/33159] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: TestNs:TestTable, procId: 39 completed 2024-02-27 13:55:49,561 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestNs:TestTable 2024-02-27 13:55:49,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] procedure2.ProcedureExecutor(1075): Stored pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestNs:TestTable 2024-02-27 13:55:49,564 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-02-27 13:55:49,565 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=44, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-02-27 13:55:49,567 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-02-27 13:55:49,571 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/TestNs/TestTable/6a22c6b91ba285f9c0135f27487952a6 2024-02-27 13:55:49,571 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/TestNs/TestTable/7c31adc03fd9b4bb2274da60b6194537 2024-02-27 13:55:49,574 DEBUG [HFileArchiver-11] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/TestNs/TestTable/6a22c6b91ba285f9c0135f27487952a6/cf, FileablePath, hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/TestNs/TestTable/6a22c6b91ba285f9c0135f27487952a6/recovered.edits] 2024-02-27 13:55:49,574 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/TestNs/TestTable/7c31adc03fd9b4bb2274da60b6194537/cf, FileablePath, hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/TestNs/TestTable/7c31adc03fd9b4bb2274da60b6194537/recovered.edits] 2024-02-27 13:55:49,581 DEBUG [HFileArchiver-11] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/TestNs/TestTable/6a22c6b91ba285f9c0135f27487952a6/recovered.edits/4.seqid to hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/archive/data/TestNs/TestTable/6a22c6b91ba285f9c0135f27487952a6/recovered.edits/4.seqid 2024-02-27 13:55:49,582 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/TestNs/TestTable/7c31adc03fd9b4bb2274da60b6194537/recovered.edits/4.seqid to hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/archive/data/TestNs/TestTable/7c31adc03fd9b4bb2274da60b6194537/recovered.edits/4.seqid 2024-02-27 13:55:49,582 DEBUG [HFileArchiver-11] backup.HFileArchiver(596): Deleted hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/TestNs/TestTable/6a22c6b91ba285f9c0135f27487952a6 2024-02-27 13:55:49,583 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/.tmp/data/TestNs/TestTable/7c31adc03fd9b4bb2274da60b6194537 2024-02-27 13:55:49,583 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-02-27 13:55:49,585 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=44, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-02-27 13:55:49,587 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of TestNs:TestTable from hbase:meta 2024-02-27 13:55:49,589 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'TestNs:TestTable' descriptor. 2024-02-27 13:55:49,591 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=44, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-02-27 13:55:49,591 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'TestNs:TestTable' from region states. 2024-02-27 13:55:49,591 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,,1709042086975.6a22c6b91ba285f9c0135f27487952a6.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1709042149591"}]},"ts":"9223372036854775807"} 2024-02-27 13:55:49,591 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,1,1709042086975.7c31adc03fd9b4bb2274da60b6194537.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1709042149591"}]},"ts":"9223372036854775807"} 2024-02-27 13:55:49,593 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2024-02-27 13:55:49,593 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 6a22c6b91ba285f9c0135f27487952a6, NAME => 'TestNs:TestTable,,1709042086975.6a22c6b91ba285f9c0135f27487952a6.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 7c31adc03fd9b4bb2274da60b6194537, NAME => 'TestNs:TestTable,1,1709042086975.7c31adc03fd9b4bb2274da60b6194537.', STARTKEY => '1', ENDKEY => ''}] 2024-02-27 13:55:49,593 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'TestNs:TestTable' as deleted. 2024-02-27 13:55:49,593 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1709042149593"}]},"ts":"9223372036854775807"} 2024-02-27 13:55:49,595 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table TestNs:TestTable state from META 2024-02-27 13:55:49,598 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=44, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-02-27 13:55:49,599 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=44, state=SUCCESS; DeleteTableProcedure table=TestNs:TestTable in 37 msec 2024-02-27 13:55:49,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-02-27 13:55:49,818 INFO [Listener at localhost/33159] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: TestNs:TestTable, procId: 44 completed 2024-02-27 13:55:49,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.HMaster$17(3092): Client=jenkins//172.31.14.131 delete TestNs 2024-02-27 13:55:49,829 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] procedure2.ProcedureExecutor(1075): Stored pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE; DeleteNamespaceProcedure, namespace=TestNs 2024-02-27 13:55:49,831 INFO [PEWorker-4] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-02-27 13:55:49,834 INFO [PEWorker-4] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_FROM_NS_TABLE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-02-27 13:55:49,836 INFO [PEWorker-4] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_FROM_ZK, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-02-27 13:55:49,837 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-02-27 13:55:49,838 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace/TestNs 2024-02-27 13:55:49,838 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-02-27 13:55:49,839 INFO [PEWorker-4] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_DIRECTORIES, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-02-27 13:55:49,841 INFO [PEWorker-4] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_NAMESPACE_QUOTA, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-02-27 13:55:49,842 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=45, state=SUCCESS; DeleteNamespaceProcedure, namespace=TestNs in 18 msec 2024-02-27 13:55:50,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=41827] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-02-27 13:55:50,088 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2024-02-27 13:55:50,088 INFO [Listener at localhost/33159] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-02-27 13:55:50,088 DEBUG [Listener at localhost/33159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x11b46918 to 127.0.0.1:60991 2024-02-27 13:55:50,088 DEBUG [Listener at localhost/33159] ipc.AbstractRpcClient(489): Stopping rpc client 2024-02-27 13:55:50,089 DEBUG [Listener at localhost/33159] util.JVMClusterUtil(237): Shutting down HBase Cluster 2024-02-27 13:55:50,089 DEBUG [Listener at localhost/33159] util.JVMClusterUtil(257): Found active master hash=1909077070, stopped=false 2024-02-27 13:55:50,089 DEBUG [Listener at localhost/33159] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-02-27 13:55:50,090 INFO [Listener at localhost/33159] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,41827,1709042079370 2024-02-27 13:55:50,092 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): regionserver:36357-0x10010395a8b0001, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-02-27 13:55:50,092 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-02-27 13:55:50,092 INFO [Listener at localhost/33159] procedure2.ProcedureExecutor(675): Stopping 2024-02-27 13:55:50,092 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): regionserver:33695-0x10010395a8b0002, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-02-27 13:55:50,092 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-27 13:55:50,093 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:36357-0x10010395a8b0001, quorum=127.0.0.1:60991, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-02-27 13:55:50,093 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:33695-0x10010395a8b0002, quorum=127.0.0.1:60991, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-02-27 13:55:50,093 DEBUG [Listener at localhost/33159] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x761f6445 to 127.0.0.1:60991 2024-02-27 13:55:50,093 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-02-27 13:55:50,093 DEBUG [Listener at localhost/33159] ipc.AbstractRpcClient(489): Stopping rpc client 2024-02-27 13:55:50,093 INFO [Listener at localhost/33159] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,36357,1709042080636' ***** 2024-02-27 13:55:50,093 INFO [Listener at localhost/33159] regionserver.HRegionServer(2313): STOPPED: Shutdown requested 2024-02-27 13:55:50,094 INFO [Listener at localhost/33159] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,33695,1709042080686' ***** 2024-02-27 13:55:50,094 INFO [Listener at localhost/33159] regionserver.HRegionServer(2313): STOPPED: Shutdown requested 2024-02-27 13:55:50,094 INFO [RS:0;jenkins-hbase4:36357] regionserver.HeapMemoryManager(220): Stopping 2024-02-27 13:55:50,094 INFO [RS:1;jenkins-hbase4:33695] regionserver.HeapMemoryManager(220): Stopping 2024-02-27 13:55:50,094 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-02-27 13:55:50,094 INFO [RS:1;jenkins-hbase4:33695] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-02-27 13:55:50,094 INFO [RS:1;jenkins-hbase4:33695] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-02-27 13:55:50,094 INFO [RS:1;jenkins-hbase4:33695] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,33695,1709042080686 2024-02-27 13:55:50,094 INFO [RS:1;jenkins-hbase4:33695] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-02-27 13:55:50,094 DEBUG [RS:1;jenkins-hbase4:33695] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b810415 to 127.0.0.1:60991 2024-02-27 13:55:50,095 DEBUG [RS:1;jenkins-hbase4:33695] ipc.AbstractRpcClient(489): Stopping rpc client 2024-02-27 13:55:50,095 INFO [RS:1;jenkins-hbase4:33695] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,33695,1709042080686; all regions closed. 2024-02-27 13:55:50,095 DEBUG [RS:1;jenkins-hbase4:33695] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-02-27 13:55:50,094 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-02-27 13:55:50,094 INFO [RS:0;jenkins-hbase4:36357] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-02-27 13:55:50,095 INFO [RS:0;jenkins-hbase4:36357] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-02-27 13:55:50,096 INFO [RS:0;jenkins-hbase4:36357] regionserver.HRegionServer(3307): Received CLOSE for 5f9121330b4c01576fb7dad518004b0a 2024-02-27 13:55:50,096 INFO [RS:0;jenkins-hbase4:36357] regionserver.HRegionServer(3307): Received CLOSE for c32c23665c326b77f453386d6994983a 2024-02-27 13:55:50,096 INFO [RS:0;jenkins-hbase4:36357] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:55:50,096 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5f9121330b4c01576fb7dad518004b0a, disabling compactions & flushes 2024-02-27 13:55:50,096 INFO [RS:0;jenkins-hbase4:36357] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-02-27 13:55:50,096 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1709042082632.5f9121330b4c01576fb7dad518004b0a. 2024-02-27 13:55:50,097 DEBUG [RS:0;jenkins-hbase4:36357] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1b5602ff to 127.0.0.1:60991 2024-02-27 13:55:50,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1709042082632.5f9121330b4c01576fb7dad518004b0a. 2024-02-27 13:55:50,097 DEBUG [RS:0;jenkins-hbase4:36357] ipc.AbstractRpcClient(489): Stopping rpc client 2024-02-27 13:55:50,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1709042082632.5f9121330b4c01576fb7dad518004b0a. after waiting 0 ms 2024-02-27 13:55:50,097 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1709042082632.5f9121330b4c01576fb7dad518004b0a. 2024-02-27 13:55:50,098 INFO [RS:0;jenkins-hbase4:36357] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-02-27 13:55:50,098 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 5f9121330b4c01576fb7dad518004b0a 1/1 column families, dataSize=147 B heapSize=704 B 2024-02-27 13:55:50,098 INFO [RS:0;jenkins-hbase4:36357] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-02-27 13:55:50,098 INFO [RS:0;jenkins-hbase4:36357] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-02-27 13:55:50,098 INFO [RS:0;jenkins-hbase4:36357] regionserver.HRegionServer(3307): Received CLOSE for 1588230740 2024-02-27 13:55:50,098 INFO [RS:0;jenkins-hbase4:36357] regionserver.HRegionServer(1477): Waiting on 3 regions to close 2024-02-27 13:55:50,098 DEBUG [RS:0;jenkins-hbase4:36357] regionserver.HRegionServer(1481): Online Regions={1588230740=hbase:meta,,1.1588230740, 5f9121330b4c01576fb7dad518004b0a=hbase:namespace,,1709042082632.5f9121330b4c01576fb7dad518004b0a., c32c23665c326b77f453386d6994983a=hbase:quota,,1709042083748.c32c23665c326b77f453386d6994983a.} 2024-02-27 13:55:50,099 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-02-27 13:55:50,099 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-02-27 13:55:50,099 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-02-27 13:55:50,099 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-02-27 13:55:50,099 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-02-27 13:55:50,099 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=14.15 KB heapSize=25.10 KB 2024-02-27 13:55:50,100 DEBUG [RS:0;jenkins-hbase4:36357] regionserver.HRegionServer(1507): Waiting on 1588230740, 5f9121330b4c01576fb7dad518004b0a, c32c23665c326b77f453386d6994983a 2024-02-27 13:55:50,109 DEBUG [RS:1;jenkins-hbase4:33695] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/oldWALs 2024-02-27 13:55:50,109 INFO [RS:1;jenkins-hbase4:33695] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C33695%2C1709042080686:(num 1709042082187) 2024-02-27 13:55:50,109 DEBUG [RS:1;jenkins-hbase4:33695] ipc.AbstractRpcClient(489): Stopping rpc client 2024-02-27 13:55:50,109 INFO [RS:1;jenkins-hbase4:33695] regionserver.LeaseManager(133): Closed leases 2024-02-27 13:55:50,109 INFO [RS:1;jenkins-hbase4:33695] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2024-02-27 13:55:50,109 INFO [RS:1;jenkins-hbase4:33695] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-02-27 13:55:50,110 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-02-27 13:55:50,110 INFO [RS:1;jenkins-hbase4:33695] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-02-27 13:55:50,110 INFO [RS:1;jenkins-hbase4:33695] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-02-27 13:55:50,110 INFO [RS:1;jenkins-hbase4:33695] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:33695 2024-02-27 13:55:50,116 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): regionserver:33695-0x10010395a8b0002, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33695,1709042080686 2024-02-27 13:55:50,116 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-02-27 13:55:50,116 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): regionserver:33695-0x10010395a8b0002, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-02-27 13:55:50,116 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): regionserver:36357-0x10010395a8b0001, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,33695,1709042080686 2024-02-27 13:55:50,117 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): regionserver:36357-0x10010395a8b0001, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-02-27 13:55:50,118 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,33695,1709042080686] 2024-02-27 13:55:50,118 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,33695,1709042080686; numProcessing=1 2024-02-27 13:55:50,120 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,33695,1709042080686 already deleted, retry=false 2024-02-27 13:55:50,120 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,33695,1709042080686 expired; onlineServers=1 2024-02-27 13:55:50,133 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=12.16 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/meta/1588230740/.tmp/info/c246c53a6f5240119cf61cb191e079c0 2024-02-27 13:55:50,136 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=147 B at sequenceid=8 (bloomFilter=true), to=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/namespace/5f9121330b4c01576fb7dad518004b0a/.tmp/info/d3f04673417747d6b328329c679d916e 2024-02-27 13:55:50,145 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c246c53a6f5240119cf61cb191e079c0 2024-02-27 13:55:50,145 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d3f04673417747d6b328329c679d916e 2024-02-27 13:55:50,146 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/namespace/5f9121330b4c01576fb7dad518004b0a/.tmp/info/d3f04673417747d6b328329c679d916e as hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/namespace/5f9121330b4c01576fb7dad518004b0a/info/d3f04673417747d6b328329c679d916e 2024-02-27 13:55:50,156 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d3f04673417747d6b328329c679d916e 2024-02-27 13:55:50,156 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/namespace/5f9121330b4c01576fb7dad518004b0a/info/d3f04673417747d6b328329c679d916e, entries=3, sequenceid=8, filesize=5.0 K 2024-02-27 13:55:50,158 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~147 B/147, heapSize ~688 B/688, currentSize=0 B/0 for 5f9121330b4c01576fb7dad518004b0a in 60ms, sequenceid=8, compaction requested=false 2024-02-27 13:55:50,161 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=478 B at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/meta/1588230740/.tmp/rep_barrier/4906efaba2b94c8fb07009514e7f3737 2024-02-27 13:55:50,165 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/namespace/5f9121330b4c01576fb7dad518004b0a/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=1 2024-02-27 13:55:50,166 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-02-27 13:55:50,166 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-02-27 13:55:50,166 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1709042082632.5f9121330b4c01576fb7dad518004b0a. 2024-02-27 13:55:50,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5f9121330b4c01576fb7dad518004b0a: 2024-02-27 13:55:50,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1709042082632.5f9121330b4c01576fb7dad518004b0a. 2024-02-27 13:55:50,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing c32c23665c326b77f453386d6994983a, disabling compactions & flushes 2024-02-27 13:55:50,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:quota,,1709042083748.c32c23665c326b77f453386d6994983a. 2024-02-27 13:55:50,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1709042083748.c32c23665c326b77f453386d6994983a. 2024-02-27 13:55:50,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1709042083748.c32c23665c326b77f453386d6994983a. after waiting 0 ms 2024-02-27 13:55:50,167 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1709042083748.c32c23665c326b77f453386d6994983a. 2024-02-27 13:55:50,167 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing c32c23665c326b77f453386d6994983a 2/2 column families, dataSize=726 B heapSize=2.44 KB 2024-02-27 13:55:50,169 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4906efaba2b94c8fb07009514e7f3737 2024-02-27 13:55:50,190 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=597 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/quota/c32c23665c326b77f453386d6994983a/.tmp/q/c37e782fcead41f7a01f522628d8cc16 2024-02-27 13:55:50,192 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.53 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/meta/1588230740/.tmp/table/a4407515ee8c46088d267891a6564704 2024-02-27 13:55:50,205 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c37e782fcead41f7a01f522628d8cc16 2024-02-27 13:55:50,205 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a4407515ee8c46088d267891a6564704 2024-02-27 13:55:50,207 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/meta/1588230740/.tmp/info/c246c53a6f5240119cf61cb191e079c0 as hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/meta/1588230740/info/c246c53a6f5240119cf61cb191e079c0 2024-02-27 13:55:50,219 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): regionserver:33695-0x10010395a8b0002, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-02-27 13:55:50,219 INFO [RS:1;jenkins-hbase4:33695] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,33695,1709042080686; zookeeper connection closed. 2024-02-27 13:55:50,219 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): regionserver:33695-0x10010395a8b0002, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-02-27 13:55:50,219 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c246c53a6f5240119cf61cb191e079c0 2024-02-27 13:55:50,219 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/meta/1588230740/info/c246c53a6f5240119cf61cb191e079c0, entries=30, sequenceid=66, filesize=8.0 K 2024-02-27 13:55:50,221 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/meta/1588230740/.tmp/rep_barrier/4906efaba2b94c8fb07009514e7f3737 as hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/meta/1588230740/rep_barrier/4906efaba2b94c8fb07009514e7f3737 2024-02-27 13:55:50,222 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@3c4575ed] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@3c4575ed 2024-02-27 13:55:50,224 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=129 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/quota/c32c23665c326b77f453386d6994983a/.tmp/u/55d9a4026a354b3387c4148952f10321 2024-02-27 13:55:50,231 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4906efaba2b94c8fb07009514e7f3737 2024-02-27 13:55:50,231 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/meta/1588230740/rep_barrier/4906efaba2b94c8fb07009514e7f3737, entries=5, sequenceid=66, filesize=5.3 K 2024-02-27 13:55:50,232 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/meta/1588230740/.tmp/table/a4407515ee8c46088d267891a6564704 as hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/meta/1588230740/table/a4407515ee8c46088d267891a6564704 2024-02-27 13:55:50,233 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 55d9a4026a354b3387c4148952f10321 2024-02-27 13:55:50,235 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/quota/c32c23665c326b77f453386d6994983a/.tmp/q/c37e782fcead41f7a01f522628d8cc16 as hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/quota/c32c23665c326b77f453386d6994983a/q/c37e782fcead41f7a01f522628d8cc16 2024-02-27 13:55:50,242 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a4407515ee8c46088d267891a6564704 2024-02-27 13:55:50,242 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/meta/1588230740/table/a4407515ee8c46088d267891a6564704, entries=13, sequenceid=66, filesize=5.6 K 2024-02-27 13:55:50,243 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~14.15 KB/14494, heapSize ~25.05 KB/25656, currentSize=0 B/0 for 1588230740 in 144ms, sequenceid=66, compaction requested=false 2024-02-27 13:55:50,244 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c37e782fcead41f7a01f522628d8cc16 2024-02-27 13:55:50,244 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/quota/c32c23665c326b77f453386d6994983a/q/c37e782fcead41f7a01f522628d8cc16, entries=5, sequenceid=17, filesize=5.1 K 2024-02-27 13:55:50,247 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/quota/c32c23665c326b77f453386d6994983a/.tmp/u/55d9a4026a354b3387c4148952f10321 as hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/quota/c32c23665c326b77f453386d6994983a/u/55d9a4026a354b3387c4148952f10321 2024-02-27 13:55:50,253 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/meta/1588230740/recovered.edits/69.seqid, newMaxSeqId=69, maxSeqId=1 2024-02-27 13:55:50,254 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-02-27 13:55:50,255 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-02-27 13:55:50,255 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-02-27 13:55:50,255 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2024-02-27 13:55:50,257 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 55d9a4026a354b3387c4148952f10321 2024-02-27 13:55:50,258 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/quota/c32c23665c326b77f453386d6994983a/u/55d9a4026a354b3387c4148952f10321, entries=4, sequenceid=17, filesize=5.0 K 2024-02-27 13:55:50,258 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~726 B/726, heapSize ~2.41 KB/2464, currentSize=0 B/0 for c32c23665c326b77f453386d6994983a in 91ms, sequenceid=17, compaction requested=false 2024-02-27 13:55:50,264 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/data/hbase/quota/c32c23665c326b77f453386d6994983a/recovered.edits/20.seqid, newMaxSeqId=20, maxSeqId=1 2024-02-27 13:55:50,265 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:quota,,1709042083748.c32c23665c326b77f453386d6994983a. 2024-02-27 13:55:50,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for c32c23665c326b77f453386d6994983a: 2024-02-27 13:55:50,266 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:quota,,1709042083748.c32c23665c326b77f453386d6994983a. 2024-02-27 13:55:50,300 INFO [RS:0;jenkins-hbase4:36357] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,36357,1709042080636; all regions closed. 2024-02-27 13:55:50,301 DEBUG [RS:0;jenkins-hbase4:36357] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-02-27 13:55:50,307 DEBUG [RS:0;jenkins-hbase4:36357] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/oldWALs 2024-02-27 13:55:50,307 INFO [RS:0;jenkins-hbase4:36357] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36357%2C1709042080636.meta:.meta(num 1709042082359) 2024-02-27 13:55:50,313 DEBUG [RS:0;jenkins-hbase4:36357] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/oldWALs 2024-02-27 13:55:50,313 INFO [RS:0;jenkins-hbase4:36357] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C36357%2C1709042080636:(num 1709042082187) 2024-02-27 13:55:50,313 DEBUG [RS:0;jenkins-hbase4:36357] ipc.AbstractRpcClient(489): Stopping rpc client 2024-02-27 13:55:50,313 INFO [RS:0;jenkins-hbase4:36357] regionserver.LeaseManager(133): Closed leases 2024-02-27 13:55:50,314 INFO [RS:0;jenkins-hbase4:36357] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2024-02-27 13:55:50,314 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-02-27 13:55:50,315 INFO [RS:0;jenkins-hbase4:36357] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:36357 2024-02-27 13:55:50,317 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): regionserver:36357-0x10010395a8b0001, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,36357,1709042080636 2024-02-27 13:55:50,317 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-02-27 13:55:50,318 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,36357,1709042080636] 2024-02-27 13:55:50,319 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,36357,1709042080636; numProcessing=2 2024-02-27 13:55:50,320 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,36357,1709042080636 already deleted, retry=false 2024-02-27 13:55:50,320 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,36357,1709042080636 expired; onlineServers=0 2024-02-27 13:55:50,320 INFO [RegionServerTracker-0] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,41827,1709042079370' ***** 2024-02-27 13:55:50,320 INFO [RegionServerTracker-0] regionserver.HRegionServer(2313): STOPPED: Cluster shutdown set; onlineServer=0 2024-02-27 13:55:50,320 DEBUG [M:0;jenkins-hbase4:41827] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@30f73e75, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-02-27 13:55:50,320 INFO [M:0;jenkins-hbase4:41827] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,41827,1709042079370 2024-02-27 13:55:50,320 INFO [M:0;jenkins-hbase4:41827] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,41827,1709042079370; all regions closed. 2024-02-27 13:55:50,320 DEBUG [M:0;jenkins-hbase4:41827] ipc.AbstractRpcClient(489): Stopping rpc client 2024-02-27 13:55:50,320 DEBUG [M:0;jenkins-hbase4:41827] cleaner.LogCleaner(198): Cancelling LogCleaner 2024-02-27 13:55:50,321 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2024-02-27 13:55:50,321 DEBUG [M:0;jenkins-hbase4:41827] cleaner.HFileCleaner(317): Stopping file delete threads 2024-02-27 13:55:50,321 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1709042081850] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1709042081850,5,FailOnTimeoutGroup] 2024-02-27 13:55:50,321 INFO [M:0;jenkins-hbase4:41827] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2024-02-27 13:55:50,321 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1709042081844] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1709042081844,5,FailOnTimeoutGroup] 2024-02-27 13:55:50,321 INFO [M:0;jenkins-hbase4:41827] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2024-02-27 13:55:50,321 INFO [M:0;jenkins-hbase4:41827] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS] on shutdown 2024-02-27 13:55:50,322 DEBUG [M:0;jenkins-hbase4:41827] master.HMaster(1517): Stopping service threads 2024-02-27 13:55:50,322 INFO [M:0;jenkins-hbase4:41827] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2024-02-27 13:55:50,322 ERROR [M:0;jenkins-hbase4:41827] procedure2.ProcedureExecutor(699): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-8,5,PEWorkerGroup] Thread[HFileArchiver-9,5,PEWorkerGroup] Thread[HFileArchiver-10,5,PEWorkerGroup] Thread[HFileArchiver-11,5,PEWorkerGroup] Thread[HFileArchiver-12,5,PEWorkerGroup] 2024-02-27 13:55:50,322 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2024-02-27 13:55:50,323 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-02-27 13:55:50,323 INFO [M:0;jenkins-hbase4:41827] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2024-02-27 13:55:50,323 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2024-02-27 13:55:50,323 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-02-27 13:55:50,323 DEBUG [M:0;jenkins-hbase4:41827] zookeeper.ZKUtil(399): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2024-02-27 13:55:50,323 WARN [M:0;jenkins-hbase4:41827] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2024-02-27 13:55:50,324 INFO [M:0;jenkins-hbase4:41827] assignment.AssignmentManager(315): Stopping assignment manager 2024-02-27 13:55:50,324 INFO [M:0;jenkins-hbase4:41827] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2024-02-27 13:55:50,324 DEBUG [M:0;jenkins-hbase4:41827] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-02-27 13:55:50,324 INFO [M:0;jenkins-hbase4:41827] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-27 13:55:50,324 DEBUG [M:0;jenkins-hbase4:41827] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-27 13:55:50,324 DEBUG [M:0;jenkins-hbase4:41827] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-02-27 13:55:50,324 DEBUG [M:0;jenkins-hbase4:41827] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-27 13:55:50,324 INFO [M:0;jenkins-hbase4:41827] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=153.03 KB heapSize=184.84 KB 2024-02-27 13:55:50,345 INFO [M:0;jenkins-hbase4:41827] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=153.03 KB at sequenceid=376 (bloomFilter=true), to=hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/02eb1a7b3e6146869eb5b741d3c8261f 2024-02-27 13:55:50,352 INFO [M:0;jenkins-hbase4:41827] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 02eb1a7b3e6146869eb5b741d3c8261f 2024-02-27 13:55:50,353 DEBUG [M:0;jenkins-hbase4:41827] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/02eb1a7b3e6146869eb5b741d3c8261f as hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/02eb1a7b3e6146869eb5b741d3c8261f 2024-02-27 13:55:50,360 INFO [M:0;jenkins-hbase4:41827] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 02eb1a7b3e6146869eb5b741d3c8261f 2024-02-27 13:55:50,360 INFO [M:0;jenkins-hbase4:41827] regionserver.HStore(1080): Added hdfs://localhost:41495/user/jenkins/test-data/678c79c0-af42-63ab-3db4-a015d8a6c4be/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/02eb1a7b3e6146869eb5b741d3c8261f, entries=45, sequenceid=376, filesize=12.0 K 2024-02-27 13:55:50,361 INFO [M:0;jenkins-hbase4:41827] regionserver.HRegion(2948): Finished flush of dataSize ~153.03 KB/156707, heapSize ~184.82 KB/189256, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 37ms, sequenceid=376, compaction requested=false 2024-02-27 13:55:50,362 INFO [M:0;jenkins-hbase4:41827] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-02-27 13:55:50,362 DEBUG [M:0;jenkins-hbase4:41827] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-02-27 13:55:50,366 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-02-27 13:55:50,366 INFO [M:0;jenkins-hbase4:41827] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2024-02-27 13:55:50,366 INFO [M:0;jenkins-hbase4:41827] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:41827 2024-02-27 13:55:50,368 DEBUG [M:0;jenkins-hbase4:41827] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,41827,1709042079370 already deleted, retry=false 2024-02-27 13:55:50,419 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): regionserver:36357-0x10010395a8b0001, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-02-27 13:55:50,419 INFO [RS:0;jenkins-hbase4:36357] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,36357,1709042080636; zookeeper connection closed. 2024-02-27 13:55:50,419 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): regionserver:36357-0x10010395a8b0001, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-02-27 13:55:50,419 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@21315bc1] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@21315bc1 2024-02-27 13:55:50,419 INFO [Listener at localhost/33159] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2024-02-27 13:55:50,470 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-02-27 13:55:50,470 INFO [M:0;jenkins-hbase4:41827] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,41827,1709042079370; zookeeper connection closed. 2024-02-27 13:55:50,470 DEBUG [Listener at localhost/33159-EventThread] zookeeper.ZKWatcher(600): master:41827-0x10010395a8b0000, quorum=127.0.0.1:60991, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-02-27 13:55:50,472 WARN [Listener at localhost/33159] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-02-27 13:55:50,475 INFO [Listener at localhost/33159] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-02-27 13:55:50,579 WARN [BP-1211230950-172.31.14.131-1709042076152 heartbeating to localhost/127.0.0.1:41495] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-02-27 13:55:50,579 WARN [BP-1211230950-172.31.14.131-1709042076152 heartbeating to localhost/127.0.0.1:41495] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1211230950-172.31.14.131-1709042076152 (Datanode Uuid 9252af07-b9ae-490b-9329-61fec675ec09) service to localhost/127.0.0.1:41495 2024-02-27 13:55:50,581 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/cluster_7819d6a5-f5a3-e085-7fba-bdd2117692ef/dfs/data/data3/current/BP-1211230950-172.31.14.131-1709042076152] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-02-27 13:55:50,581 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/cluster_7819d6a5-f5a3-e085-7fba-bdd2117692ef/dfs/data/data4/current/BP-1211230950-172.31.14.131-1709042076152] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-02-27 13:55:50,582 WARN [Listener at localhost/33159] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-02-27 13:55:50,584 INFO [Listener at localhost/33159] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-02-27 13:55:50,688 WARN [BP-1211230950-172.31.14.131-1709042076152 heartbeating to localhost/127.0.0.1:41495] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-02-27 13:55:50,688 WARN [BP-1211230950-172.31.14.131-1709042076152 heartbeating to localhost/127.0.0.1:41495] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1211230950-172.31.14.131-1709042076152 (Datanode Uuid d3d1c02e-155d-49c4-b45e-9e943a6cc416) service to localhost/127.0.0.1:41495 2024-02-27 13:55:50,688 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/cluster_7819d6a5-f5a3-e085-7fba-bdd2117692ef/dfs/data/data1/current/BP-1211230950-172.31.14.131-1709042076152] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-02-27 13:55:50,689 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/9a9da6ff-8670-5f97-4b93-4c3b9de93092/cluster_7819d6a5-f5a3-e085-7fba-bdd2117692ef/dfs/data/data2/current/BP-1211230950-172.31.14.131-1709042076152] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-02-27 13:55:50,723 INFO [Listener at localhost/33159] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-02-27 13:55:50,838 INFO [Listener at localhost/33159] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2024-02-27 13:55:50,878 INFO [Listener at localhost/33159] hbase.HBaseTestingUtility(1293): Minicluster is down