2024-01-08 10:55:26,708 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle timeout: 13 mins 2024-01-08 10:55:26,932 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879 2024-01-08 10:55:26,946 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2024-01-08 10:55:26,947 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/cluster_bcadc389-5d61-62b6-5c09-06ca34aa64a2, deleteOnExit=true 2024-01-08 10:55:26,947 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2024-01-08 10:55:26,948 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/test.cache.data in system properties and HBase conf 2024-01-08 10:55:26,948 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/hadoop.tmp.dir in system properties and HBase conf 2024-01-08 10:55:26,948 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/hadoop.log.dir in system properties and HBase conf 2024-01-08 10:55:26,949 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/mapreduce.cluster.local.dir in system properties and HBase conf 2024-01-08 10:55:26,949 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/mapreduce.cluster.temp.dir in system properties and HBase conf 2024-01-08 10:55:26,950 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2024-01-08 10:55:27,070 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2024-01-08 10:55:27,462 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-01-08 10:55:27,467 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2024-01-08 10:55:27,467 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2024-01-08 10:55:27,467 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/yarn.nodemanager.log-dirs in system properties and HBase conf 2024-01-08 10:55:27,468 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-01-08 10:55:27,468 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2024-01-08 10:55:27,468 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2024-01-08 10:55:27,468 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-01-08 10:55:27,469 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/dfs.journalnode.edits.dir in system properties and HBase conf 2024-01-08 10:55:27,469 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2024-01-08 10:55:27,469 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/nfs.dump.dir in system properties and HBase conf 2024-01-08 10:55:27,470 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/java.io.tmpdir in system properties and HBase conf 2024-01-08 10:55:27,470 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/dfs.journalnode.edits.dir in system properties and HBase conf 2024-01-08 10:55:27,470 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2024-01-08 10:55:27,470 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2024-01-08 10:55:28,111 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-01-08 10:55:28,116 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-01-08 10:55:28,437 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2024-01-08 10:55:28,612 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2024-01-08 10:55:28,628 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-01-08 10:55:28,665 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2024-01-08 10:55:28,698 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/java.io.tmpdir/Jetty_localhost_34959_hdfs____2f42fa/webapp 2024-01-08 10:55:28,823 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:34959 2024-01-08 10:55:28,833 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-01-08 10:55:28,834 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-01-08 10:55:29,289 WARN [Listener at localhost/38469] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-01-08 10:55:29,356 WARN [Listener at localhost/38469] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-01-08 10:55:29,376 WARN [Listener at localhost/38469] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-01-08 10:55:29,384 INFO [Listener at localhost/38469] log.Slf4jLog(67): jetty-6.1.26 2024-01-08 10:55:29,389 INFO [Listener at localhost/38469] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/java.io.tmpdir/Jetty_localhost_46663_datanode____.noj014/webapp 2024-01-08 10:55:29,490 INFO [Listener at localhost/38469] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:46663 2024-01-08 10:55:29,822 WARN [Listener at localhost/45629] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-01-08 10:55:29,900 WARN [Listener at localhost/45629] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-01-08 10:55:29,907 WARN [Listener at localhost/45629] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-01-08 10:55:29,909 INFO [Listener at localhost/45629] log.Slf4jLog(67): jetty-6.1.26 2024-01-08 10:55:29,921 INFO [Listener at localhost/45629] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/java.io.tmpdir/Jetty_localhost_38557_datanode____.rwcvlz/webapp 2024-01-08 10:55:30,072 INFO [Listener at localhost/45629] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38557 2024-01-08 10:55:30,084 WARN [Listener at localhost/34349] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-01-08 10:55:30,456 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf33a2da738f4a4d2: Processing first storage report for DS-e8beb3e7-699c-4771-87a2-e80dcdc3ddc4 from datanode 50255a6e-424e-44b2-9393-8da468798590 2024-01-08 10:55:30,458 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf33a2da738f4a4d2: from storage DS-e8beb3e7-699c-4771-87a2-e80dcdc3ddc4 node DatanodeRegistration(127.0.0.1:33331, datanodeUuid=50255a6e-424e-44b2-9393-8da468798590, infoPort=38729, infoSecurePort=0, ipcPort=34349, storageInfo=lv=-57;cid=testClusterID;nsid=246827537;c=1704711328209), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2024-01-08 10:55:30,458 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2cb8477432322d80: Processing first storage report for DS-679739df-70ab-4d72-bce4-00444c23eb85 from datanode 1a36a8dc-33f7-4928-a6f9-de7cadd8426c 2024-01-08 10:55:30,458 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2cb8477432322d80: from storage DS-679739df-70ab-4d72-bce4-00444c23eb85 node DatanodeRegistration(127.0.0.1:46099, datanodeUuid=1a36a8dc-33f7-4928-a6f9-de7cadd8426c, infoPort=44481, infoSecurePort=0, ipcPort=45629, storageInfo=lv=-57;cid=testClusterID;nsid=246827537;c=1704711328209), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2024-01-08 10:55:30,458 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xf33a2da738f4a4d2: Processing first storage report for DS-3ce1fcaf-e4b9-49a5-80b1-d11beb99b481 from datanode 50255a6e-424e-44b2-9393-8da468798590 2024-01-08 10:55:30,458 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xf33a2da738f4a4d2: from storage DS-3ce1fcaf-e4b9-49a5-80b1-d11beb99b481 node DatanodeRegistration(127.0.0.1:33331, datanodeUuid=50255a6e-424e-44b2-9393-8da468798590, infoPort=38729, infoSecurePort=0, ipcPort=34349, storageInfo=lv=-57;cid=testClusterID;nsid=246827537;c=1704711328209), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-01-08 10:55:30,458 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x2cb8477432322d80: Processing first storage report for DS-9afc3420-4cef-4d5d-a271-c3b085915240 from datanode 1a36a8dc-33f7-4928-a6f9-de7cadd8426c 2024-01-08 10:55:30,458 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x2cb8477432322d80: from storage DS-9afc3420-4cef-4d5d-a271-c3b085915240 node DatanodeRegistration(127.0.0.1:46099, datanodeUuid=1a36a8dc-33f7-4928-a6f9-de7cadd8426c, infoPort=44481, infoSecurePort=0, ipcPort=45629, storageInfo=lv=-57;cid=testClusterID;nsid=246827537;c=1704711328209), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-01-08 10:55:30,540 DEBUG [Listener at localhost/34349] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879 2024-01-08 10:55:30,657 INFO [Listener at localhost/34349] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/cluster_bcadc389-5d61-62b6-5c09-06ca34aa64a2/zookeeper_0, clientPort=52049, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/cluster_bcadc389-5d61-62b6-5c09-06ca34aa64a2/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/cluster_bcadc389-5d61-62b6-5c09-06ca34aa64a2/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2024-01-08 10:55:30,673 INFO [Listener at localhost/34349] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=52049 2024-01-08 10:55:30,686 INFO [Listener at localhost/34349] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-08 10:55:30,689 INFO [Listener at localhost/34349] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-08 10:55:31,379 INFO [Listener at localhost/34349] util.FSUtils(471): Created version file at hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840 with version=8 2024-01-08 10:55:31,379 INFO [Listener at localhost/34349] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/hbase-staging 2024-01-08 10:55:31,727 INFO [Listener at localhost/34349] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2024-01-08 10:55:32,207 INFO [Listener at localhost/34349] client.ConnectionUtils(126): master/jenkins-hbase4:0 server-side Connection retries=45 2024-01-08 10:55:32,240 INFO [Listener at localhost/34349] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-08 10:55:32,241 INFO [Listener at localhost/34349] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-01-08 10:55:32,241 INFO [Listener at localhost/34349] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-01-08 10:55:32,241 INFO [Listener at localhost/34349] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-08 10:55:32,241 INFO [Listener at localhost/34349] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-01-08 10:55:32,395 INFO [Listener at localhost/34349] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2024-01-08 10:55:32,468 DEBUG [Listener at localhost/34349] util.ClassSize(228): Using Unsafe to estimate memory layout 2024-01-08 10:55:32,565 INFO [Listener at localhost/34349] ipc.NettyRpcServer(120): Bind to /172.31.14.131:44665 2024-01-08 10:55:32,576 INFO [Listener at localhost/34349] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-08 10:55:32,578 INFO [Listener at localhost/34349] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-08 10:55:32,603 INFO [Listener at localhost/34349] zookeeper.RecoverableZooKeeper(93): Process identifier=master:44665 connecting to ZooKeeper ensemble=127.0.0.1:52049 2024-01-08 10:55:32,649 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:446650x0, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-01-08 10:55:32,651 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:44665-0x10106c67f690000 connected 2024-01-08 10:55:32,685 DEBUG [Listener at localhost/34349] zookeeper.ZKUtil(165): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-01-08 10:55:32,686 DEBUG [Listener at localhost/34349] zookeeper.ZKUtil(165): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-08 10:55:32,689 DEBUG [Listener at localhost/34349] zookeeper.ZKUtil(165): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-01-08 10:55:32,697 DEBUG [Listener at localhost/34349] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=44665 2024-01-08 10:55:32,698 DEBUG [Listener at localhost/34349] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=44665 2024-01-08 10:55:32,698 DEBUG [Listener at localhost/34349] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=44665 2024-01-08 10:55:32,699 DEBUG [Listener at localhost/34349] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=44665 2024-01-08 10:55:32,699 DEBUG [Listener at localhost/34349] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=44665 2024-01-08 10:55:32,705 INFO [Listener at localhost/34349] master.HMaster(445): hbase.rootdir=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840, hbase.cluster.distributed=false 2024-01-08 10:55:32,779 INFO [Listener at localhost/34349] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-01-08 10:55:32,779 INFO [Listener at localhost/34349] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-08 10:55:32,779 INFO [Listener at localhost/34349] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-01-08 10:55:32,779 INFO [Listener at localhost/34349] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-01-08 10:55:32,779 INFO [Listener at localhost/34349] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-08 10:55:32,779 INFO [Listener at localhost/34349] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-01-08 10:55:32,784 INFO [Listener at localhost/34349] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-01-08 10:55:32,787 INFO [Listener at localhost/34349] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39335 2024-01-08 10:55:32,789 INFO [Listener at localhost/34349] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-01-08 10:55:32,796 DEBUG [Listener at localhost/34349] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-01-08 10:55:32,797 INFO [Listener at localhost/34349] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-08 10:55:32,799 INFO [Listener at localhost/34349] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-08 10:55:32,801 INFO [Listener at localhost/34349] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39335 connecting to ZooKeeper ensemble=127.0.0.1:52049 2024-01-08 10:55:32,805 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): regionserver:393350x0, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-01-08 10:55:32,806 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39335-0x10106c67f690001 connected 2024-01-08 10:55:32,806 DEBUG [Listener at localhost/34349] zookeeper.ZKUtil(165): regionserver:39335-0x10106c67f690001, quorum=127.0.0.1:52049, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-01-08 10:55:32,808 DEBUG [Listener at localhost/34349] zookeeper.ZKUtil(165): regionserver:39335-0x10106c67f690001, quorum=127.0.0.1:52049, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-08 10:55:32,809 DEBUG [Listener at localhost/34349] zookeeper.ZKUtil(165): regionserver:39335-0x10106c67f690001, quorum=127.0.0.1:52049, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-01-08 10:55:32,809 DEBUG [Listener at localhost/34349] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39335 2024-01-08 10:55:32,809 DEBUG [Listener at localhost/34349] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39335 2024-01-08 10:55:32,810 DEBUG [Listener at localhost/34349] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39335 2024-01-08 10:55:32,810 DEBUG [Listener at localhost/34349] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39335 2024-01-08 10:55:32,811 DEBUG [Listener at localhost/34349] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39335 2024-01-08 10:55:32,824 INFO [Listener at localhost/34349] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-01-08 10:55:32,824 INFO [Listener at localhost/34349] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-08 10:55:32,824 INFO [Listener at localhost/34349] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-01-08 10:55:32,825 INFO [Listener at localhost/34349] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-01-08 10:55:32,825 INFO [Listener at localhost/34349] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-01-08 10:55:32,825 INFO [Listener at localhost/34349] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-01-08 10:55:32,825 INFO [Listener at localhost/34349] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-01-08 10:55:32,827 INFO [Listener at localhost/34349] ipc.NettyRpcServer(120): Bind to /172.31.14.131:38189 2024-01-08 10:55:32,827 INFO [Listener at localhost/34349] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-01-08 10:55:32,828 DEBUG [Listener at localhost/34349] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-01-08 10:55:32,829 INFO [Listener at localhost/34349] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-08 10:55:32,831 INFO [Listener at localhost/34349] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-08 10:55:32,833 INFO [Listener at localhost/34349] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:38189 connecting to ZooKeeper ensemble=127.0.0.1:52049 2024-01-08 10:55:32,837 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): regionserver:381890x0, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-01-08 10:55:32,838 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:38189-0x10106c67f690002 connected 2024-01-08 10:55:32,839 DEBUG [Listener at localhost/34349] zookeeper.ZKUtil(165): regionserver:38189-0x10106c67f690002, quorum=127.0.0.1:52049, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-01-08 10:55:32,840 DEBUG [Listener at localhost/34349] zookeeper.ZKUtil(165): regionserver:38189-0x10106c67f690002, quorum=127.0.0.1:52049, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-08 10:55:32,840 DEBUG [Listener at localhost/34349] zookeeper.ZKUtil(165): regionserver:38189-0x10106c67f690002, quorum=127.0.0.1:52049, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-01-08 10:55:32,841 DEBUG [Listener at localhost/34349] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=38189 2024-01-08 10:55:32,841 DEBUG [Listener at localhost/34349] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=38189 2024-01-08 10:55:32,842 DEBUG [Listener at localhost/34349] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=38189 2024-01-08 10:55:32,842 DEBUG [Listener at localhost/34349] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=38189 2024-01-08 10:55:32,842 DEBUG [Listener at localhost/34349] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=38189 2024-01-08 10:55:32,844 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2174): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,44665,1704711331544 2024-01-08 10:55:32,854 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-01-08 10:55:32,856 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,44665,1704711331544 2024-01-08 10:55:32,876 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): regionserver:39335-0x10106c67f690001, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-01-08 10:55:32,876 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-01-08 10:55:32,876 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): regionserver:38189-0x10106c67f690002, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-01-08 10:55:32,876 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-08 10:55:32,878 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-01-08 10:55:32,879 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,44665,1704711331544 from backup master directory 2024-01-08 10:55:32,879 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(163): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-01-08 10:55:32,883 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,44665,1704711331544 2024-01-08 10:55:32,883 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-01-08 10:55:32,884 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-01-08 10:55:32,884 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,44665,1704711331544 2024-01-08 10:55:32,887 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2024-01-08 10:55:32,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2024-01-08 10:55:32,981 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/hbase.id with ID: f081b951-fcd7-4d29-9e0f-61d045431ea8 2024-01-08 10:55:33,027 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-01-08 10:55:33,044 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-08 10:55:33,091 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x3096f690 to 127.0.0.1:52049 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-01-08 10:55:33,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7a34a9ee, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-01-08 10:55:33,152 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-08 10:55:33,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2024-01-08 10:55:33,175 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2024-01-08 10:55:33,175 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2024-01-08 10:55:33,177 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-01-08 10:55:33,181 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-01-08 10:55:33,183 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-01-08 10:55:33,219 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/MasterData/data/master/store-tmp 2024-01-08 10:55:33,253 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-08 10:55:33,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-01-08 10:55:33,254 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-08 10:55:33,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-08 10:55:33,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-01-08 10:55:33,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-08 10:55:33,254 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-08 10:55:33,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-01-08 10:55:33,256 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/MasterData/WALs/jenkins-hbase4.apache.org,44665,1704711331544 2024-01-08 10:55:33,277 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C44665%2C1704711331544, suffix=, logDir=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/MasterData/WALs/jenkins-hbase4.apache.org,44665,1704711331544, archiveDir=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/MasterData/oldWALs, maxLogs=10 2024-01-08 10:55:33,337 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46099,DS-679739df-70ab-4d72-bce4-00444c23eb85,DISK] 2024-01-08 10:55:33,337 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33331,DS-e8beb3e7-699c-4771-87a2-e80dcdc3ddc4,DISK] 2024-01-08 10:55:33,346 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2024-01-08 10:55:33,415 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/MasterData/WALs/jenkins-hbase4.apache.org,44665,1704711331544/jenkins-hbase4.apache.org%2C44665%2C1704711331544.1704711333288 2024-01-08 10:55:33,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:33331,DS-e8beb3e7-699c-4771-87a2-e80dcdc3ddc4,DISK], DatanodeInfoWithStorage[127.0.0.1:46099,DS-679739df-70ab-4d72-bce4-00444c23eb85,DISK]] 2024-01-08 10:55:33,417 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2024-01-08 10:55:33,417 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-08 10:55:33,420 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2024-01-08 10:55:33,422 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2024-01-08 10:55:33,482 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2024-01-08 10:55:33,490 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2024-01-08 10:55:33,514 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2024-01-08 10:55:33,527 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-08 10:55:33,534 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-01-08 10:55:33,536 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-01-08 10:55:33,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2024-01-08 10:55:33,557 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-08 10:55:33,558 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62638791, jitterRate=-0.06660927832126617}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-08 10:55:33,558 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2024-01-08 10:55:33,559 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2024-01-08 10:55:33,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2024-01-08 10:55:33,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(608): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2024-01-08 10:55:33,582 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2024-01-08 10:55:33,584 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(628): Recovered RegionProcedureStore lease in 1 msec 2024-01-08 10:55:33,619 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(642): Loaded RegionProcedureStore in 34 msec 2024-01-08 10:55:33,619 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2024-01-08 10:55:33,646 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2024-01-08 10:55:33,651 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2024-01-08 10:55:33,677 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2024-01-08 10:55:33,680 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2024-01-08 10:55:33,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2024-01-08 10:55:33,688 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2024-01-08 10:55:33,693 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2024-01-08 10:55:33,696 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-08 10:55:33,698 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2024-01-08 10:55:33,699 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2024-01-08 10:55:33,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2024-01-08 10:55:33,716 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): regionserver:39335-0x10106c67f690001, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-01-08 10:55:33,716 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): regionserver:38189-0x10106c67f690002, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-01-08 10:55:33,716 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-01-08 10:55:33,717 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-08 10:55:33,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(745): Active/primary master=jenkins-hbase4.apache.org,44665,1704711331544, sessionid=0x10106c67f690000, setting cluster-up flag (Was=false) 2024-01-08 10:55:33,736 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-08 10:55:33,743 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2024-01-08 10:55:33,745 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44665,1704711331544 2024-01-08 10:55:33,751 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-08 10:55:33,759 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2024-01-08 10:55:33,761 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,44665,1704711331544 2024-01-08 10:55:33,764 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.hbase-snapshot/.tmp 2024-01-08 10:55:33,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver loaded, priority=536870911. 2024-01-08 10:55:33,846 INFO [RS:0;jenkins-hbase4:39335] regionserver.HRegionServer(954): ClusterId : f081b951-fcd7-4d29-9e0f-61d045431ea8 2024-01-08 10:55:33,846 INFO [RS:1;jenkins-hbase4:38189] regionserver.HRegionServer(954): ClusterId : f081b951-fcd7-4d29-9e0f-61d045431ea8 2024-01-08 10:55:33,852 DEBUG [RS:1;jenkins-hbase4:38189] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-01-08 10:55:33,852 DEBUG [RS:0;jenkins-hbase4:39335] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-01-08 10:55:33,859 DEBUG [RS:0;jenkins-hbase4:39335] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-01-08 10:55:33,859 DEBUG [RS:1;jenkins-hbase4:38189] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-01-08 10:55:33,860 DEBUG [RS:0;jenkins-hbase4:39335] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-01-08 10:55:33,860 DEBUG [RS:1;jenkins-hbase4:38189] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-01-08 10:55:33,864 DEBUG [RS:0;jenkins-hbase4:39335] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-01-08 10:55:33,864 DEBUG [RS:1;jenkins-hbase4:38189] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-01-08 10:55:33,867 DEBUG [RS:1;jenkins-hbase4:38189] zookeeper.ReadOnlyZKClient(139): Connect 0x3c7afe35 to 127.0.0.1:52049 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-01-08 10:55:33,867 DEBUG [RS:0;jenkins-hbase4:39335] zookeeper.ReadOnlyZKClient(139): Connect 0x43d7c6dd to 127.0.0.1:52049 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-01-08 10:55:33,881 DEBUG [RS:1;jenkins-hbase4:38189] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@32bd17ca, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-01-08 10:55:33,882 DEBUG [RS:0;jenkins-hbase4:39335] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@4d1020d7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-01-08 10:55:33,882 DEBUG [RS:1;jenkins-hbase4:38189] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@36829545, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-01-08 10:55:33,882 DEBUG [RS:0;jenkins-hbase4:39335] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@492fadad, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-01-08 10:55:33,888 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2024-01-08 10:55:33,898 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-01-08 10:55:33,898 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-01-08 10:55:33,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-01-08 10:55:33,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-01-08 10:55:33,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2024-01-08 10:55:33,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-08 10:55:33,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-01-08 10:55:33,899 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-08 10:55:33,900 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1704711363900 2024-01-08 10:55:33,902 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2024-01-08 10:55:33,906 DEBUG [RS:1;jenkins-hbase4:38189] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:38189 2024-01-08 10:55:33,907 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2024-01-08 10:55:33,907 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2024-01-08 10:55:33,909 DEBUG [RS:0;jenkins-hbase4:39335] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39335 2024-01-08 10:55:33,912 INFO [RS:1;jenkins-hbase4:38189] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-01-08 10:55:33,912 INFO [RS:1;jenkins-hbase4:38189] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-01-08 10:55:33,912 DEBUG [RS:1;jenkins-hbase4:38189] regionserver.HRegionServer(1025): About to register with Master. 2024-01-08 10:55:33,912 INFO [RS:0;jenkins-hbase4:39335] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-01-08 10:55:33,912 INFO [RS:0;jenkins-hbase4:39335] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-01-08 10:55:33,913 DEBUG [RS:0;jenkins-hbase4:39335] regionserver.HRegionServer(1025): About to register with Master. 2024-01-08 10:55:33,914 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-01-08 10:55:33,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2024-01-08 10:55:33,916 INFO [RS:1;jenkins-hbase4:38189] regionserver.HRegionServer(2814): reportForDuty to master=jenkins-hbase4.apache.org,44665,1704711331544 with isa=jenkins-hbase4.apache.org/172.31.14.131:38189, startcode=1704711332823 2024-01-08 10:55:33,916 INFO [RS:0;jenkins-hbase4:39335] regionserver.HRegionServer(2814): reportForDuty to master=jenkins-hbase4.apache.org,44665,1704711331544 with isa=jenkins-hbase4.apache.org/172.31.14.131:39335, startcode=1704711332778 2024-01-08 10:55:33,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2024-01-08 10:55:33,925 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2024-01-08 10:55:33,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2024-01-08 10:55:33,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2024-01-08 10:55:33,926 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:33,930 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2024-01-08 10:55:33,931 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2024-01-08 10:55:33,932 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2024-01-08 10:55:33,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2024-01-08 10:55:33,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2024-01-08 10:55:33,938 DEBUG [RS:0;jenkins-hbase4:39335] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-01-08 10:55:33,939 DEBUG [RS:1;jenkins-hbase4:38189] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-01-08 10:55:33,940 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1704711333939,5,FailOnTimeoutGroup] 2024-01-08 10:55:33,941 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1704711333941,5,FailOnTimeoutGroup] 2024-01-08 10:55:33,941 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:33,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1466): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2024-01-08 10:55:33,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:33,945 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:33,968 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-01-08 10:55:33,970 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-01-08 10:55:33,970 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840 2024-01-08 10:55:34,005 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-08 10:55:34,010 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-01-08 10:55:34,019 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/meta/1588230740/info 2024-01-08 10:55:34,021 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-01-08 10:55:34,022 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42473, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2024-01-08 10:55:34,022 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58057, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2024-01-08 10:55:34,024 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-08 10:55:34,024 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-01-08 10:55:34,028 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/meta/1588230740/rep_barrier 2024-01-08 10:55:34,029 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-01-08 10:55:34,030 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-08 10:55:34,031 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-01-08 10:55:34,035 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/meta/1588230740/table 2024-01-08 10:55:34,036 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-01-08 10:55:34,037 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44665] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,38189,1704711332823 2024-01-08 10:55:34,038 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-08 10:55:34,040 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/meta/1588230740 2024-01-08 10:55:34,041 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/meta/1588230740 2024-01-08 10:55:34,046 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-01-08 10:55:34,048 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2024-01-08 10:55:34,053 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-08 10:55:34,055 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=44665] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:55:34,056 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71028563, jitterRate=0.058408066630363464}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-01-08 10:55:34,056 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2024-01-08 10:55:34,056 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-01-08 10:55:34,056 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-01-08 10:55:34,056 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-01-08 10:55:34,056 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-01-08 10:55:34,056 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-01-08 10:55:34,057 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-01-08 10:55:34,058 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-01-08 10:55:34,061 DEBUG [RS:1;jenkins-hbase4:38189] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840 2024-01-08 10:55:34,061 DEBUG [RS:1;jenkins-hbase4:38189] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:38469 2024-01-08 10:55:34,061 DEBUG [RS:1;jenkins-hbase4:38189] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-01-08 10:55:34,062 DEBUG [RS:0;jenkins-hbase4:39335] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840 2024-01-08 10:55:34,062 DEBUG [RS:0;jenkins-hbase4:39335] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:38469 2024-01-08 10:55:34,062 DEBUG [RS:0;jenkins-hbase4:39335] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-01-08 10:55:34,064 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2024-01-08 10:55:34,064 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2024-01-08 10:55:34,072 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-01-08 10:55:34,073 DEBUG [RS:1;jenkins-hbase4:38189] zookeeper.ZKUtil(163): regionserver:38189-0x10106c67f690002, quorum=127.0.0.1:52049, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38189,1704711332823 2024-01-08 10:55:34,073 WARN [RS:1;jenkins-hbase4:38189] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-01-08 10:55:34,073 DEBUG [RS:0;jenkins-hbase4:39335] zookeeper.ZKUtil(163): regionserver:39335-0x10106c67f690001, quorum=127.0.0.1:52049, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:55:34,074 INFO [RS:1;jenkins-hbase4:38189] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-01-08 10:55:34,074 WARN [RS:0;jenkins-hbase4:39335] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-01-08 10:55:34,075 DEBUG [RS:1;jenkins-hbase4:38189] regionserver.HRegionServer(1951): logDir=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/WALs/jenkins-hbase4.apache.org,38189,1704711332823 2024-01-08 10:55:34,075 INFO [RS:0;jenkins-hbase4:39335] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-01-08 10:55:34,083 DEBUG [RS:0;jenkins-hbase4:39335] regionserver.HRegionServer(1951): logDir=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/WALs/jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:55:34,084 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2024-01-08 10:55:34,084 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39335,1704711332778] 2024-01-08 10:55:34,086 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,38189,1704711332823] 2024-01-08 10:55:34,097 DEBUG [RS:0;jenkins-hbase4:39335] zookeeper.ZKUtil(163): regionserver:39335-0x10106c67f690001, quorum=127.0.0.1:52049, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:55:34,097 DEBUG [RS:1;jenkins-hbase4:38189] zookeeper.ZKUtil(163): regionserver:38189-0x10106c67f690002, quorum=127.0.0.1:52049, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:55:34,097 DEBUG [RS:0;jenkins-hbase4:39335] zookeeper.ZKUtil(163): regionserver:39335-0x10106c67f690001, quorum=127.0.0.1:52049, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38189,1704711332823 2024-01-08 10:55:34,098 DEBUG [RS:1;jenkins-hbase4:38189] zookeeper.ZKUtil(163): regionserver:38189-0x10106c67f690002, quorum=127.0.0.1:52049, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,38189,1704711332823 2024-01-08 10:55:34,101 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2024-01-08 10:55:34,105 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2024-01-08 10:55:34,111 DEBUG [RS:1;jenkins-hbase4:38189] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-01-08 10:55:34,111 DEBUG [RS:0;jenkins-hbase4:39335] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-01-08 10:55:34,122 INFO [RS:1;jenkins-hbase4:38189] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-01-08 10:55:34,122 INFO [RS:0;jenkins-hbase4:39335] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-01-08 10:55:34,143 INFO [RS:0;jenkins-hbase4:39335] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-01-08 10:55:34,143 INFO [RS:1;jenkins-hbase4:38189] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-01-08 10:55:34,147 INFO [RS:0;jenkins-hbase4:39335] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-01-08 10:55:34,147 INFO [RS:1;jenkins-hbase4:38189] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-01-08 10:55:34,148 INFO [RS:0;jenkins-hbase4:39335] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:34,148 INFO [RS:1;jenkins-hbase4:38189] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:34,149 INFO [RS:0;jenkins-hbase4:39335] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-01-08 10:55:34,151 INFO [RS:1;jenkins-hbase4:38189] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-01-08 10:55:34,161 INFO [RS:1;jenkins-hbase4:38189] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:34,161 INFO [RS:0;jenkins-hbase4:39335] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:34,161 DEBUG [RS:1;jenkins-hbase4:38189] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-08 10:55:34,161 DEBUG [RS:0;jenkins-hbase4:39335] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-08 10:55:34,162 DEBUG [RS:1;jenkins-hbase4:38189] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-08 10:55:34,162 DEBUG [RS:0;jenkins-hbase4:39335] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-08 10:55:34,162 DEBUG [RS:1;jenkins-hbase4:38189] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-08 10:55:34,162 DEBUG [RS:0;jenkins-hbase4:39335] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-08 10:55:34,162 DEBUG [RS:1;jenkins-hbase4:38189] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-08 10:55:34,162 DEBUG [RS:0;jenkins-hbase4:39335] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-08 10:55:34,162 DEBUG [RS:1;jenkins-hbase4:38189] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-08 10:55:34,162 DEBUG [RS:0;jenkins-hbase4:39335] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-08 10:55:34,162 DEBUG [RS:1;jenkins-hbase4:38189] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-01-08 10:55:34,162 DEBUG [RS:0;jenkins-hbase4:39335] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-01-08 10:55:34,162 DEBUG [RS:1;jenkins-hbase4:38189] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-08 10:55:34,162 DEBUG [RS:0;jenkins-hbase4:39335] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-08 10:55:34,163 DEBUG [RS:1;jenkins-hbase4:38189] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-08 10:55:34,163 DEBUG [RS:0;jenkins-hbase4:39335] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-08 10:55:34,163 DEBUG [RS:1;jenkins-hbase4:38189] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-08 10:55:34,163 DEBUG [RS:0;jenkins-hbase4:39335] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-08 10:55:34,163 DEBUG [RS:1;jenkins-hbase4:38189] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-08 10:55:34,163 DEBUG [RS:0;jenkins-hbase4:39335] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-01-08 10:55:34,172 INFO [RS:1;jenkins-hbase4:38189] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:34,173 INFO [RS:1;jenkins-hbase4:38189] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:34,173 INFO [RS:1;jenkins-hbase4:38189] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:34,173 INFO [RS:1;jenkins-hbase4:38189] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:34,185 INFO [RS:0;jenkins-hbase4:39335] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:34,186 INFO [RS:0;jenkins-hbase4:39335] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:34,186 INFO [RS:0;jenkins-hbase4:39335] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:34,186 INFO [RS:0;jenkins-hbase4:39335] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:34,211 INFO [RS:0;jenkins-hbase4:39335] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-01-08 10:55:34,211 INFO [RS:1;jenkins-hbase4:38189] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-01-08 10:55:34,215 INFO [RS:1;jenkins-hbase4:38189] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,38189,1704711332823-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:34,215 INFO [RS:0;jenkins-hbase4:39335] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39335,1704711332778-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:34,257 DEBUG [jenkins-hbase4:44665] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=2, allServersCount=2 2024-01-08 10:55:34,262 DEBUG [jenkins-hbase4:44665] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-08 10:55:34,281 DEBUG [jenkins-hbase4:44665] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-08 10:55:34,281 DEBUG [jenkins-hbase4:44665] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-08 10:55:34,281 DEBUG [jenkins-hbase4:44665] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-08 10:55:34,282 INFO [RS:0;jenkins-hbase4:39335] regionserver.Replication(203): jenkins-hbase4.apache.org,39335,1704711332778 started 2024-01-08 10:55:34,283 INFO [RS:0;jenkins-hbase4:39335] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,39335,1704711332778, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39335, sessionid=0x10106c67f690001 2024-01-08 10:55:34,283 DEBUG [RS:0;jenkins-hbase4:39335] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-01-08 10:55:34,283 DEBUG [RS:0;jenkins-hbase4:39335] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:55:34,283 DEBUG [RS:0;jenkins-hbase4:39335] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39335,1704711332778' 2024-01-08 10:55:34,283 DEBUG [RS:0;jenkins-hbase4:39335] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-01-08 10:55:34,285 DEBUG [RS:0;jenkins-hbase4:39335] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-01-08 10:55:34,286 INFO [RS:1;jenkins-hbase4:38189] regionserver.Replication(203): jenkins-hbase4.apache.org,38189,1704711332823 started 2024-01-08 10:55:34,286 INFO [RS:1;jenkins-hbase4:38189] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,38189,1704711332823, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:38189, sessionid=0x10106c67f690002 2024-01-08 10:55:34,287 DEBUG [RS:1;jenkins-hbase4:38189] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-01-08 10:55:34,287 DEBUG [RS:1;jenkins-hbase4:38189] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,38189,1704711332823 2024-01-08 10:55:34,287 DEBUG [RS:1;jenkins-hbase4:38189] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38189,1704711332823' 2024-01-08 10:55:34,288 DEBUG [RS:1;jenkins-hbase4:38189] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-01-08 10:55:34,288 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39335,1704711332778, state=OPENING 2024-01-08 10:55:34,288 DEBUG [RS:0;jenkins-hbase4:39335] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-01-08 10:55:34,289 DEBUG [RS:0;jenkins-hbase4:39335] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-01-08 10:55:34,289 DEBUG [RS:0;jenkins-hbase4:39335] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:55:34,289 DEBUG [RS:0;jenkins-hbase4:39335] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39335,1704711332778' 2024-01-08 10:55:34,289 DEBUG [RS:0;jenkins-hbase4:39335] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-01-08 10:55:34,289 DEBUG [RS:1;jenkins-hbase4:38189] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-01-08 10:55:34,290 DEBUG [RS:1;jenkins-hbase4:38189] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-01-08 10:55:34,290 DEBUG [RS:1;jenkins-hbase4:38189] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-01-08 10:55:34,290 DEBUG [RS:1;jenkins-hbase4:38189] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,38189,1704711332823 2024-01-08 10:55:34,291 DEBUG [RS:1;jenkins-hbase4:38189] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,38189,1704711332823' 2024-01-08 10:55:34,291 DEBUG [RS:1;jenkins-hbase4:38189] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-01-08 10:55:34,292 DEBUG [RS:0;jenkins-hbase4:39335] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-01-08 10:55:34,293 DEBUG [RS:1;jenkins-hbase4:38189] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-01-08 10:55:34,293 DEBUG [RS:0;jenkins-hbase4:39335] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-01-08 10:55:34,293 INFO [RS:0;jenkins-hbase4:39335] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-01-08 10:55:34,294 DEBUG [RS:1;jenkins-hbase4:38189] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-01-08 10:55:34,294 INFO [RS:1;jenkins-hbase4:38189] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-01-08 10:55:34,318 INFO [RS:0;jenkins-hbase4:39335] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:34,319 INFO [RS:1;jenkins-hbase4:38189] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:34,320 DEBUG [RS:0;jenkins-hbase4:39335] zookeeper.ZKUtil(399): regionserver:39335-0x10106c67f690001, quorum=127.0.0.1:52049, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-01-08 10:55:34,320 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2024-01-08 10:55:34,321 DEBUG [RS:1;jenkins-hbase4:38189] zookeeper.ZKUtil(399): regionserver:38189-0x10106c67f690002, quorum=127.0.0.1:52049, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-01-08 10:55:34,321 INFO [RS:1;jenkins-hbase4:38189] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-01-08 10:55:34,321 INFO [RS:0;jenkins-hbase4:39335] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-01-08 10:55:34,321 INFO [RS:1;jenkins-hbase4:38189] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:34,321 INFO [RS:0;jenkins-hbase4:39335] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:34,322 INFO [RS:1;jenkins-hbase4:38189] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:34,322 INFO [RS:0;jenkins-hbase4:39335] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:34,323 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-08 10:55:34,324 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-01-08 10:55:34,329 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39335,1704711332778}] 2024-01-08 10:55:34,440 INFO [RS:1;jenkins-hbase4:38189] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C38189%2C1704711332823, suffix=, logDir=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/WALs/jenkins-hbase4.apache.org,38189,1704711332823, archiveDir=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/oldWALs, maxLogs=32 2024-01-08 10:55:34,440 INFO [RS:0;jenkins-hbase4:39335] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39335%2C1704711332778, suffix=, logDir=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/WALs/jenkins-hbase4.apache.org,39335,1704711332778, archiveDir=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/oldWALs, maxLogs=32 2024-01-08 10:55:34,540 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46099,DS-679739df-70ab-4d72-bce4-00444c23eb85,DISK] 2024-01-08 10:55:34,568 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33331,DS-e8beb3e7-699c-4771-87a2-e80dcdc3ddc4,DISK] 2024-01-08 10:55:34,634 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33331,DS-e8beb3e7-699c-4771-87a2-e80dcdc3ddc4,DISK] 2024-01-08 10:55:34,634 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46099,DS-679739df-70ab-4d72-bce4-00444c23eb85,DISK] 2024-01-08 10:55:34,645 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:55:34,648 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-01-08 10:55:34,657 INFO [RS:1;jenkins-hbase4:38189] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/WALs/jenkins-hbase4.apache.org,38189,1704711332823/jenkins-hbase4.apache.org%2C38189%2C1704711332823.1704711334447 2024-01-08 10:55:34,669 DEBUG [RS:1;jenkins-hbase4:38189] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46099,DS-679739df-70ab-4d72-bce4-00444c23eb85,DISK], DatanodeInfoWithStorage[127.0.0.1:33331,DS-e8beb3e7-699c-4771-87a2-e80dcdc3ddc4,DISK]] 2024-01-08 10:55:34,682 INFO [RS:0;jenkins-hbase4:39335] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/WALs/jenkins-hbase4.apache.org,39335,1704711332778/jenkins-hbase4.apache.org%2C39335%2C1704711332778.1704711334446 2024-01-08 10:55:34,708 DEBUG [RS:0;jenkins-hbase4:39335] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46099,DS-679739df-70ab-4d72-bce4-00444c23eb85,DISK], DatanodeInfoWithStorage[127.0.0.1:33331,DS-e8beb3e7-699c-4771-87a2-e80dcdc3ddc4,DISK]] 2024-01-08 10:55:34,711 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34694, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-01-08 10:55:34,753 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2024-01-08 10:55:34,753 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-01-08 10:55:34,761 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39335%2C1704711332778.meta, suffix=.meta, logDir=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/WALs/jenkins-hbase4.apache.org,39335,1704711332778, archiveDir=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/oldWALs, maxLogs=32 2024-01-08 10:55:34,827 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:46099,DS-679739df-70ab-4d72-bce4-00444c23eb85,DISK] 2024-01-08 10:55:34,844 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:33331,DS-e8beb3e7-699c-4771-87a2-e80dcdc3ddc4,DISK] 2024-01-08 10:55:34,885 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/WALs/jenkins-hbase4.apache.org,39335,1704711332778/jenkins-hbase4.apache.org%2C39335%2C1704711332778.meta.1704711334763.meta 2024-01-08 10:55:34,898 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:46099,DS-679739df-70ab-4d72-bce4-00444c23eb85,DISK], DatanodeInfoWithStorage[127.0.0.1:33331,DS-e8beb3e7-699c-4771-87a2-e80dcdc3ddc4,DISK]] 2024-01-08 10:55:34,899 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2024-01-08 10:55:34,902 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2024-01-08 10:55:34,976 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2024-01-08 10:55:35,013 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2024-01-08 10:55:35,054 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2024-01-08 10:55:35,075 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-08 10:55:35,076 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2024-01-08 10:55:35,076 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2024-01-08 10:55:35,093 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-01-08 10:55:35,095 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/meta/1588230740/info 2024-01-08 10:55:35,095 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/meta/1588230740/info 2024-01-08 10:55:35,096 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-01-08 10:55:35,099 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-08 10:55:35,099 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-01-08 10:55:35,101 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/meta/1588230740/rep_barrier 2024-01-08 10:55:35,102 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/meta/1588230740/rep_barrier 2024-01-08 10:55:35,102 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-01-08 10:55:35,103 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-08 10:55:35,104 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-01-08 10:55:35,106 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/meta/1588230740/table 2024-01-08 10:55:35,106 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/meta/1588230740/table 2024-01-08 10:55:35,107 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-01-08 10:55:35,108 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-08 10:55:35,123 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/meta/1588230740 2024-01-08 10:55:35,140 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/meta/1588230740 2024-01-08 10:55:35,176 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-01-08 10:55:35,198 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2024-01-08 10:55:35,212 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72129748, jitterRate=0.0748170018196106}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-01-08 10:55:35,213 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2024-01-08 10:55:35,307 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1704711334623 2024-01-08 10:55:35,457 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39335,1704711332778, state=OPEN 2024-01-08 10:55:35,463 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2024-01-08 10:55:35,463 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-01-08 10:55:35,473 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=3, resume processing ppid=2 2024-01-08 10:55:35,473 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39335,1704711332778 in 1.1340 sec 2024-01-08 10:55:35,481 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=2, resume processing ppid=1 2024-01-08 10:55:35,482 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 1.3910 sec 2024-01-08 10:55:35,492 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 1.6730 sec 2024-01-08 10:55:35,492 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(954): Wait for region servers to report in: status=null, state=RUNNING, startTime=1704711335492, completionTime=-1 2024-01-08 10:55:35,492 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2024-01-08 10:55:35,492 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2024-01-08 10:55:35,493 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for hbase:meta,,1.1588230740 2024-01-08 10:55:35,494 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2024-01-08 10:55:35,865 DEBUG [hconnection-0x7a4b07db-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-01-08 10:55:35,868 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34706, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-01-08 10:55:35,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=2 2024-01-08 10:55:35,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1704711395886 2024-01-08 10:55:35,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1704711455886 2024-01-08 10:55:35,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 393 msec 2024-01-08 10:55:35,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44665,1704711331544-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:35,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44665,1704711331544-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:35,915 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44665,1704711331544-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:35,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:44665, period=300000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:35,918 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:35,925 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2024-01-08 10:55:35,936 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2024-01-08 10:55:35,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-01-08 10:55:35,949 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2024-01-08 10:55:35,956 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2024-01-08 10:55:35,959 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-08 10:55:35,985 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/hbase/namespace/0499fb4abf5cf46f848299662aa32b7f 2024-01-08 10:55:35,988 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/hbase/namespace/0499fb4abf5cf46f848299662aa32b7f empty. 2024-01-08 10:55:35,989 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/hbase/namespace/0499fb4abf5cf46f848299662aa32b7f 2024-01-08 10:55:35,989 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2024-01-08 10:55:36,029 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2024-01-08 10:55:36,032 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0499fb4abf5cf46f848299662aa32b7f, NAME => 'hbase:namespace,,1704711335937.0499fb4abf5cf46f848299662aa32b7f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp 2024-01-08 10:55:36,051 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1704711335937.0499fb4abf5cf46f848299662aa32b7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-08 10:55:36,051 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 0499fb4abf5cf46f848299662aa32b7f, disabling compactions & flushes 2024-01-08 10:55:36,052 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1704711335937.0499fb4abf5cf46f848299662aa32b7f. 2024-01-08 10:55:36,052 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1704711335937.0499fb4abf5cf46f848299662aa32b7f. 2024-01-08 10:55:36,052 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1704711335937.0499fb4abf5cf46f848299662aa32b7f. after waiting 0 ms 2024-01-08 10:55:36,052 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1704711335937.0499fb4abf5cf46f848299662aa32b7f. 2024-01-08 10:55:36,052 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1704711335937.0499fb4abf5cf46f848299662aa32b7f. 2024-01-08 10:55:36,052 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 0499fb4abf5cf46f848299662aa32b7f: 2024-01-08 10:55:36,058 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2024-01-08 10:55:36,073 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1704711335937.0499fb4abf5cf46f848299662aa32b7f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1704711336061"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1704711336061"}]},"ts":"1704711336061"} 2024-01-08 10:55:36,102 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-08 10:55:36,104 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-08 10:55:36,109 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704711336105"}]},"ts":"1704711336105"} 2024-01-08 10:55:36,114 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2024-01-08 10:55:36,121 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-08 10:55:36,123 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-08 10:55:36,123 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-08 10:55:36,123 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-08 10:55:36,126 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0499fb4abf5cf46f848299662aa32b7f, ASSIGN}] 2024-01-08 10:55:36,129 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=0499fb4abf5cf46f848299662aa32b7f, ASSIGN 2024-01-08 10:55:36,131 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=0499fb4abf5cf46f848299662aa32b7f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39335,1704711332778; forceNewPlan=false, retain=false 2024-01-08 10:55:36,284 INFO [jenkins-hbase4:44665] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-08 10:55:36,285 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0499fb4abf5cf46f848299662aa32b7f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:55:36,285 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1704711335937.0499fb4abf5cf46f848299662aa32b7f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1704711336285"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1704711336285"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1704711336285"}]},"ts":"1704711336285"} 2024-01-08 10:55:36,290 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 0499fb4abf5cf46f848299662aa32b7f, server=jenkins-hbase4.apache.org,39335,1704711332778}] 2024-01-08 10:55:36,444 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:55:36,452 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1704711335937.0499fb4abf5cf46f848299662aa32b7f. 2024-01-08 10:55:36,452 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0499fb4abf5cf46f848299662aa32b7f, NAME => 'hbase:namespace,,1704711335937.0499fb4abf5cf46f848299662aa32b7f.', STARTKEY => '', ENDKEY => ''} 2024-01-08 10:55:36,453 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 0499fb4abf5cf46f848299662aa32b7f 2024-01-08 10:55:36,453 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1704711335937.0499fb4abf5cf46f848299662aa32b7f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-08 10:55:36,453 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0499fb4abf5cf46f848299662aa32b7f 2024-01-08 10:55:36,453 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0499fb4abf5cf46f848299662aa32b7f 2024-01-08 10:55:36,456 INFO [StoreOpener-0499fb4abf5cf46f848299662aa32b7f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 0499fb4abf5cf46f848299662aa32b7f 2024-01-08 10:55:36,458 DEBUG [StoreOpener-0499fb4abf5cf46f848299662aa32b7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/namespace/0499fb4abf5cf46f848299662aa32b7f/info 2024-01-08 10:55:36,459 DEBUG [StoreOpener-0499fb4abf5cf46f848299662aa32b7f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/namespace/0499fb4abf5cf46f848299662aa32b7f/info 2024-01-08 10:55:36,459 INFO [StoreOpener-0499fb4abf5cf46f848299662aa32b7f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0499fb4abf5cf46f848299662aa32b7f columnFamilyName info 2024-01-08 10:55:36,460 INFO [StoreOpener-0499fb4abf5cf46f848299662aa32b7f-1] regionserver.HStore(310): Store=0499fb4abf5cf46f848299662aa32b7f/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-08 10:55:36,462 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/namespace/0499fb4abf5cf46f848299662aa32b7f 2024-01-08 10:55:36,464 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/namespace/0499fb4abf5cf46f848299662aa32b7f 2024-01-08 10:55:36,469 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0499fb4abf5cf46f848299662aa32b7f 2024-01-08 10:55:36,472 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/namespace/0499fb4abf5cf46f848299662aa32b7f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-08 10:55:36,473 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0499fb4abf5cf46f848299662aa32b7f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69942682, jitterRate=0.04222717881202698}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-08 10:55:36,473 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0499fb4abf5cf46f848299662aa32b7f: 2024-01-08 10:55:36,475 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for hbase:namespace,,1704711335937.0499fb4abf5cf46f848299662aa32b7f., pid=6, masterSystemTime=1704711336444 2024-01-08 10:55:36,479 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for hbase:namespace,,1704711335937.0499fb4abf5cf46f848299662aa32b7f. 2024-01-08 10:55:36,479 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1704711335937.0499fb4abf5cf46f848299662aa32b7f. 2024-01-08 10:55:36,481 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=0499fb4abf5cf46f848299662aa32b7f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:55:36,481 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1704711335937.0499fb4abf5cf46f848299662aa32b7f.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1704711336480"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1704711336480"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1704711336480"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1704711336480"}]},"ts":"1704711336480"} 2024-01-08 10:55:36,490 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=6, resume processing ppid=5 2024-01-08 10:55:36,491 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 0499fb4abf5cf46f848299662aa32b7f, server=jenkins-hbase4.apache.org,39335,1704711332778 in 196 msec 2024-01-08 10:55:36,494 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=5, resume processing ppid=4 2024-01-08 10:55:36,495 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=0499fb4abf5cf46f848299662aa32b7f, ASSIGN in 364 msec 2024-01-08 10:55:36,496 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-08 10:55:36,496 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704711336496"}]},"ts":"1704711336496"} 2024-01-08 10:55:36,499 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2024-01-08 10:55:36,502 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2024-01-08 10:55:36,505 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 564 msec 2024-01-08 10:55:36,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2024-01-08 10:55:36,554 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2024-01-08 10:55:36,554 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-08 10:55:36,590 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2024-01-08 10:55:36,609 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-01-08 10:55:36,617 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 34 msec 2024-01-08 10:55:36,625 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2024-01-08 10:55:36,638 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-01-08 10:55:36,644 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 19 msec 2024-01-08 10:55:36,652 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2024-01-08 10:55:36,654 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2024-01-08 10:55:36,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1084): Master has completed initialization 3.771sec 2024-01-08 10:55:36,658 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(103): Quota table not found. Creating... 2024-01-08 10:55:36,658 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-08 10:55:36,660 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:quota 2024-01-08 10:55:36,660 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(107): Initializing quota support 2024-01-08 10:55:36,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(59): Namespace State Manager started. 2024-01-08 10:55:36,663 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_PRE_OPERATION 2024-01-08 10:55:36,665 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-08 10:55:36,668 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/hbase/quota/d883bf22d50697f3557f80c625c49171 2024-01-08 10:55:36,669 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/hbase/quota/d883bf22d50697f3557f80c625c49171 empty. 2024-01-08 10:55:36,672 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/hbase/quota/d883bf22d50697f3557f80c625c49171 2024-01-08 10:55:36,672 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived hbase:quota regions 2024-01-08 10:55:36,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(222): Finished updating state of 2 namespaces. 2024-01-08 10:55:36,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceAuditor(50): NamespaceAuditor started. 2024-01-08 10:55:36,674 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:36,674 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:36,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2024-01-08 10:55:36,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2024-01-08 10:55:36,678 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44665,1704711331544-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2024-01-08 10:55:36,679 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44665,1704711331544-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2024-01-08 10:55:36,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1176): Balancer post startup initialization complete, took 0 seconds 2024-01-08 10:55:36,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,44665,1704711331544-OldWALsDirSizeChore, period=300000, unit=MILLISECONDS is enabled. 2024-01-08 10:55:36,693 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/hbase/quota/.tabledesc/.tableinfo.0000000001 2024-01-08 10:55:36,695 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(7675): creating {ENCODED => d883bf22d50697f3557f80c625c49171, NAME => 'hbase:quota,,1704711336658.d883bf22d50697f3557f80c625c49171.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp 2024-01-08 10:55:36,715 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(866): Instantiated hbase:quota,,1704711336658.d883bf22d50697f3557f80c625c49171.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-08 10:55:36,715 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1604): Closing d883bf22d50697f3557f80c625c49171, disabling compactions & flushes 2024-01-08 10:55:36,715 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1626): Closing region hbase:quota,,1704711336658.d883bf22d50697f3557f80c625c49171. 2024-01-08 10:55:36,715 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1704711336658.d883bf22d50697f3557f80c625c49171. 2024-01-08 10:55:36,715 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1704711336658.d883bf22d50697f3557f80c625c49171. after waiting 0 ms 2024-01-08 10:55:36,715 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1704711336658.d883bf22d50697f3557f80c625c49171. 2024-01-08 10:55:36,715 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1838): Closed hbase:quota,,1704711336658.d883bf22d50697f3557f80c625c49171. 2024-01-08 10:55:36,715 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1558): Region close journal for d883bf22d50697f3557f80c625c49171: 2024-01-08 10:55:36,720 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ADD_TO_META 2024-01-08 10:55:36,723 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:quota,,1704711336658.d883bf22d50697f3557f80c625c49171.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1704711336722"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1704711336722"}]},"ts":"1704711336722"} 2024-01-08 10:55:36,726 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-08 10:55:36,728 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-08 10:55:36,728 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704711336728"}]},"ts":"1704711336728"} 2024-01-08 10:55:36,731 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLING in hbase:meta 2024-01-08 10:55:36,738 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-08 10:55:36,740 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-08 10:55:36,740 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-08 10:55:36,740 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-08 10:55:36,740 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=d883bf22d50697f3557f80c625c49171, ASSIGN}] 2024-01-08 10:55:36,743 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=d883bf22d50697f3557f80c625c49171, ASSIGN 2024-01-08 10:55:36,744 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:quota, region=d883bf22d50697f3557f80c625c49171, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39335,1704711332778; forceNewPlan=false, retain=false 2024-01-08 10:55:36,762 DEBUG [Listener at localhost/34349] zookeeper.ReadOnlyZKClient(139): Connect 0x255a256c to 127.0.0.1:52049 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-01-08 10:55:36,767 DEBUG [Listener at localhost/34349] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7051ce65, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-01-08 10:55:36,782 DEBUG [hconnection-0x6c2b5037-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-01-08 10:55:36,794 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34722, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-01-08 10:55:36,804 INFO [Listener at localhost/34349] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,44665,1704711331544 2024-01-08 10:55:36,806 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:55:36,810 DEBUG [Listener at localhost/34349] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-01-08 10:55:36,895 INFO [jenkins-hbase4:44665] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-08 10:55:36,896 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=d883bf22d50697f3557f80c625c49171, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:55:36,896 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:quota,,1704711336658.d883bf22d50697f3557f80c625c49171.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1704711336896"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1704711336896"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1704711336896"}]},"ts":"1704711336896"} 2024-01-08 10:55:36,900 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure d883bf22d50697f3557f80c625c49171, server=jenkins-hbase4.apache.org,39335,1704711332778}] 2024-01-08 10:55:36,912 DEBUG [Listener at localhost/34349] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-01-08 10:55:37,015 DEBUG [Listener at localhost/34349] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-01-08 10:55:37,053 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:55:37,059 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:quota,,1704711336658.d883bf22d50697f3557f80c625c49171. 2024-01-08 10:55:37,059 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => d883bf22d50697f3557f80c625c49171, NAME => 'hbase:quota,,1704711336658.d883bf22d50697f3557f80c625c49171.', STARTKEY => '', ENDKEY => ''} 2024-01-08 10:55:37,060 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table quota d883bf22d50697f3557f80c625c49171 2024-01-08 10:55:37,060 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:quota,,1704711336658.d883bf22d50697f3557f80c625c49171.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-08 10:55:37,060 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for d883bf22d50697f3557f80c625c49171 2024-01-08 10:55:37,060 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for d883bf22d50697f3557f80c625c49171 2024-01-08 10:55:37,062 INFO [StoreOpener-d883bf22d50697f3557f80c625c49171-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family q of region d883bf22d50697f3557f80c625c49171 2024-01-08 10:55:37,064 DEBUG [StoreOpener-d883bf22d50697f3557f80c625c49171-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/quota/d883bf22d50697f3557f80c625c49171/q 2024-01-08 10:55:37,064 DEBUG [StoreOpener-d883bf22d50697f3557f80c625c49171-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/quota/d883bf22d50697f3557f80c625c49171/q 2024-01-08 10:55:37,065 INFO [StoreOpener-d883bf22d50697f3557f80c625c49171-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d883bf22d50697f3557f80c625c49171 columnFamilyName q 2024-01-08 10:55:37,066 INFO [StoreOpener-d883bf22d50697f3557f80c625c49171-1] regionserver.HStore(310): Store=d883bf22d50697f3557f80c625c49171/q, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-08 10:55:37,066 INFO [StoreOpener-d883bf22d50697f3557f80c625c49171-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family u of region d883bf22d50697f3557f80c625c49171 2024-01-08 10:55:37,068 DEBUG [StoreOpener-d883bf22d50697f3557f80c625c49171-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/quota/d883bf22d50697f3557f80c625c49171/u 2024-01-08 10:55:37,068 DEBUG [StoreOpener-d883bf22d50697f3557f80c625c49171-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/quota/d883bf22d50697f3557f80c625c49171/u 2024-01-08 10:55:37,068 INFO [StoreOpener-d883bf22d50697f3557f80c625c49171-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region d883bf22d50697f3557f80c625c49171 columnFamilyName u 2024-01-08 10:55:37,069 INFO [StoreOpener-d883bf22d50697f3557f80c625c49171-1] regionserver.HStore(310): Store=d883bf22d50697f3557f80c625c49171/u, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-08 10:55:37,071 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/quota/d883bf22d50697f3557f80c625c49171 2024-01-08 10:55:37,072 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/quota/d883bf22d50697f3557f80c625c49171 2024-01-08 10:55:37,075 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:quota descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2024-01-08 10:55:37,077 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for d883bf22d50697f3557f80c625c49171 2024-01-08 10:55:37,081 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/quota/d883bf22d50697f3557f80c625c49171/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-08 10:55:37,081 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened d883bf22d50697f3557f80c625c49171; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72929337, jitterRate=0.08673180639743805}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2024-01-08 10:55:37,081 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for d883bf22d50697f3557f80c625c49171: 2024-01-08 10:55:37,083 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for hbase:quota,,1704711336658.d883bf22d50697f3557f80c625c49171., pid=11, masterSystemTime=1704711337053 2024-01-08 10:55:37,086 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for hbase:quota,,1704711336658.d883bf22d50697f3557f80c625c49171. 2024-01-08 10:55:37,086 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:quota,,1704711336658.d883bf22d50697f3557f80c625c49171. 2024-01-08 10:55:37,087 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=d883bf22d50697f3557f80c625c49171, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:55:37,087 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:quota,,1704711336658.d883bf22d50697f3557f80c625c49171.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1704711337086"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1704711337086"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1704711337086"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1704711337086"}]},"ts":"1704711337086"} 2024-01-08 10:55:37,093 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=11, resume processing ppid=10 2024-01-08 10:55:37,093 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure d883bf22d50697f3557f80c625c49171, server=jenkins-hbase4.apache.org,39335,1704711332778 in 190 msec 2024-01-08 10:55:37,097 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=10, resume processing ppid=9 2024-01-08 10:55:37,097 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:quota, region=d883bf22d50697f3557f80c625c49171, ASSIGN in 353 msec 2024-01-08 10:55:37,098 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-08 10:55:37,098 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704711337098"}]},"ts":"1704711337098"} 2024-01-08 10:55:37,100 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLED in hbase:meta 2024-01-08 10:55:37,104 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_POST_OPERATION 2024-01-08 10:55:37,107 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:quota in 446 msec 2024-01-08 10:55:37,129 DEBUG [Listener at localhost/34349] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-01-08 10:55:37,132 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34682, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2024-01-08 10:55:37,160 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44665] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-08 10:55:37,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44665] procedure2.ProcedureExecutor(1075): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin0 2024-01-08 10:55:37,165 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_PRE_OPERATION 2024-01-08 10:55:37,167 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-08 10:55:37,170 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44665] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin0" procId is: 12 2024-01-08 10:55:37,170 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/default/TestQuotaAdmin0/cdd2e33bb4d429ba6f039699d97e40cd 2024-01-08 10:55:37,171 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/default/TestQuotaAdmin0/cdd2e33bb4d429ba6f039699d97e40cd empty. 2024-01-08 10:55:37,172 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/default/TestQuotaAdmin0/cdd2e33bb4d429ba6f039699d97e40cd 2024-01-08 10:55:37,172 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-01-08 10:55:37,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-01-08 10:55:37,192 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/default/TestQuotaAdmin0/.tabledesc/.tableinfo.0000000001 2024-01-08 10:55:37,194 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(7675): creating {ENCODED => cdd2e33bb4d429ba6f039699d97e40cd, NAME => 'TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp 2024-01-08 10:55:37,211 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-08 10:55:37,211 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1604): Closing cdd2e33bb4d429ba6f039699d97e40cd, disabling compactions & flushes 2024-01-08 10:55:37,211 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd. 2024-01-08 10:55:37,211 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd. 2024-01-08 10:55:37,211 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd. after waiting 0 ms 2024-01-08 10:55:37,211 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd. 2024-01-08 10:55:37,211 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd. 2024-01-08 10:55:37,211 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1558): Region close journal for cdd2e33bb4d429ba6f039699d97e40cd: 2024-01-08 10:55:37,215 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ADD_TO_META 2024-01-08 10:55:37,217 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704711337217"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1704711337217"}]},"ts":"1704711337217"} 2024-01-08 10:55:37,220 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-08 10:55:37,222 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-08 10:55:37,222 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704711337222"}]},"ts":"1704711337222"} 2024-01-08 10:55:37,224 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLING in hbase:meta 2024-01-08 10:55:37,230 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-08 10:55:37,232 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-08 10:55:37,232 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-08 10:55:37,232 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-08 10:55:37,232 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=cdd2e33bb4d429ba6f039699d97e40cd, ASSIGN}] 2024-01-08 10:55:37,234 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=cdd2e33bb4d429ba6f039699d97e40cd, ASSIGN 2024-01-08 10:55:37,235 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin0, region=cdd2e33bb4d429ba6f039699d97e40cd, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39335,1704711332778; forceNewPlan=false, retain=false 2024-01-08 10:55:37,386 INFO [jenkins-hbase4:44665] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-08 10:55:37,387 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=cdd2e33bb4d429ba6f039699d97e40cd, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:55:37,387 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704711337387"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1704711337387"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1704711337387"}]},"ts":"1704711337387"} 2024-01-08 10:55:37,390 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; OpenRegionProcedure cdd2e33bb4d429ba6f039699d97e40cd, server=jenkins-hbase4.apache.org,39335,1704711332778}] 2024-01-08 10:55:37,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-01-08 10:55:37,543 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:55:37,549 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd. 2024-01-08 10:55:37,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cdd2e33bb4d429ba6f039699d97e40cd, NAME => 'TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd.', STARTKEY => '', ENDKEY => ''} 2024-01-08 10:55:37,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin0 cdd2e33bb4d429ba6f039699d97e40cd 2024-01-08 10:55:37,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-08 10:55:37,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cdd2e33bb4d429ba6f039699d97e40cd 2024-01-08 10:55:37,550 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cdd2e33bb4d429ba6f039699d97e40cd 2024-01-08 10:55:37,552 INFO [StoreOpener-cdd2e33bb4d429ba6f039699d97e40cd-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region cdd2e33bb4d429ba6f039699d97e40cd 2024-01-08 10:55:37,554 DEBUG [StoreOpener-cdd2e33bb4d429ba6f039699d97e40cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/default/TestQuotaAdmin0/cdd2e33bb4d429ba6f039699d97e40cd/cf 2024-01-08 10:55:37,554 DEBUG [StoreOpener-cdd2e33bb4d429ba6f039699d97e40cd-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/default/TestQuotaAdmin0/cdd2e33bb4d429ba6f039699d97e40cd/cf 2024-01-08 10:55:37,555 INFO [StoreOpener-cdd2e33bb4d429ba6f039699d97e40cd-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cdd2e33bb4d429ba6f039699d97e40cd columnFamilyName cf 2024-01-08 10:55:37,556 INFO [StoreOpener-cdd2e33bb4d429ba6f039699d97e40cd-1] regionserver.HStore(310): Store=cdd2e33bb4d429ba6f039699d97e40cd/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-08 10:55:37,558 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/default/TestQuotaAdmin0/cdd2e33bb4d429ba6f039699d97e40cd 2024-01-08 10:55:37,559 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/default/TestQuotaAdmin0/cdd2e33bb4d429ba6f039699d97e40cd 2024-01-08 10:55:37,564 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cdd2e33bb4d429ba6f039699d97e40cd 2024-01-08 10:55:37,567 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/default/TestQuotaAdmin0/cdd2e33bb4d429ba6f039699d97e40cd/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-08 10:55:37,568 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cdd2e33bb4d429ba6f039699d97e40cd; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69339482, jitterRate=0.03323879837989807}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-08 10:55:37,568 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cdd2e33bb4d429ba6f039699d97e40cd: 2024-01-08 10:55:37,569 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd., pid=14, masterSystemTime=1704711337543 2024-01-08 10:55:37,572 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd. 2024-01-08 10:55:37,572 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd. 2024-01-08 10:55:37,573 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=cdd2e33bb4d429ba6f039699d97e40cd, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:55:37,573 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704711337573"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1704711337573"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1704711337573"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1704711337573"}]},"ts":"1704711337573"} 2024-01-08 10:55:37,579 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=14, resume processing ppid=13 2024-01-08 10:55:37,581 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=14, ppid=13, state=SUCCESS; OpenRegionProcedure cdd2e33bb4d429ba6f039699d97e40cd, server=jenkins-hbase4.apache.org,39335,1704711332778 in 186 msec 2024-01-08 10:55:37,583 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=13, resume processing ppid=12 2024-01-08 10:55:37,584 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=cdd2e33bb4d429ba6f039699d97e40cd, ASSIGN in 347 msec 2024-01-08 10:55:37,585 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-08 10:55:37,585 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704711337585"}]},"ts":"1704711337585"} 2024-01-08 10:55:37,587 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLED in hbase:meta 2024-01-08 10:55:37,591 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_POST_OPERATION 2024-01-08 10:55:37,594 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=12, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin0 in 430 msec 2024-01-08 10:55:37,936 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-01-08 10:55:37,937 INFO [Listener at localhost/34349] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin0, procId: 12 completed 2024-01-08 10:55:37,937 DEBUG [Listener at localhost/34349] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin0 get assigned. Timeout = 60000ms 2024-01-08 10:55:37,937 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:55:37,942 INFO [Listener at localhost/34349] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin0 assigned to meta. Checking AM states. 2024-01-08 10:55:37,942 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:55:37,942 INFO [Listener at localhost/34349] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin0 assigned. 2024-01-08 10:55:37,942 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:55:37,957 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-01-08 10:55:37,960 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34694, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService 2024-01-08 10:55:37,961 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44665] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-08 10:55:37,962 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44665] procedure2.ProcedureExecutor(1075): Stored pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin1 2024-01-08 10:55:37,965 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_PRE_OPERATION 2024-01-08 10:55:37,967 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44665] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin1" procId is: 15 2024-01-08 10:55:37,968 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-08 10:55:37,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-01-08 10:55:37,972 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/default/TestQuotaAdmin1/7f49985cd1e2794cdbe1fb824e142d2b 2024-01-08 10:55:37,973 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/default/TestQuotaAdmin1/7f49985cd1e2794cdbe1fb824e142d2b empty. 2024-01-08 10:55:37,974 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/default/TestQuotaAdmin1/7f49985cd1e2794cdbe1fb824e142d2b 2024-01-08 10:55:37,974 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-01-08 10:55:37,996 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/default/TestQuotaAdmin1/.tabledesc/.tableinfo.0000000001 2024-01-08 10:55:37,998 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7f49985cd1e2794cdbe1fb824e142d2b, NAME => 'TestQuotaAdmin1,,1704711337960.7f49985cd1e2794cdbe1fb824e142d2b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp 2024-01-08 10:55:38,015 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1704711337960.7f49985cd1e2794cdbe1fb824e142d2b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-08 10:55:38,015 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1604): Closing 7f49985cd1e2794cdbe1fb824e142d2b, disabling compactions & flushes 2024-01-08 10:55:38,015 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1704711337960.7f49985cd1e2794cdbe1fb824e142d2b. 2024-01-08 10:55:38,015 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1704711337960.7f49985cd1e2794cdbe1fb824e142d2b. 2024-01-08 10:55:38,015 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1704711337960.7f49985cd1e2794cdbe1fb824e142d2b. after waiting 0 ms 2024-01-08 10:55:38,015 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1704711337960.7f49985cd1e2794cdbe1fb824e142d2b. 2024-01-08 10:55:38,015 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1704711337960.7f49985cd1e2794cdbe1fb824e142d2b. 2024-01-08 10:55:38,015 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1558): Region close journal for 7f49985cd1e2794cdbe1fb824e142d2b: 2024-01-08 10:55:38,020 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ADD_TO_META 2024-01-08 10:55:38,022 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1704711337960.7f49985cd1e2794cdbe1fb824e142d2b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704711338022"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1704711338022"}]},"ts":"1704711338022"} 2024-01-08 10:55:38,025 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-08 10:55:38,026 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-08 10:55:38,026 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704711338026"}]},"ts":"1704711338026"} 2024-01-08 10:55:38,028 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLING in hbase:meta 2024-01-08 10:55:38,034 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-08 10:55:38,035 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-08 10:55:38,035 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-08 10:55:38,035 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-08 10:55:38,036 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=7f49985cd1e2794cdbe1fb824e142d2b, ASSIGN}] 2024-01-08 10:55:38,037 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=7f49985cd1e2794cdbe1fb824e142d2b, ASSIGN 2024-01-08 10:55:38,039 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin1, region=7f49985cd1e2794cdbe1fb824e142d2b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39335,1704711332778; forceNewPlan=false, retain=false 2024-01-08 10:55:38,189 INFO [jenkins-hbase4:44665] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-08 10:55:38,190 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=7f49985cd1e2794cdbe1fb824e142d2b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:55:38,190 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1704711337960.7f49985cd1e2794cdbe1fb824e142d2b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704711338190"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1704711338190"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1704711338190"}]},"ts":"1704711338190"} 2024-01-08 10:55:38,193 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure 7f49985cd1e2794cdbe1fb824e142d2b, server=jenkins-hbase4.apache.org,39335,1704711332778}] 2024-01-08 10:55:38,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-01-08 10:55:38,346 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:55:38,351 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin1,,1704711337960.7f49985cd1e2794cdbe1fb824e142d2b. 2024-01-08 10:55:38,351 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7f49985cd1e2794cdbe1fb824e142d2b, NAME => 'TestQuotaAdmin1,,1704711337960.7f49985cd1e2794cdbe1fb824e142d2b.', STARTKEY => '', ENDKEY => ''} 2024-01-08 10:55:38,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin1 7f49985cd1e2794cdbe1fb824e142d2b 2024-01-08 10:55:38,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1704711337960.7f49985cd1e2794cdbe1fb824e142d2b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-08 10:55:38,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7f49985cd1e2794cdbe1fb824e142d2b 2024-01-08 10:55:38,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7f49985cd1e2794cdbe1fb824e142d2b 2024-01-08 10:55:38,354 INFO [StoreOpener-7f49985cd1e2794cdbe1fb824e142d2b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7f49985cd1e2794cdbe1fb824e142d2b 2024-01-08 10:55:38,356 DEBUG [StoreOpener-7f49985cd1e2794cdbe1fb824e142d2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/default/TestQuotaAdmin1/7f49985cd1e2794cdbe1fb824e142d2b/cf 2024-01-08 10:55:38,356 DEBUG [StoreOpener-7f49985cd1e2794cdbe1fb824e142d2b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/default/TestQuotaAdmin1/7f49985cd1e2794cdbe1fb824e142d2b/cf 2024-01-08 10:55:38,357 INFO [StoreOpener-7f49985cd1e2794cdbe1fb824e142d2b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7f49985cd1e2794cdbe1fb824e142d2b columnFamilyName cf 2024-01-08 10:55:38,358 INFO [StoreOpener-7f49985cd1e2794cdbe1fb824e142d2b-1] regionserver.HStore(310): Store=7f49985cd1e2794cdbe1fb824e142d2b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-08 10:55:38,359 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/default/TestQuotaAdmin1/7f49985cd1e2794cdbe1fb824e142d2b 2024-01-08 10:55:38,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/default/TestQuotaAdmin1/7f49985cd1e2794cdbe1fb824e142d2b 2024-01-08 10:55:38,366 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7f49985cd1e2794cdbe1fb824e142d2b 2024-01-08 10:55:38,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/default/TestQuotaAdmin1/7f49985cd1e2794cdbe1fb824e142d2b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-08 10:55:38,372 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7f49985cd1e2794cdbe1fb824e142d2b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64181407, jitterRate=-0.04362250864505768}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-08 10:55:38,372 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7f49985cd1e2794cdbe1fb824e142d2b: 2024-01-08 10:55:38,374 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestQuotaAdmin1,,1704711337960.7f49985cd1e2794cdbe1fb824e142d2b., pid=17, masterSystemTime=1704711338346 2024-01-08 10:55:38,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestQuotaAdmin1,,1704711337960.7f49985cd1e2794cdbe1fb824e142d2b. 2024-01-08 10:55:38,377 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin1,,1704711337960.7f49985cd1e2794cdbe1fb824e142d2b. 2024-01-08 10:55:38,378 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=7f49985cd1e2794cdbe1fb824e142d2b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:55:38,378 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin1,,1704711337960.7f49985cd1e2794cdbe1fb824e142d2b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704711338378"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1704711338378"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1704711338378"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1704711338378"}]},"ts":"1704711338378"} 2024-01-08 10:55:38,383 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=17, resume processing ppid=16 2024-01-08 10:55:38,384 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure 7f49985cd1e2794cdbe1fb824e142d2b, server=jenkins-hbase4.apache.org,39335,1704711332778 in 187 msec 2024-01-08 10:55:38,386 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=16, resume processing ppid=15 2024-01-08 10:55:38,387 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=7f49985cd1e2794cdbe1fb824e142d2b, ASSIGN in 347 msec 2024-01-08 10:55:38,388 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-08 10:55:38,388 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704711338388"}]},"ts":"1704711338388"} 2024-01-08 10:55:38,390 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLED in hbase:meta 2024-01-08 10:55:38,393 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_POST_OPERATION 2024-01-08 10:55:38,396 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=15, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin1 in 433 msec 2024-01-08 10:55:38,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-01-08 10:55:38,723 INFO [Listener at localhost/34349] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin1, procId: 15 completed 2024-01-08 10:55:38,724 DEBUG [Listener at localhost/34349] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin1 get assigned. Timeout = 60000ms 2024-01-08 10:55:38,724 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:55:38,728 INFO [Listener at localhost/34349] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin1 assigned to meta. Checking AM states. 2024-01-08 10:55:38,728 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:55:38,728 INFO [Listener at localhost/34349] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin1 assigned. 2024-01-08 10:55:38,728 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:55:38,741 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-08 10:55:38,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] procedure2.ProcedureExecutor(1075): Stored pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin2 2024-01-08 10:55:38,746 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_PRE_OPERATION 2024-01-08 10:55:38,746 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin2" procId is: 18 2024-01-08 10:55:38,747 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-08 10:55:38,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-01-08 10:55:38,750 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/default/TestQuotaAdmin2/b0182e56a4c63ba331108c28fab73610 2024-01-08 10:55:38,751 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/default/TestQuotaAdmin2/b0182e56a4c63ba331108c28fab73610 empty. 2024-01-08 10:55:38,751 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/default/TestQuotaAdmin2/b0182e56a4c63ba331108c28fab73610 2024-01-08 10:55:38,752 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-01-08 10:55:38,774 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/default/TestQuotaAdmin2/.tabledesc/.tableinfo.0000000001 2024-01-08 10:55:38,776 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(7675): creating {ENCODED => b0182e56a4c63ba331108c28fab73610, NAME => 'TestQuotaAdmin2,,1704711338741.b0182e56a4c63ba331108c28fab73610.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp 2024-01-08 10:55:38,792 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1704711338741.b0182e56a4c63ba331108c28fab73610.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-08 10:55:38,793 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1604): Closing b0182e56a4c63ba331108c28fab73610, disabling compactions & flushes 2024-01-08 10:55:38,793 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1704711338741.b0182e56a4c63ba331108c28fab73610. 2024-01-08 10:55:38,793 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1704711338741.b0182e56a4c63ba331108c28fab73610. 2024-01-08 10:55:38,793 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1704711338741.b0182e56a4c63ba331108c28fab73610. after waiting 0 ms 2024-01-08 10:55:38,793 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1704711338741.b0182e56a4c63ba331108c28fab73610. 2024-01-08 10:55:38,793 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1704711338741.b0182e56a4c63ba331108c28fab73610. 2024-01-08 10:55:38,793 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1558): Region close journal for b0182e56a4c63ba331108c28fab73610: 2024-01-08 10:55:38,797 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ADD_TO_META 2024-01-08 10:55:38,799 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1704711338741.b0182e56a4c63ba331108c28fab73610.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704711338799"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1704711338799"}]},"ts":"1704711338799"} 2024-01-08 10:55:38,802 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-01-08 10:55:38,803 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-08 10:55:38,804 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704711338803"}]},"ts":"1704711338803"} 2024-01-08 10:55:38,806 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLING in hbase:meta 2024-01-08 10:55:38,812 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-08 10:55:38,813 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-08 10:55:38,813 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-08 10:55:38,813 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-08 10:55:38,813 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=b0182e56a4c63ba331108c28fab73610, ASSIGN}] 2024-01-08 10:55:38,815 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=b0182e56a4c63ba331108c28fab73610, ASSIGN 2024-01-08 10:55:38,816 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin2, region=b0182e56a4c63ba331108c28fab73610, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38189,1704711332823; forceNewPlan=false, retain=false 2024-01-08 10:55:38,966 INFO [jenkins-hbase4:44665] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-01-08 10:55:38,967 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=b0182e56a4c63ba331108c28fab73610, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38189,1704711332823 2024-01-08 10:55:38,967 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1704711338741.b0182e56a4c63ba331108c28fab73610.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704711338967"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1704711338967"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1704711338967"}]},"ts":"1704711338967"} 2024-01-08 10:55:38,970 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE; OpenRegionProcedure b0182e56a4c63ba331108c28fab73610, server=jenkins-hbase4.apache.org,38189,1704711332823}] 2024-01-08 10:55:38,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-01-08 10:55:39,124 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38189,1704711332823 2024-01-08 10:55:39,124 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-01-08 10:55:39,127 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43700, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-01-08 10:55:39,132 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin2,,1704711338741.b0182e56a4c63ba331108c28fab73610. 2024-01-08 10:55:39,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b0182e56a4c63ba331108c28fab73610, NAME => 'TestQuotaAdmin2,,1704711338741.b0182e56a4c63ba331108c28fab73610.', STARTKEY => '', ENDKEY => ''} 2024-01-08 10:55:39,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin2 b0182e56a4c63ba331108c28fab73610 2024-01-08 10:55:39,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1704711338741.b0182e56a4c63ba331108c28fab73610.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-08 10:55:39,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b0182e56a4c63ba331108c28fab73610 2024-01-08 10:55:39,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b0182e56a4c63ba331108c28fab73610 2024-01-08 10:55:39,135 INFO [StoreOpener-b0182e56a4c63ba331108c28fab73610-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b0182e56a4c63ba331108c28fab73610 2024-01-08 10:55:39,137 DEBUG [StoreOpener-b0182e56a4c63ba331108c28fab73610-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/default/TestQuotaAdmin2/b0182e56a4c63ba331108c28fab73610/cf 2024-01-08 10:55:39,137 DEBUG [StoreOpener-b0182e56a4c63ba331108c28fab73610-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/default/TestQuotaAdmin2/b0182e56a4c63ba331108c28fab73610/cf 2024-01-08 10:55:39,138 INFO [StoreOpener-b0182e56a4c63ba331108c28fab73610-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b0182e56a4c63ba331108c28fab73610 columnFamilyName cf 2024-01-08 10:55:39,139 INFO [StoreOpener-b0182e56a4c63ba331108c28fab73610-1] regionserver.HStore(310): Store=b0182e56a4c63ba331108c28fab73610/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-08 10:55:39,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/default/TestQuotaAdmin2/b0182e56a4c63ba331108c28fab73610 2024-01-08 10:55:39,142 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/default/TestQuotaAdmin2/b0182e56a4c63ba331108c28fab73610 2024-01-08 10:55:39,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b0182e56a4c63ba331108c28fab73610 2024-01-08 10:55:39,151 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/default/TestQuotaAdmin2/b0182e56a4c63ba331108c28fab73610/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-08 10:55:39,152 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b0182e56a4c63ba331108c28fab73610; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58856596, jitterRate=-0.12296837568283081}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-08 10:55:39,152 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b0182e56a4c63ba331108c28fab73610: 2024-01-08 10:55:39,153 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestQuotaAdmin2,,1704711338741.b0182e56a4c63ba331108c28fab73610., pid=20, masterSystemTime=1704711339123 2024-01-08 10:55:39,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestQuotaAdmin2,,1704711338741.b0182e56a4c63ba331108c28fab73610. 2024-01-08 10:55:39,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin2,,1704711338741.b0182e56a4c63ba331108c28fab73610. 2024-01-08 10:55:39,158 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=b0182e56a4c63ba331108c28fab73610, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38189,1704711332823 2024-01-08 10:55:39,159 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin2,,1704711338741.b0182e56a4c63ba331108c28fab73610.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704711339158"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1704711339158"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1704711339158"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1704711339158"}]},"ts":"1704711339158"} 2024-01-08 10:55:39,163 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=20, resume processing ppid=19 2024-01-08 10:55:39,164 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=20, ppid=19, state=SUCCESS; OpenRegionProcedure b0182e56a4c63ba331108c28fab73610, server=jenkins-hbase4.apache.org,38189,1704711332823 in 191 msec 2024-01-08 10:55:39,166 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=19, resume processing ppid=18 2024-01-08 10:55:39,167 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=19, ppid=18, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=b0182e56a4c63ba331108c28fab73610, ASSIGN in 351 msec 2024-01-08 10:55:39,168 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-08 10:55:39,168 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704711339168"}]},"ts":"1704711339168"} 2024-01-08 10:55:39,170 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLED in hbase:meta 2024-01-08 10:55:39,174 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_POST_OPERATION 2024-01-08 10:55:39,176 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=18, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin2 in 433 msec 2024-01-08 10:55:39,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-01-08 10:55:39,502 INFO [Listener at localhost/34349] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin2, procId: 18 completed 2024-01-08 10:55:39,502 DEBUG [Listener at localhost/34349] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin2 get assigned. Timeout = 60000ms 2024-01-08 10:55:39,502 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:55:39,506 INFO [Listener at localhost/34349] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin2 assigned to meta. Checking AM states. 2024-01-08 10:55:39,506 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:55:39,506 INFO [Listener at localhost/34349] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin2 assigned. 2024-01-08 10:55:39,507 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:55:39,514 DEBUG [hconnection-0x6c2b5037-shared-pool-3] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-01-08 10:55:39,517 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43704, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-01-08 10:55:39,519 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-01-08 10:55:39,522 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34710, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=MasterService 2024-01-08 10:55:39,526 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.HMaster$15(3020): Client=jenkins//172.31.14.131 creating {NAME => 'TestNs'} 2024-01-08 10:55:39,527 DEBUG [hconnection-0x29026089-metaLookup-shared--pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-01-08 10:55:39,529 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34736, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2024-01-08 10:55:39,529 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] procedure2.ProcedureExecutor(1075): Stored pid=21, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=TestNs 2024-01-08 10:55:39,537 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-01-08 10:55:39,544 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-01-08 10:55:39,550 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=21, state=SUCCESS; CreateNamespaceProcedure, namespace=TestNs in 21 msec 2024-01-08 10:55:39,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-01-08 10:55:39,792 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-01-08 10:55:39,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] procedure2.ProcedureExecutor(1075): Stored pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestNs:TestTable 2024-01-08 10:55:39,796 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_PRE_OPERATION 2024-01-08 10:55:39,796 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "TestNs" qualifier: "TestTable" procId is: 22 2024-01-08 10:55:39,797 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-01-08 10:55:39,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-01-08 10:55:39,800 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/TestNs/TestTable/bbb7a9e9169d0180b7cf43896edf60e5 2024-01-08 10:55:39,800 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/TestNs/TestTable/97a0c6e40de5e390efe7fed552a1fe40 2024-01-08 10:55:39,801 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/TestNs/TestTable/bbb7a9e9169d0180b7cf43896edf60e5 empty. 2024-01-08 10:55:39,801 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/TestNs/TestTable/97a0c6e40de5e390efe7fed552a1fe40 empty. 2024-01-08 10:55:39,802 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/TestNs/TestTable/bbb7a9e9169d0180b7cf43896edf60e5 2024-01-08 10:55:39,802 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/TestNs/TestTable/97a0c6e40de5e390efe7fed552a1fe40 2024-01-08 10:55:39,802 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-01-08 10:55:39,820 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/TestNs/TestTable/.tabledesc/.tableinfo.0000000001 2024-01-08 10:55:39,822 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(7675): creating {ENCODED => bbb7a9e9169d0180b7cf43896edf60e5, NAME => 'TestNs:TestTable,,1704711339792.bbb7a9e9169d0180b7cf43896edf60e5.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp 2024-01-08 10:55:39,822 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(7675): creating {ENCODED => 97a0c6e40de5e390efe7fed552a1fe40, NAME => 'TestNs:TestTable,1,1704711339792.97a0c6e40de5e390efe7fed552a1fe40.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp 2024-01-08 10:55:39,843 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1704711339792.bbb7a9e9169d0180b7cf43896edf60e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-08 10:55:39,843 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1604): Closing bbb7a9e9169d0180b7cf43896edf60e5, disabling compactions & flushes 2024-01-08 10:55:39,843 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1704711339792.bbb7a9e9169d0180b7cf43896edf60e5. 2024-01-08 10:55:39,844 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1704711339792.bbb7a9e9169d0180b7cf43896edf60e5. 2024-01-08 10:55:39,844 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1704711339792.bbb7a9e9169d0180b7cf43896edf60e5. after waiting 0 ms 2024-01-08 10:55:39,844 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1704711339792.bbb7a9e9169d0180b7cf43896edf60e5. 2024-01-08 10:55:39,844 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1704711339792.bbb7a9e9169d0180b7cf43896edf60e5. 2024-01-08 10:55:39,844 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1558): Region close journal for bbb7a9e9169d0180b7cf43896edf60e5: 2024-01-08 10:55:39,844 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1704711339792.97a0c6e40de5e390efe7fed552a1fe40.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-08 10:55:39,844 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1604): Closing 97a0c6e40de5e390efe7fed552a1fe40, disabling compactions & flushes 2024-01-08 10:55:39,845 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1704711339792.97a0c6e40de5e390efe7fed552a1fe40. 2024-01-08 10:55:39,845 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1704711339792.97a0c6e40de5e390efe7fed552a1fe40. 2024-01-08 10:55:39,845 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1704711339792.97a0c6e40de5e390efe7fed552a1fe40. after waiting 0 ms 2024-01-08 10:55:39,845 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1704711339792.97a0c6e40de5e390efe7fed552a1fe40. 2024-01-08 10:55:39,845 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1704711339792.97a0c6e40de5e390efe7fed552a1fe40. 2024-01-08 10:55:39,845 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1558): Region close journal for 97a0c6e40de5e390efe7fed552a1fe40: 2024-01-08 10:55:39,849 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ADD_TO_META 2024-01-08 10:55:39,850 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,,1704711339792.bbb7a9e9169d0180b7cf43896edf60e5.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1704711339850"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1704711339850"}]},"ts":"1704711339850"} 2024-01-08 10:55:39,851 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1704711339792.97a0c6e40de5e390efe7fed552a1fe40.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1704711339850"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1704711339850"}]},"ts":"1704711339850"} 2024-01-08 10:55:39,858 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2024-01-08 10:55:39,859 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-01-08 10:55:39,859 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704711339859"}]},"ts":"1704711339859"} 2024-01-08 10:55:39,862 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLING in hbase:meta 2024-01-08 10:55:39,866 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-01-08 10:55:39,868 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-01-08 10:55:39,869 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-01-08 10:55:39,869 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-01-08 10:55:39,869 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=bbb7a9e9169d0180b7cf43896edf60e5, ASSIGN}, {pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=97a0c6e40de5e390efe7fed552a1fe40, ASSIGN}] 2024-01-08 10:55:39,871 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=97a0c6e40de5e390efe7fed552a1fe40, ASSIGN 2024-01-08 10:55:39,871 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=bbb7a9e9169d0180b7cf43896edf60e5, ASSIGN 2024-01-08 10:55:39,873 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=bbb7a9e9169d0180b7cf43896edf60e5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39335,1704711332778; forceNewPlan=false, retain=false 2024-01-08 10:55:39,873 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=97a0c6e40de5e390efe7fed552a1fe40, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,38189,1704711332823; forceNewPlan=false, retain=false 2024-01-08 10:55:40,023 INFO [jenkins-hbase4:44665] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2024-01-08 10:55:40,024 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=bbb7a9e9169d0180b7cf43896edf60e5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:55:40,024 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=97a0c6e40de5e390efe7fed552a1fe40, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,38189,1704711332823 2024-01-08 10:55:40,024 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1704711339792.bbb7a9e9169d0180b7cf43896edf60e5.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1704711340024"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1704711340024"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1704711340024"}]},"ts":"1704711340024"} 2024-01-08 10:55:40,024 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1704711339792.97a0c6e40de5e390efe7fed552a1fe40.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1704711340024"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1704711340024"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1704711340024"}]},"ts":"1704711340024"} 2024-01-08 10:55:40,027 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; OpenRegionProcedure bbb7a9e9169d0180b7cf43896edf60e5, server=jenkins-hbase4.apache.org,39335,1704711332778}] 2024-01-08 10:55:40,028 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=26, ppid=24, state=RUNNABLE; OpenRegionProcedure 97a0c6e40de5e390efe7fed552a1fe40, server=jenkins-hbase4.apache.org,38189,1704711332823}] 2024-01-08 10:55:40,049 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-01-08 10:55:40,180 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:55:40,181 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38189,1704711332823 2024-01-08 10:55:40,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,,1704711339792.bbb7a9e9169d0180b7cf43896edf60e5. 2024-01-08 10:55:40,187 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,1,1704711339792.97a0c6e40de5e390efe7fed552a1fe40. 2024-01-08 10:55:40,187 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bbb7a9e9169d0180b7cf43896edf60e5, NAME => 'TestNs:TestTable,,1704711339792.bbb7a9e9169d0180b7cf43896edf60e5.', STARTKEY => '', ENDKEY => '1'} 2024-01-08 10:55:40,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 97a0c6e40de5e390efe7fed552a1fe40, NAME => 'TestNs:TestTable,1,1704711339792.97a0c6e40de5e390efe7fed552a1fe40.', STARTKEY => '1', ENDKEY => ''} 2024-01-08 10:55:40,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable bbb7a9e9169d0180b7cf43896edf60e5 2024-01-08 10:55:40,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1704711339792.bbb7a9e9169d0180b7cf43896edf60e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-08 10:55:40,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable 97a0c6e40de5e390efe7fed552a1fe40 2024-01-08 10:55:40,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bbb7a9e9169d0180b7cf43896edf60e5 2024-01-08 10:55:40,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1704711339792.97a0c6e40de5e390efe7fed552a1fe40.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-01-08 10:55:40,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bbb7a9e9169d0180b7cf43896edf60e5 2024-01-08 10:55:40,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 97a0c6e40de5e390efe7fed552a1fe40 2024-01-08 10:55:40,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 97a0c6e40de5e390efe7fed552a1fe40 2024-01-08 10:55:40,191 INFO [StoreOpener-bbb7a9e9169d0180b7cf43896edf60e5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region bbb7a9e9169d0180b7cf43896edf60e5 2024-01-08 10:55:40,191 INFO [StoreOpener-97a0c6e40de5e390efe7fed552a1fe40-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 97a0c6e40de5e390efe7fed552a1fe40 2024-01-08 10:55:40,195 DEBUG [StoreOpener-bbb7a9e9169d0180b7cf43896edf60e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/TestNs/TestTable/bbb7a9e9169d0180b7cf43896edf60e5/cf 2024-01-08 10:55:40,195 DEBUG [StoreOpener-bbb7a9e9169d0180b7cf43896edf60e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/TestNs/TestTable/bbb7a9e9169d0180b7cf43896edf60e5/cf 2024-01-08 10:55:40,195 DEBUG [StoreOpener-97a0c6e40de5e390efe7fed552a1fe40-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/TestNs/TestTable/97a0c6e40de5e390efe7fed552a1fe40/cf 2024-01-08 10:55:40,195 DEBUG [StoreOpener-97a0c6e40de5e390efe7fed552a1fe40-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/TestNs/TestTable/97a0c6e40de5e390efe7fed552a1fe40/cf 2024-01-08 10:55:40,196 INFO [StoreOpener-97a0c6e40de5e390efe7fed552a1fe40-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 97a0c6e40de5e390efe7fed552a1fe40 columnFamilyName cf 2024-01-08 10:55:40,196 INFO [StoreOpener-bbb7a9e9169d0180b7cf43896edf60e5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bbb7a9e9169d0180b7cf43896edf60e5 columnFamilyName cf 2024-01-08 10:55:40,197 INFO [StoreOpener-bbb7a9e9169d0180b7cf43896edf60e5-1] regionserver.HStore(310): Store=bbb7a9e9169d0180b7cf43896edf60e5/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-08 10:55:40,197 INFO [StoreOpener-97a0c6e40de5e390efe7fed552a1fe40-1] regionserver.HStore(310): Store=97a0c6e40de5e390efe7fed552a1fe40/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-01-08 10:55:40,199 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/TestNs/TestTable/bbb7a9e9169d0180b7cf43896edf60e5 2024-01-08 10:55:40,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/TestNs/TestTable/97a0c6e40de5e390efe7fed552a1fe40 2024-01-08 10:55:40,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/TestNs/TestTable/bbb7a9e9169d0180b7cf43896edf60e5 2024-01-08 10:55:40,200 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/TestNs/TestTable/97a0c6e40de5e390efe7fed552a1fe40 2024-01-08 10:55:40,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bbb7a9e9169d0180b7cf43896edf60e5 2024-01-08 10:55:40,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 97a0c6e40de5e390efe7fed552a1fe40 2024-01-08 10:55:40,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/TestNs/TestTable/bbb7a9e9169d0180b7cf43896edf60e5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-08 10:55:40,211 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/TestNs/TestTable/97a0c6e40de5e390efe7fed552a1fe40/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-01-08 10:55:40,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bbb7a9e9169d0180b7cf43896edf60e5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60614997, jitterRate=-0.0967661589384079}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-08 10:55:40,211 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 97a0c6e40de5e390efe7fed552a1fe40; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62008905, jitterRate=-0.0759953111410141}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-01-08 10:55:40,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bbb7a9e9169d0180b7cf43896edf60e5: 2024-01-08 10:55:40,212 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 97a0c6e40de5e390efe7fed552a1fe40: 2024-01-08 10:55:40,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestNs:TestTable,1,1704711339792.97a0c6e40de5e390efe7fed552a1fe40., pid=26, masterSystemTime=1704711340181 2024-01-08 10:55:40,213 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for TestNs:TestTable,,1704711339792.bbb7a9e9169d0180b7cf43896edf60e5., pid=25, masterSystemTime=1704711340180 2024-01-08 10:55:40,215 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestNs:TestTable,,1704711339792.bbb7a9e9169d0180b7cf43896edf60e5. 2024-01-08 10:55:40,216 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,,1704711339792.bbb7a9e9169d0180b7cf43896edf60e5. 2024-01-08 10:55:40,216 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=bbb7a9e9169d0180b7cf43896edf60e5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:55:40,217 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,,1704711339792.bbb7a9e9169d0180b7cf43896edf60e5.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1704711340216"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1704711340216"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1704711340216"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1704711340216"}]},"ts":"1704711340216"} 2024-01-08 10:55:40,218 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for TestNs:TestTable,1,1704711339792.97a0c6e40de5e390efe7fed552a1fe40. 2024-01-08 10:55:40,218 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,1,1704711339792.97a0c6e40de5e390efe7fed552a1fe40. 2024-01-08 10:55:40,219 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=97a0c6e40de5e390efe7fed552a1fe40, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,38189,1704711332823 2024-01-08 10:55:40,220 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,1,1704711339792.97a0c6e40de5e390efe7fed552a1fe40.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1704711340219"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1704711340219"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1704711340219"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1704711340219"}]},"ts":"1704711340219"} 2024-01-08 10:55:40,224 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=25, resume processing ppid=23 2024-01-08 10:55:40,224 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=25, ppid=23, state=SUCCESS; OpenRegionProcedure bbb7a9e9169d0180b7cf43896edf60e5, server=jenkins-hbase4.apache.org,39335,1704711332778 in 193 msec 2024-01-08 10:55:40,226 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=26, resume processing ppid=24 2024-01-08 10:55:40,228 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=23, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=bbb7a9e9169d0180b7cf43896edf60e5, ASSIGN in 355 msec 2024-01-08 10:55:40,228 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=26, ppid=24, state=SUCCESS; OpenRegionProcedure 97a0c6e40de5e390efe7fed552a1fe40, server=jenkins-hbase4.apache.org,38189,1704711332823 in 194 msec 2024-01-08 10:55:40,229 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=24, resume processing ppid=22 2024-01-08 10:55:40,230 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=24, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=97a0c6e40de5e390efe7fed552a1fe40, ASSIGN in 358 msec 2024-01-08 10:55:40,230 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-01-08 10:55:40,231 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704711340230"}]},"ts":"1704711340230"} 2024-01-08 10:55:40,232 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLED in hbase:meta 2024-01-08 10:55:40,242 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_POST_OPERATION 2024-01-08 10:55:40,244 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=22, state=SUCCESS; CreateTableProcedure table=TestNs:TestTable in 450 msec 2024-01-08 10:55:40,551 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-01-08 10:55:40,552 INFO [Listener at localhost/34349] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: TestNs:TestTable, procId: 22 completed 2024-01-08 10:55:40,552 DEBUG [Listener at localhost/34349] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestNs:TestTable get assigned. Timeout = 60000ms 2024-01-08 10:55:40,552 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:55:40,557 INFO [Listener at localhost/34349] hbase.HBaseTestingUtility(3484): All regions for table TestNs:TestTable assigned to meta. Checking AM states. 2024-01-08 10:55:40,557 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:55:40,557 INFO [Listener at localhost/34349] hbase.HBaseTestingUtility(3504): All regions for table TestNs:TestTable assigned. 2024-01-08 10:55:40,557 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:55:40,581 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2024-01-08 10:55:40,605 INFO [Listener at localhost/34349] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=306, OpenFileDescriptor=632, MaxFileDescriptor=60000, SystemLoadAverage=1045, ProcessCount=173, AvailableMemoryMB=8492 2024-01-08 10:55:40,670 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestNs:TestTable' 2024-01-08 10:55:40,674 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin2' 2024-01-08 10:55:40,675 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin0' 2024-01-08 10:55:40,676 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2024-01-08 10:55:40,677 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2024-01-08 10:55:40,678 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:quota' 2024-01-08 10:55:40,678 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin1' 2024-01-08 10:55:40,915 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:55:40,915 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-08 10:55:40,916 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704714940663 bypass), TestNs=QuotaState(ts=1704714940663 bypass)} 2024-01-08 10:55:40,916 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1704714940663 bypass), TestNs:TestTable=QuotaState(ts=1704714940663 bypass), TestQuotaAdmin1=QuotaState(ts=1704714940663 bypass)} 2024-01-08 10:55:40,916 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1704714940663 [ TestNs:TestTable ])} 2024-01-08 10:55:40,916 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704714940663 bypass)} 2024-01-08 10:55:41,166 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:55:41,167 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-08 10:55:41,167 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704714940663 bypass), TestNs=QuotaState(ts=1704714940663 bypass)} 2024-01-08 10:55:41,167 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1704714940663 bypass), TestQuotaAdmin2=QuotaState(ts=1704714940663 bypass)} 2024-01-08 10:55:41,167 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1704714940663 [ TestNs:TestTable ])} 2024-01-08 10:55:41,167 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704714940663 bypass)} 2024-01-08 10:55:41,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:55:41,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] ipc.CallRunner(144): callId: 89 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:43704 deadline: 1704711351185, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:55:41,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:55:41,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] ipc.CallRunner(144): callId: 91 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:43704 deadline: 1704711351186, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:55:41,723 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-01-08 10:55:41,723 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver Metrics about HBase MasterObservers 2024-01-08 10:55:41,724 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-01-08 10:55:41,724 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2024-01-08 10:55:41,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:55:41,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] ipc.CallRunner(144): callId: 93 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:43704 deadline: 1704711351185, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:55:42,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:55:42,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] ipc.CallRunner(144): callId: 95 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:43704 deadline: 1704711351186, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:55:43,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:55:43,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] ipc.CallRunner(144): callId: 97 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:43704 deadline: 1704711351186, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:55:45,691 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2024-01-08 10:55:46,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:55:46,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] ipc.CallRunner(144): callId: 99 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:43704 deadline: 1704711351186, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:55:46,521 ERROR [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10359: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1704711339792.97a0c6e40de5e390efe7fed552a1fe40., hostname=jenkins-hbase4.apache.org,38189,1704711332823, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-08 10:55:46,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:55:46,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] ipc.CallRunner(144): callId: 100 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:43704 deadline: 1704711356524, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:55:46,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:55:46,779 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] ipc.CallRunner(144): callId: 102 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:43704 deadline: 1704711356524, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:55:47,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:55:47,287 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] ipc.CallRunner(144): callId: 104 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:43704 deadline: 1704711356523, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:55:48,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:55:48,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] ipc.CallRunner(144): callId: 106 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:43704 deadline: 1704711356524, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:55:49,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:55:49,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] ipc.CallRunner(144): callId: 108 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:43704 deadline: 1704711356523, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:55:51,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:55:51,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] ipc.CallRunner(144): callId: 110 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:43704 deadline: 1704711356524, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:55:51,825 ERROR [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10313: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1704711339792.97a0c6e40de5e390efe7fed552a1fe40., hostname=jenkins-hbase4.apache.org,38189,1704711332823, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-08 10:55:52,086 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:55:52,086 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-08 10:55:52,086 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704718540663 bypass), TestNs=QuotaState(ts=1704718540663 bypass)} 2024-01-08 10:55:52,086 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1704718540663 bypass), TestNs:TestTable=QuotaState(ts=1704718540663 bypass), TestQuotaAdmin1=QuotaState(ts=1704718540663 bypass)} 2024-01-08 10:55:52,086 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1704718540663 bypass)} 2024-01-08 10:55:52,086 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704718540663 bypass)} 2024-01-08 10:55:52,337 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:55:52,337 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-08 10:55:52,337 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704718540663 bypass), TestNs=QuotaState(ts=1704718540663 bypass)} 2024-01-08 10:55:52,337 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1704718540663 bypass), TestQuotaAdmin2=QuotaState(ts=1704718540663 bypass)} 2024-01-08 10:55:52,337 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1704718540663 bypass)} 2024-01-08 10:55:52,337 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704718540663 bypass)} 2024-01-08 10:55:52,351 INFO [Listener at localhost/34349] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=290 (was 306), OpenFileDescriptor=602 (was 632), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=840 (was 1045), ProcessCount=170 (was 173), AvailableMemoryMB=10363 (was 8492) - AvailableMemoryMB LEAK? - 2024-01-08 10:55:52,364 INFO [Listener at localhost/34349] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=290, OpenFileDescriptor=602, MaxFileDescriptor=60000, SystemLoadAverage=840, ProcessCount=170, AvailableMemoryMB=10363 2024-01-08 10:55:52,629 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:55:52,629 INFO [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-01-08 10:55:52,880 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-08 10:55:52,880 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704722140763 bypass), TestNs=QuotaState(ts=1704722140763 bypass)} 2024-01-08 10:55:52,881 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1704722140763 bypass), TestNs:TestTable=QuotaState(ts=1704722140763 bypass), TestQuotaAdmin1=QuotaState(ts=1704722140763 bypass)} 2024-01-08 10:55:52,881 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1704722140763 [ default ])} 2024-01-08 10:55:52,881 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704722140763 bypass)} 2024-01-08 10:55:53,132 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:55:53,132 INFO [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-01-08 10:55:53,382 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-08 10:55:53,383 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704722140863 bypass), TestNs=QuotaState(ts=1704722140863 bypass)} 2024-01-08 10:55:53,385 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1704722140863 bypass), TestQuotaAdmin2=QuotaState(ts=1704722140863 bypass)} 2024-01-08 10:55:53,385 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1704722140863 [ default ])} 2024-01-08 10:55:53,385 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704722140863 bypass)} 2024-01-08 10:55:53,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-08 10:55:53,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 122 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:34722 deadline: 1704711363394, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-08 10:55:53,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-08 10:55:53,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 124 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:34722 deadline: 1704711363394, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-08 10:55:54,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-08 10:55:54,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 126 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:34722 deadline: 1704711363394, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-08 10:55:54,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-08 10:55:54,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 128 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:34722 deadline: 1704711363395, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-08 10:55:56,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-08 10:55:56,169 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 130 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:34722 deadline: 1704711363395, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-08 10:55:58,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-01-08 10:55:58,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 132 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:34722 deadline: 1704711363395, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-01-08 10:55:58,689 ERROR [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10304: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd., hostname=jenkins-hbase4.apache.org,39335,1704711332778, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:199) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor35.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-08 10:55:58,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-08 10:55:58,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 139 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:34722 deadline: 1704711368744, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-08 10:55:58,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-08 10:55:58,999 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 141 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:34722 deadline: 1704711368744, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-08 10:55:59,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-08 10:55:59,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 143 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:34722 deadline: 1704711368743, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:00,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:00,269 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 145 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:34722 deadline: 1704711368743, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:01,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:01,524 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 147 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:34722 deadline: 1704711368744, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:04,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:04,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 149 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:34722 deadline: 1704711368744, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:04,047 ERROR [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10320: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd., hostname=jenkins-hbase4.apache.org,39335,1704711332778, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:200) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor35.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-08 10:56:04,305 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:56:04,306 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-08 10:56:04,306 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704725740863 bypass), TestNs=QuotaState(ts=1704725740863 bypass)} 2024-01-08 10:56:04,306 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1704725740863 bypass), TestNs:TestTable=QuotaState(ts=1704725740863 bypass), TestQuotaAdmin1=QuotaState(ts=1704725740863 bypass)} 2024-01-08 10:56:04,306 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1704725740863 bypass)} 2024-01-08 10:56:04,306 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704725740863 bypass)} 2024-01-08 10:56:04,556 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:56:04,556 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-08 10:56:04,556 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704725740863 bypass), TestNs=QuotaState(ts=1704725740863 bypass)} 2024-01-08 10:56:04,556 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1704725740863 bypass), TestQuotaAdmin2=QuotaState(ts=1704725740863 bypass)} 2024-01-08 10:56:04,556 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1704725740863 bypass)} 2024-01-08 10:56:04,557 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704725740863 bypass)} 2024-01-08 10:56:04,570 INFO [Listener at localhost/34349] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=291 (was 290) Potentially hanging thread: hconnection-0x62ae85a7-shared-pool-12 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x62ae85a7-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x29026089-shared-pool-11 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x29026089-shared-pool-10 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=597 (was 602), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=711 (was 840), ProcessCount=170 (was 170), AvailableMemoryMB=10339 (was 10363) 2024-01-08 10:56:04,582 INFO [Listener at localhost/34349] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=291, OpenFileDescriptor=597, MaxFileDescriptor=60000, SystemLoadAverage=711, ProcessCount=170, AvailableMemoryMB=10338 2024-01-08 10:56:04,845 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:56:04,846 INFO [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-01-08 10:56:05,096 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-08 10:56:05,097 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704729340963 bypass), TestNs=QuotaState(ts=1704729340963 bypass)} 2024-01-08 10:56:05,098 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1704729340963 bypass), TestNs:TestTable=QuotaState(ts=1704729340963 bypass), TestQuotaAdmin1=QuotaState(ts=1704729340963 bypass)} 2024-01-08 10:56:05,098 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1704729340963 global-limiter)} 2024-01-08 10:56:05,098 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704729340963 bypass)} 2024-01-08 10:56:05,348 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:56:05,349 INFO [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-01-08 10:56:05,599 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-08 10:56:05,600 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704729341063 bypass), TestNs=QuotaState(ts=1704729341063 bypass)} 2024-01-08 10:56:05,601 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1704729341063 bypass), TestQuotaAdmin2=QuotaState(ts=1704729341063 bypass)} 2024-01-08 10:56:05,601 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1704729341063 global-limiter)} 2024-01-08 10:56:05,601 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704729341063 bypass)} 2024-01-08 10:56:05,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:05,618 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 162 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:34722 deadline: 1704711375617, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:05,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:05,874 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 164 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:34722 deadline: 1704711375616, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:06,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:06,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 166 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:34722 deadline: 1704711375617, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:07,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:07,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 168 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:34722 deadline: 1704711375616, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:08,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:08,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 170 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:34722 deadline: 1704711375617, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:10,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:10,925 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 172 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:34722 deadline: 1704711375617, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:10,926 ERROR [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10320: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd., hostname=jenkins-hbase4.apache.org,39335,1704711332778, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:178) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor35.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-08 10:56:10,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-08 10:56:10,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 176 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:34722 deadline: 1704711380933, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-08 10:56:11,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-08 10:56:11,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 178 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:34722 deadline: 1704711380933, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-08 10:56:11,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-08 10:56:11,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 180 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:34722 deadline: 1704711380933, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-08 10:56:12,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-08 10:56:12,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 182 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:34722 deadline: 1704711380932, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-08 10:56:13,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-08 10:56:13,711 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 184 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:34722 deadline: 1704711380932, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-08 10:56:16,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-01-08 10:56:16,221 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 186 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:34722 deadline: 1704711380932, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-01-08 10:56:16,222 ERROR [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=3 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10290: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-3' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd., hostname=jenkins-hbase4.apache.org,39335,1704711332778, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor35.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-08 10:56:16,478 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:56:16,479 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-08 10:56:16,479 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704732941063 bypass), TestNs=QuotaState(ts=1704732941063 bypass)} 2024-01-08 10:56:16,479 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1704732941063 bypass), TestNs:TestTable=QuotaState(ts=1704732941063 bypass), TestQuotaAdmin1=QuotaState(ts=1704732941063 bypass)} 2024-01-08 10:56:16,479 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1704732941063 bypass)} 2024-01-08 10:56:16,479 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704732941063 bypass)} 2024-01-08 10:56:16,729 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:56:16,730 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-08 10:56:16,730 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704732941063 bypass), TestNs=QuotaState(ts=1704732941063 bypass)} 2024-01-08 10:56:16,730 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1704732941063 bypass), TestQuotaAdmin2=QuotaState(ts=1704732941063 bypass)} 2024-01-08 10:56:16,730 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1704732941063 bypass)} 2024-01-08 10:56:16,730 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704732941063 bypass)} 2024-01-08 10:56:16,742 INFO [Listener at localhost/34349] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=281 (was 291), OpenFileDescriptor=593 (was 597), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=574 (was 711), ProcessCount=170 (was 170), AvailableMemoryMB=10343 (was 10338) - AvailableMemoryMB LEAK? - 2024-01-08 10:56:16,753 INFO [Listener at localhost/34349] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=281, OpenFileDescriptor=593, MaxFileDescriptor=60000, SystemLoadAverage=574, ProcessCount=170, AvailableMemoryMB=10342 2024-01-08 10:56:17,011 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:56:17,012 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-08 10:56:17,013 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704736541063 bypass), TestNs=QuotaState(ts=1704736541063 bypass)} 2024-01-08 10:56:17,014 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1704736541063 bypass), TestNs:TestTable=QuotaState(ts=1704736541063 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin1=QuotaState(ts=1704736541063 bypass)} 2024-01-08 10:56:17,015 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-08 10:56:17,016 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704736541063 bypass)} 2024-01-08 10:56:17,266 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:56:17,266 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-08 10:56:17,266 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704736541063 bypass), TestNs=QuotaState(ts=1704736541063 bypass)} 2024-01-08 10:56:17,267 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1704736541063 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin2=QuotaState(ts=1704736541063 bypass)} 2024-01-08 10:56:17,267 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-08 10:56:17,267 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704736541063 bypass)} 2024-01-08 10:56:17,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:56:17,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] ipc.CallRunner(144): callId: 201 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:43704 deadline: 1704711387284, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:56:17,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:56:17,538 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] ipc.CallRunner(144): callId: 203 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:43704 deadline: 1704711387283, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:56:18,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:56:18,044 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] ipc.CallRunner(144): callId: 205 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:43704 deadline: 1704711387283, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:56:18,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:56:18,799 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] ipc.CallRunner(144): callId: 207 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:43704 deadline: 1704711387283, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:56:20,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:56:20,056 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] ipc.CallRunner(144): callId: 209 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:43704 deadline: 1704711387284, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:56:22,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:56:22,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] ipc.CallRunner(144): callId: 211 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:43704 deadline: 1704711387283, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:56:22,581 ERROR [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10327: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1704711339792.97a0c6e40de5e390efe7fed552a1fe40., hostname=jenkins-hbase4.apache.org,38189,1704711332823, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor35.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-08 10:56:22,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:56:22,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] ipc.CallRunner(144): callId: 212 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:43704 deadline: 1704711392583, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:56:22,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:56:22,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] ipc.CallRunner(144): callId: 214 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:43704 deadline: 1704711392584, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:56:23,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:56:23,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] ipc.CallRunner(144): callId: 216 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:43704 deadline: 1704711392584, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:56:24,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:56:24,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] ipc.CallRunner(144): callId: 218 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:43704 deadline: 1704711392584, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:56:25,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:56:25,359 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] ipc.CallRunner(144): callId: 220 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:43704 deadline: 1704711392583, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:56:27,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:56:27,870 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=38189] ipc.CallRunner(144): callId: 222 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:43704 deadline: 1704711392583, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-01-08 10:56:27,871 ERROR [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10336: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1704711339792.97a0c6e40de5e390efe7fed552a1fe40., hostname=jenkins-hbase4.apache.org,38189,1704711332823, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor35.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-08 10:56:28,129 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:56:28,129 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-08 10:56:28,129 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704740141063 bypass), TestNs=QuotaState(ts=1704740141063 bypass)} 2024-01-08 10:56:28,129 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1704740141063 bypass), TestNs:TestTable=QuotaState(ts=1704740141063 bypass), TestQuotaAdmin1=QuotaState(ts=1704740141063 bypass)} 2024-01-08 10:56:28,129 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-08 10:56:28,130 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704740141063 bypass)} 2024-01-08 10:56:28,380 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:56:28,380 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-08 10:56:28,380 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704740141063 bypass), TestNs=QuotaState(ts=1704740141063 bypass)} 2024-01-08 10:56:28,380 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1704740141063 bypass), TestQuotaAdmin2=QuotaState(ts=1704740141063 bypass)} 2024-01-08 10:56:28,380 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1704740141063 bypass)} 2024-01-08 10:56:28,380 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704740141063 bypass)} 2024-01-08 10:56:28,392 INFO [Listener at localhost/34349] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=280 (was 281), OpenFileDescriptor=593 (was 593), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=486 (was 574), ProcessCount=170 (was 170), AvailableMemoryMB=10343 (was 10342) - AvailableMemoryMB LEAK? - 2024-01-08 10:56:28,405 INFO [Listener at localhost/34349] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=280, OpenFileDescriptor=593, MaxFileDescriptor=60000, SystemLoadAverage=486, ProcessCount=170, AvailableMemoryMB=10342 2024-01-08 10:56:28,669 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:56:28,669 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-08 10:56:28,670 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704743741063 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1704743741063 bypass)} 2024-01-08 10:56:28,671 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1704743741063 bypass), TestNs:TestTable=QuotaState(ts=1704743741063 bypass), TestQuotaAdmin1=QuotaState(ts=1704743741063 bypass)} 2024-01-08 10:56:28,671 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-08 10:56:28,671 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704743741063 bypass)} 2024-01-08 10:56:28,921 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:56:28,921 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-08 10:56:28,922 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704743741063 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1704743741063 bypass)} 2024-01-08 10:56:28,922 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1704743741063 bypass), TestQuotaAdmin2=QuotaState(ts=1704743741063 bypass)} 2024-01-08 10:56:28,922 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-08 10:56:28,923 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704743741063 bypass)} 2024-01-08 10:56:28,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-08 10:56:28,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 234 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:34722 deadline: 1704711398939, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-08 10:56:29,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-08 10:56:29,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 236 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:34722 deadline: 1704711398939, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-08 10:56:29,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-08 10:56:29,702 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 238 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:34722 deadline: 1704711398939, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-08 10:56:30,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-08 10:56:30,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 240 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:34722 deadline: 1704711398938, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-08 10:56:31,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-08 10:56:31,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 242 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:34722 deadline: 1704711398938, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-08 10:56:34,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-01-08 10:56:34,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 244 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:34722 deadline: 1704711398939, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-01-08 10:56:34,224 ERROR [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10329: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd., hostname=jenkins-hbase4.apache.org,39335,1704711332778, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:128) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor35.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2942) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-08 10:56:34,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:34,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 251 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:34722 deadline: 1704711404233, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:34,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:34,488 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 253 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:34722 deadline: 1704711404232, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:34,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:34,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 255 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:34722 deadline: 1704711404233, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:35,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:35,750 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 257 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:34722 deadline: 1704711404233, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:37,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:37,013 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 259 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:34722 deadline: 1704711404232, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:39,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:39,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=39335] ipc.CallRunner(144): callId: 261 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:34722 deadline: 1704711404233, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-01-08 10:56:39,528 ERROR [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10340: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd., hostname=jenkins-hbase4.apache.org,39335,1704711332778, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor35.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2532) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-01-08 10:56:39,785 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:56:39,785 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-08 10:56:39,785 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704747341063 bypass), TestNs=QuotaState(ts=1704747341063 bypass)} 2024-01-08 10:56:39,785 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1704747341063 bypass), TestNs:TestTable=QuotaState(ts=1704747341063 bypass), TestQuotaAdmin1=QuotaState(ts=1704747341063 bypass)} 2024-01-08 10:56:39,786 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1704747341063 bypass)} 2024-01-08 10:56:39,786 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704747341063 bypass)} 2024-01-08 10:56:40,036 INFO [Listener at localhost/34349] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-01-08 10:56:40,036 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-01-08 10:56:40,036 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1704747341063 bypass), TestNs=QuotaState(ts=1704747341063 bypass)} 2024-01-08 10:56:40,036 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1704747341063 bypass), TestQuotaAdmin2=QuotaState(ts=1704747341063 bypass)} 2024-01-08 10:56:40,036 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(218): {} 2024-01-08 10:56:40,036 DEBUG [Listener at localhost/34349] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1704747341063 bypass)} 2024-01-08 10:56:40,048 INFO [Listener at localhost/34349] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=265 (was 280), OpenFileDescriptor=581 (was 593), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=411 (was 486), ProcessCount=170 (was 170), AvailableMemoryMB=10343 (was 10342) - AvailableMemoryMB LEAK? - 2024-01-08 10:56:40,051 INFO [Listener at localhost/34349] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin0 2024-01-08 10:56:40,056 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin0 2024-01-08 10:56:40,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] procedure2.ProcedureExecutor(1075): Stored pid=27, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin0 2024-01-08 10:56:40,067 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704711400067"}]},"ts":"1704711400067"} 2024-01-08 10:56:40,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-01-08 10:56:40,069 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLING in hbase:meta 2024-01-08 10:56:40,071 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set TestQuotaAdmin0 to state=DISABLING 2024-01-08 10:56:40,073 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=cdd2e33bb4d429ba6f039699d97e40cd, UNASSIGN}] 2024-01-08 10:56:40,074 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=cdd2e33bb4d429ba6f039699d97e40cd, UNASSIGN 2024-01-08 10:56:40,075 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=cdd2e33bb4d429ba6f039699d97e40cd, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:56:40,075 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704711400075"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1704711400075"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1704711400075"}]},"ts":"1704711400075"} 2024-01-08 10:56:40,077 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure cdd2e33bb4d429ba6f039699d97e40cd, server=jenkins-hbase4.apache.org,39335,1704711332778}] 2024-01-08 10:56:40,181 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase4.apache.org,39335,1704711332778, timeout=1704711400233, delay=52, operations=[pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure cdd2e33bb4d429ba6f039699d97e40cd, server=jenkins-hbase4.apache.org,39335,1704711332778]] 2024-01-08 10:56:40,236 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:56:40,237 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close cdd2e33bb4d429ba6f039699d97e40cd 2024-01-08 10:56:40,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cdd2e33bb4d429ba6f039699d97e40cd, disabling compactions & flushes 2024-01-08 10:56:40,239 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd. 2024-01-08 10:56:40,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd. 2024-01-08 10:56:40,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd. after waiting 0 ms 2024-01-08 10:56:40,239 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd. 2024-01-08 10:56:40,240 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing cdd2e33bb4d429ba6f039699d97e40cd 1/1 column families, dataSize=578 B heapSize=2.11 KB 2024-01-08 10:56:40,313 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=578 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/default/TestQuotaAdmin0/cdd2e33bb4d429ba6f039699d97e40cd/.tmp/cf/31d02eb1f9754a40b7cd229dfaacf955 2024-01-08 10:56:40,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-01-08 10:56:40,360 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/default/TestQuotaAdmin0/cdd2e33bb4d429ba6f039699d97e40cd/.tmp/cf/31d02eb1f9754a40b7cd229dfaacf955 as hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/default/TestQuotaAdmin0/cdd2e33bb4d429ba6f039699d97e40cd/cf/31d02eb1f9754a40b7cd229dfaacf955 2024-01-08 10:56:40,374 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/default/TestQuotaAdmin0/cdd2e33bb4d429ba6f039699d97e40cd/cf/31d02eb1f9754a40b7cd229dfaacf955, entries=6, sequenceid=21, filesize=4.7 K 2024-01-08 10:56:40,378 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~578 B/578, heapSize ~2.09 KB/2144, currentSize=0 B/0 for cdd2e33bb4d429ba6f039699d97e40cd in 138ms, sequenceid=21, compaction requested=false 2024-01-08 10:56:40,387 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/default/TestQuotaAdmin0/cdd2e33bb4d429ba6f039699d97e40cd/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2024-01-08 10:56:40,388 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd. 2024-01-08 10:56:40,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cdd2e33bb4d429ba6f039699d97e40cd: 2024-01-08 10:56:40,391 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed cdd2e33bb4d429ba6f039699d97e40cd 2024-01-08 10:56:40,391 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=cdd2e33bb4d429ba6f039699d97e40cd, regionState=CLOSED 2024-01-08 10:56:40,391 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704711400391"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1704711400391"}]},"ts":"1704711400391"} 2024-01-08 10:56:40,395 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=29, resume processing ppid=28 2024-01-08 10:56:40,395 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=29, ppid=28, state=SUCCESS; CloseRegionProcedure cdd2e33bb4d429ba6f039699d97e40cd, server=jenkins-hbase4.apache.org,39335,1704711332778 in 316 msec 2024-01-08 10:56:40,397 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=28, resume processing ppid=27 2024-01-08 10:56:40,397 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=cdd2e33bb4d429ba6f039699d97e40cd, UNASSIGN in 322 msec 2024-01-08 10:56:40,398 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704711400398"}]},"ts":"1704711400398"} 2024-01-08 10:56:40,399 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLED in hbase:meta 2024-01-08 10:56:40,402 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set TestQuotaAdmin0 to state=DISABLED 2024-01-08 10:56:40,404 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=27, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin0 in 346 msec 2024-01-08 10:56:40,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-01-08 10:56:40,821 INFO [Listener at localhost/34349] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin0, procId: 27 completed 2024-01-08 10:56:40,825 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin0 2024-01-08 10:56:40,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] procedure2.ProcedureExecutor(1075): Stored pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-08 10:56:40,835 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-08 10:56:40,837 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=30, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-08 10:56:40,841 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-01-08 10:56:40,845 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/default/TestQuotaAdmin0/cdd2e33bb4d429ba6f039699d97e40cd 2024-01-08 10:56:40,849 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/default/TestQuotaAdmin0/cdd2e33bb4d429ba6f039699d97e40cd/cf, FileablePath, hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/default/TestQuotaAdmin0/cdd2e33bb4d429ba6f039699d97e40cd/recovered.edits] 2024-01-08 10:56:40,859 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/default/TestQuotaAdmin0/cdd2e33bb4d429ba6f039699d97e40cd/cf/31d02eb1f9754a40b7cd229dfaacf955 to hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/archive/data/default/TestQuotaAdmin0/cdd2e33bb4d429ba6f039699d97e40cd/cf/31d02eb1f9754a40b7cd229dfaacf955 2024-01-08 10:56:40,863 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/default/TestQuotaAdmin0/cdd2e33bb4d429ba6f039699d97e40cd/recovered.edits/24.seqid to hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/archive/data/default/TestQuotaAdmin0/cdd2e33bb4d429ba6f039699d97e40cd/recovered.edits/24.seqid 2024-01-08 10:56:40,864 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/default/TestQuotaAdmin0/cdd2e33bb4d429ba6f039699d97e40cd 2024-01-08 10:56:40,864 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-01-08 10:56:40,868 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=30, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-08 10:56:40,889 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin0 from hbase:meta 2024-01-08 10:56:40,892 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin0' descriptor. 2024-01-08 10:56:40,894 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=30, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-08 10:56:40,894 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin0' from region states. 2024-01-08 10:56:40,894 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1704711400894"}]},"ts":"9223372036854775807"} 2024-01-08 10:56:40,896 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-01-08 10:56:40,896 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => cdd2e33bb4d429ba6f039699d97e40cd, NAME => 'TestQuotaAdmin0,,1704711337156.cdd2e33bb4d429ba6f039699d97e40cd.', STARTKEY => '', ENDKEY => ''}] 2024-01-08 10:56:40,897 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin0' as deleted. 2024-01-08 10:56:40,897 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1704711400897"}]},"ts":"9223372036854775807"} 2024-01-08 10:56:40,898 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin0 state from META 2024-01-08 10:56:40,901 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=30, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-01-08 10:56:40,903 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=30, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin0 in 74 msec 2024-01-08 10:56:41,093 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-01-08 10:56:41,093 INFO [Listener at localhost/34349] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin0, procId: 30 completed 2024-01-08 10:56:41,094 INFO [Listener at localhost/34349] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin1 2024-01-08 10:56:41,094 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin1 2024-01-08 10:56:41,095 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] procedure2.ProcedureExecutor(1075): Stored pid=31, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin1 2024-01-08 10:56:41,098 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-01-08 10:56:41,099 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704711401099"}]},"ts":"1704711401099"} 2024-01-08 10:56:41,101 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLING in hbase:meta 2024-01-08 10:56:41,103 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set TestQuotaAdmin1 to state=DISABLING 2024-01-08 10:56:41,105 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=7f49985cd1e2794cdbe1fb824e142d2b, UNASSIGN}] 2024-01-08 10:56:41,106 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=7f49985cd1e2794cdbe1fb824e142d2b, UNASSIGN 2024-01-08 10:56:41,107 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=7f49985cd1e2794cdbe1fb824e142d2b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:56:41,107 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1704711337960.7f49985cd1e2794cdbe1fb824e142d2b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704711401107"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1704711401107"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1704711401107"}]},"ts":"1704711401107"} 2024-01-08 10:56:41,109 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=33, ppid=32, state=RUNNABLE; CloseRegionProcedure 7f49985cd1e2794cdbe1fb824e142d2b, server=jenkins-hbase4.apache.org,39335,1704711332778}] 2024-01-08 10:56:41,261 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:56:41,261 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7f49985cd1e2794cdbe1fb824e142d2b 2024-01-08 10:56:41,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7f49985cd1e2794cdbe1fb824e142d2b, disabling compactions & flushes 2024-01-08 10:56:41,262 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1704711337960.7f49985cd1e2794cdbe1fb824e142d2b. 2024-01-08 10:56:41,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1704711337960.7f49985cd1e2794cdbe1fb824e142d2b. 2024-01-08 10:56:41,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1704711337960.7f49985cd1e2794cdbe1fb824e142d2b. after waiting 0 ms 2024-01-08 10:56:41,262 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1704711337960.7f49985cd1e2794cdbe1fb824e142d2b. 2024-01-08 10:56:41,267 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/default/TestQuotaAdmin1/7f49985cd1e2794cdbe1fb824e142d2b/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-01-08 10:56:41,269 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1704711337960.7f49985cd1e2794cdbe1fb824e142d2b. 2024-01-08 10:56:41,269 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7f49985cd1e2794cdbe1fb824e142d2b: 2024-01-08 10:56:41,271 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7f49985cd1e2794cdbe1fb824e142d2b 2024-01-08 10:56:41,272 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=7f49985cd1e2794cdbe1fb824e142d2b, regionState=CLOSED 2024-01-08 10:56:41,272 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1704711337960.7f49985cd1e2794cdbe1fb824e142d2b.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704711401272"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1704711401272"}]},"ts":"1704711401272"} 2024-01-08 10:56:41,276 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=33, resume processing ppid=32 2024-01-08 10:56:41,276 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=33, ppid=32, state=SUCCESS; CloseRegionProcedure 7f49985cd1e2794cdbe1fb824e142d2b, server=jenkins-hbase4.apache.org,39335,1704711332778 in 166 msec 2024-01-08 10:56:41,278 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=32, resume processing ppid=31 2024-01-08 10:56:41,278 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=32, ppid=31, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=7f49985cd1e2794cdbe1fb824e142d2b, UNASSIGN in 171 msec 2024-01-08 10:56:41,279 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704711401279"}]},"ts":"1704711401279"} 2024-01-08 10:56:41,280 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLED in hbase:meta 2024-01-08 10:56:41,282 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set TestQuotaAdmin1 to state=DISABLED 2024-01-08 10:56:41,284 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=31, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin1 in 189 msec 2024-01-08 10:56:41,350 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-01-08 10:56:41,350 INFO [Listener at localhost/34349] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin1, procId: 31 completed 2024-01-08 10:56:41,351 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin1 2024-01-08 10:56:41,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] procedure2.ProcedureExecutor(1075): Stored pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-08 10:56:41,354 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-08 10:56:41,355 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=34, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-08 10:56:41,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-01-08 10:56:41,361 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/default/TestQuotaAdmin1/7f49985cd1e2794cdbe1fb824e142d2b 2024-01-08 10:56:41,363 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/default/TestQuotaAdmin1/7f49985cd1e2794cdbe1fb824e142d2b/cf, FileablePath, hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/default/TestQuotaAdmin1/7f49985cd1e2794cdbe1fb824e142d2b/recovered.edits] 2024-01-08 10:56:41,372 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/default/TestQuotaAdmin1/7f49985cd1e2794cdbe1fb824e142d2b/recovered.edits/4.seqid to hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/archive/data/default/TestQuotaAdmin1/7f49985cd1e2794cdbe1fb824e142d2b/recovered.edits/4.seqid 2024-01-08 10:56:41,372 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/default/TestQuotaAdmin1/7f49985cd1e2794cdbe1fb824e142d2b 2024-01-08 10:56:41,372 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-01-08 10:56:41,376 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=34, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-08 10:56:41,378 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin1 from hbase:meta 2024-01-08 10:56:41,380 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin1' descriptor. 2024-01-08 10:56:41,382 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=34, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-08 10:56:41,382 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin1' from region states. 2024-01-08 10:56:41,382 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1,,1704711337960.7f49985cd1e2794cdbe1fb824e142d2b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1704711401382"}]},"ts":"9223372036854775807"} 2024-01-08 10:56:41,384 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-01-08 10:56:41,384 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7f49985cd1e2794cdbe1fb824e142d2b, NAME => 'TestQuotaAdmin1,,1704711337960.7f49985cd1e2794cdbe1fb824e142d2b.', STARTKEY => '', ENDKEY => ''}] 2024-01-08 10:56:41,384 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin1' as deleted. 2024-01-08 10:56:41,384 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1704711401384"}]},"ts":"9223372036854775807"} 2024-01-08 10:56:41,386 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin1 state from META 2024-01-08 10:56:41,388 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=34, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-01-08 10:56:41,390 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=34, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin1 in 37 msec 2024-01-08 10:56:41,609 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-01-08 10:56:41,609 INFO [Listener at localhost/34349] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin1, procId: 34 completed 2024-01-08 10:56:41,609 INFO [Listener at localhost/34349] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin2 2024-01-08 10:56:41,610 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin2 2024-01-08 10:56:41,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] procedure2.ProcedureExecutor(1075): Stored pid=35, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin2 2024-01-08 10:56:41,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-01-08 10:56:41,615 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704711401615"}]},"ts":"1704711401615"} 2024-01-08 10:56:41,616 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLING in hbase:meta 2024-01-08 10:56:41,618 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set TestQuotaAdmin2 to state=DISABLING 2024-01-08 10:56:41,619 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=b0182e56a4c63ba331108c28fab73610, UNASSIGN}] 2024-01-08 10:56:41,620 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=b0182e56a4c63ba331108c28fab73610, UNASSIGN 2024-01-08 10:56:41,621 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=b0182e56a4c63ba331108c28fab73610, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38189,1704711332823 2024-01-08 10:56:41,621 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1704711338741.b0182e56a4c63ba331108c28fab73610.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704711401621"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1704711401621"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1704711401621"}]},"ts":"1704711401621"} 2024-01-08 10:56:41,622 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; CloseRegionProcedure b0182e56a4c63ba331108c28fab73610, server=jenkins-hbase4.apache.org,38189,1704711332823}] 2024-01-08 10:56:41,775 DEBUG [RSProcedureDispatcher-pool-5] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38189,1704711332823 2024-01-08 10:56:41,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b0182e56a4c63ba331108c28fab73610 2024-01-08 10:56:41,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b0182e56a4c63ba331108c28fab73610, disabling compactions & flushes 2024-01-08 10:56:41,776 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1704711338741.b0182e56a4c63ba331108c28fab73610. 2024-01-08 10:56:41,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1704711338741.b0182e56a4c63ba331108c28fab73610. 2024-01-08 10:56:41,776 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1704711338741.b0182e56a4c63ba331108c28fab73610. after waiting 0 ms 2024-01-08 10:56:41,777 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1704711338741.b0182e56a4c63ba331108c28fab73610. 2024-01-08 10:56:41,783 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/default/TestQuotaAdmin2/b0182e56a4c63ba331108c28fab73610/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-01-08 10:56:41,784 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1704711338741.b0182e56a4c63ba331108c28fab73610. 2024-01-08 10:56:41,784 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b0182e56a4c63ba331108c28fab73610: 2024-01-08 10:56:41,786 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b0182e56a4c63ba331108c28fab73610 2024-01-08 10:56:41,787 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=b0182e56a4c63ba331108c28fab73610, regionState=CLOSED 2024-01-08 10:56:41,787 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1704711338741.b0182e56a4c63ba331108c28fab73610.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1704711401787"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1704711401787"}]},"ts":"1704711401787"} 2024-01-08 10:56:41,791 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=37, resume processing ppid=36 2024-01-08 10:56:41,791 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=37, ppid=36, state=SUCCESS; CloseRegionProcedure b0182e56a4c63ba331108c28fab73610, server=jenkins-hbase4.apache.org,38189,1704711332823 in 167 msec 2024-01-08 10:56:41,793 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=36, resume processing ppid=35 2024-01-08 10:56:41,793 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=b0182e56a4c63ba331108c28fab73610, UNASSIGN in 172 msec 2024-01-08 10:56:41,794 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704711401793"}]},"ts":"1704711401793"} 2024-01-08 10:56:41,795 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLED in hbase:meta 2024-01-08 10:56:41,798 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set TestQuotaAdmin2 to state=DISABLED 2024-01-08 10:56:41,800 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=35, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin2 in 189 msec 2024-01-08 10:56:41,865 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-01-08 10:56:41,866 INFO [Listener at localhost/34349] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin2, procId: 35 completed 2024-01-08 10:56:41,866 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin2 2024-01-08 10:56:41,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] procedure2.ProcedureExecutor(1075): Stored pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-08 10:56:41,870 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-08 10:56:41,871 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=38, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-08 10:56:41,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-01-08 10:56:41,875 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/default/TestQuotaAdmin2/b0182e56a4c63ba331108c28fab73610 2024-01-08 10:56:41,877 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/default/TestQuotaAdmin2/b0182e56a4c63ba331108c28fab73610/cf, FileablePath, hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/default/TestQuotaAdmin2/b0182e56a4c63ba331108c28fab73610/recovered.edits] 2024-01-08 10:56:41,885 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/default/TestQuotaAdmin2/b0182e56a4c63ba331108c28fab73610/recovered.edits/4.seqid to hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/archive/data/default/TestQuotaAdmin2/b0182e56a4c63ba331108c28fab73610/recovered.edits/4.seqid 2024-01-08 10:56:41,886 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/default/TestQuotaAdmin2/b0182e56a4c63ba331108c28fab73610 2024-01-08 10:56:41,886 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-01-08 10:56:41,889 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=38, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-08 10:56:41,891 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin2 from hbase:meta 2024-01-08 10:56:41,893 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin2' descriptor. 2024-01-08 10:56:41,894 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=38, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-08 10:56:41,894 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin2' from region states. 2024-01-08 10:56:41,894 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2,,1704711338741.b0182e56a4c63ba331108c28fab73610.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1704711401894"}]},"ts":"9223372036854775807"} 2024-01-08 10:56:41,896 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-01-08 10:56:41,896 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b0182e56a4c63ba331108c28fab73610, NAME => 'TestQuotaAdmin2,,1704711338741.b0182e56a4c63ba331108c28fab73610.', STARTKEY => '', ENDKEY => ''}] 2024-01-08 10:56:41,896 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin2' as deleted. 2024-01-08 10:56:41,896 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1704711401896"}]},"ts":"9223372036854775807"} 2024-01-08 10:56:41,898 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin2 state from META 2024-01-08 10:56:41,901 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=38, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-01-08 10:56:41,902 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=38, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin2 in 34 msec 2024-01-08 10:56:42,124 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-01-08 10:56:42,125 INFO [Listener at localhost/34349] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin2, procId: 38 completed 2024-01-08 10:56:42,125 INFO [Listener at localhost/34349] client.HBaseAdmin$15(890): Started disable of TestNs:TestTable 2024-01-08 10:56:42,126 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestNs:TestTable 2024-01-08 10:56:42,127 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] procedure2.ProcedureExecutor(1075): Stored pid=39, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestNs:TestTable 2024-01-08 10:56:42,130 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-01-08 10:56:42,130 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704711402130"}]},"ts":"1704711402130"} 2024-01-08 10:56:42,132 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLING in hbase:meta 2024-01-08 10:56:42,134 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set TestNs:TestTable to state=DISABLING 2024-01-08 10:56:42,135 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=bbb7a9e9169d0180b7cf43896edf60e5, UNASSIGN}, {pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=97a0c6e40de5e390efe7fed552a1fe40, UNASSIGN}] 2024-01-08 10:56:42,136 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=97a0c6e40de5e390efe7fed552a1fe40, UNASSIGN 2024-01-08 10:56:42,136 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=bbb7a9e9169d0180b7cf43896edf60e5, UNASSIGN 2024-01-08 10:56:42,136 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=97a0c6e40de5e390efe7fed552a1fe40, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,38189,1704711332823 2024-01-08 10:56:42,137 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=bbb7a9e9169d0180b7cf43896edf60e5, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:56:42,137 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1704711339792.97a0c6e40de5e390efe7fed552a1fe40.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1704711402136"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1704711402136"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1704711402136"}]},"ts":"1704711402136"} 2024-01-08 10:56:42,137 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1704711339792.bbb7a9e9169d0180b7cf43896edf60e5.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1704711402137"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1704711402137"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1704711402137"}]},"ts":"1704711402137"} 2024-01-08 10:56:42,138 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=42, ppid=41, state=RUNNABLE; CloseRegionProcedure 97a0c6e40de5e390efe7fed552a1fe40, server=jenkins-hbase4.apache.org,38189,1704711332823}] 2024-01-08 10:56:42,139 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=43, ppid=40, state=RUNNABLE; CloseRegionProcedure bbb7a9e9169d0180b7cf43896edf60e5, server=jenkins-hbase4.apache.org,39335,1704711332778}] 2024-01-08 10:56:42,290 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,38189,1704711332823 2024-01-08 10:56:42,291 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 97a0c6e40de5e390efe7fed552a1fe40 2024-01-08 10:56:42,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 97a0c6e40de5e390efe7fed552a1fe40, disabling compactions & flushes 2024-01-08 10:56:42,292 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:56:42,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1704711339792.97a0c6e40de5e390efe7fed552a1fe40. 2024-01-08 10:56:42,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1704711339792.97a0c6e40de5e390efe7fed552a1fe40. 2024-01-08 10:56:42,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1704711339792.97a0c6e40de5e390efe7fed552a1fe40. after waiting 0 ms 2024-01-08 10:56:42,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1704711339792.97a0c6e40de5e390efe7fed552a1fe40. 2024-01-08 10:56:42,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close bbb7a9e9169d0180b7cf43896edf60e5 2024-01-08 10:56:42,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bbb7a9e9169d0180b7cf43896edf60e5, disabling compactions & flushes 2024-01-08 10:56:42,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1704711339792.bbb7a9e9169d0180b7cf43896edf60e5. 2024-01-08 10:56:42,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1704711339792.bbb7a9e9169d0180b7cf43896edf60e5. 2024-01-08 10:56:42,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1704711339792.bbb7a9e9169d0180b7cf43896edf60e5. after waiting 0 ms 2024-01-08 10:56:42,293 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1704711339792.bbb7a9e9169d0180b7cf43896edf60e5. 2024-01-08 10:56:42,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/TestNs/TestTable/97a0c6e40de5e390efe7fed552a1fe40/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-01-08 10:56:42,299 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/TestNs/TestTable/bbb7a9e9169d0180b7cf43896edf60e5/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-01-08 10:56:42,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1704711339792.97a0c6e40de5e390efe7fed552a1fe40. 2024-01-08 10:56:42,300 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 97a0c6e40de5e390efe7fed552a1fe40: 2024-01-08 10:56:42,300 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1704711339792.bbb7a9e9169d0180b7cf43896edf60e5. 2024-01-08 10:56:42,301 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bbb7a9e9169d0180b7cf43896edf60e5: 2024-01-08 10:56:42,302 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 97a0c6e40de5e390efe7fed552a1fe40 2024-01-08 10:56:42,303 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=97a0c6e40de5e390efe7fed552a1fe40, regionState=CLOSED 2024-01-08 10:56:42,303 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1704711339792.97a0c6e40de5e390efe7fed552a1fe40.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1704711402303"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1704711402303"}]},"ts":"1704711402303"} 2024-01-08 10:56:42,303 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed bbb7a9e9169d0180b7cf43896edf60e5 2024-01-08 10:56:42,304 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=bbb7a9e9169d0180b7cf43896edf60e5, regionState=CLOSED 2024-01-08 10:56:42,304 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,,1704711339792.bbb7a9e9169d0180b7cf43896edf60e5.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1704711402304"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1704711402304"}]},"ts":"1704711402304"} 2024-01-08 10:56:42,307 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=42, resume processing ppid=41 2024-01-08 10:56:42,307 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=42, ppid=41, state=SUCCESS; CloseRegionProcedure 97a0c6e40de5e390efe7fed552a1fe40, server=jenkins-hbase4.apache.org,38189,1704711332823 in 167 msec 2024-01-08 10:56:42,307 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=43, resume processing ppid=40 2024-01-08 10:56:42,308 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=43, ppid=40, state=SUCCESS; CloseRegionProcedure bbb7a9e9169d0180b7cf43896edf60e5, server=jenkins-hbase4.apache.org,39335,1704711332778 in 166 msec 2024-01-08 10:56:42,308 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=41, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=97a0c6e40de5e390efe7fed552a1fe40, UNASSIGN in 172 msec 2024-01-08 10:56:42,309 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=40, resume processing ppid=39 2024-01-08 10:56:42,309 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=bbb7a9e9169d0180b7cf43896edf60e5, UNASSIGN in 173 msec 2024-01-08 10:56:42,310 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1704711402310"}]},"ts":"1704711402310"} 2024-01-08 10:56:42,311 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLED in hbase:meta 2024-01-08 10:56:42,313 INFO [PEWorker-1] procedure.DisableTableProcedure(305): Set TestNs:TestTable to state=DISABLED 2024-01-08 10:56:42,315 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=39, state=SUCCESS; DisableTableProcedure table=TestNs:TestTable in 188 msec 2024-01-08 10:56:42,381 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-01-08 10:56:42,381 INFO [Listener at localhost/34349] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: TestNs:TestTable, procId: 39 completed 2024-01-08 10:56:42,382 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestNs:TestTable 2024-01-08 10:56:42,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] procedure2.ProcedureExecutor(1075): Stored pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestNs:TestTable 2024-01-08 10:56:42,385 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-08 10:56:42,386 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=44, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-08 10:56:42,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-01-08 10:56:42,392 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/TestNs/TestTable/bbb7a9e9169d0180b7cf43896edf60e5 2024-01-08 10:56:42,392 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/TestNs/TestTable/97a0c6e40de5e390efe7fed552a1fe40 2024-01-08 10:56:42,394 DEBUG [HFileArchiver-11] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/TestNs/TestTable/bbb7a9e9169d0180b7cf43896edf60e5/cf, FileablePath, hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/TestNs/TestTable/bbb7a9e9169d0180b7cf43896edf60e5/recovered.edits] 2024-01-08 10:56:42,394 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/TestNs/TestTable/97a0c6e40de5e390efe7fed552a1fe40/cf, FileablePath, hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/TestNs/TestTable/97a0c6e40de5e390efe7fed552a1fe40/recovered.edits] 2024-01-08 10:56:42,402 DEBUG [HFileArchiver-11] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/TestNs/TestTable/bbb7a9e9169d0180b7cf43896edf60e5/recovered.edits/4.seqid to hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/archive/data/TestNs/TestTable/bbb7a9e9169d0180b7cf43896edf60e5/recovered.edits/4.seqid 2024-01-08 10:56:42,402 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/TestNs/TestTable/97a0c6e40de5e390efe7fed552a1fe40/recovered.edits/4.seqid to hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/archive/data/TestNs/TestTable/97a0c6e40de5e390efe7fed552a1fe40/recovered.edits/4.seqid 2024-01-08 10:56:42,403 DEBUG [HFileArchiver-11] backup.HFileArchiver(596): Deleted hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/TestNs/TestTable/bbb7a9e9169d0180b7cf43896edf60e5 2024-01-08 10:56:42,403 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/.tmp/data/TestNs/TestTable/97a0c6e40de5e390efe7fed552a1fe40 2024-01-08 10:56:42,403 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-01-08 10:56:42,406 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=44, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-08 10:56:42,408 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of TestNs:TestTable from hbase:meta 2024-01-08 10:56:42,410 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'TestNs:TestTable' descriptor. 2024-01-08 10:56:42,412 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=44, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-08 10:56:42,412 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'TestNs:TestTable' from region states. 2024-01-08 10:56:42,412 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,,1704711339792.bbb7a9e9169d0180b7cf43896edf60e5.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1704711402412"}]},"ts":"9223372036854775807"} 2024-01-08 10:56:42,412 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,1,1704711339792.97a0c6e40de5e390efe7fed552a1fe40.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1704711402412"}]},"ts":"9223372036854775807"} 2024-01-08 10:56:42,414 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2024-01-08 10:56:42,414 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => bbb7a9e9169d0180b7cf43896edf60e5, NAME => 'TestNs:TestTable,,1704711339792.bbb7a9e9169d0180b7cf43896edf60e5.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 97a0c6e40de5e390efe7fed552a1fe40, NAME => 'TestNs:TestTable,1,1704711339792.97a0c6e40de5e390efe7fed552a1fe40.', STARTKEY => '1', ENDKEY => ''}] 2024-01-08 10:56:42,414 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'TestNs:TestTable' as deleted. 2024-01-08 10:56:42,414 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1704711402414"}]},"ts":"9223372036854775807"} 2024-01-08 10:56:42,416 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table TestNs:TestTable state from META 2024-01-08 10:56:42,420 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=44, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-01-08 10:56:42,421 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=44, state=SUCCESS; DeleteTableProcedure table=TestNs:TestTable in 38 msec 2024-01-08 10:56:42,639 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-01-08 10:56:42,639 INFO [Listener at localhost/34349] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: TestNs:TestTable, procId: 44 completed 2024-01-08 10:56:42,644 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.HMaster$17(3092): Client=jenkins//172.31.14.131 delete TestNs 2024-01-08 10:56:42,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] procedure2.ProcedureExecutor(1075): Stored pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE; DeleteNamespaceProcedure, namespace=TestNs 2024-01-08 10:56:42,652 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-08 10:56:42,655 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_FROM_NS_TABLE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-08 10:56:42,657 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_FROM_ZK, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-08 10:56:42,658 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-01-08 10:56:42,659 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace/TestNs 2024-01-08 10:56:42,659 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-01-08 10:56:42,660 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_DIRECTORIES, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-08 10:56:42,662 INFO [PEWorker-3] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_NAMESPACE_QUOTA, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-01-08 10:56:42,664 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=45, state=SUCCESS; DeleteNamespaceProcedure, namespace=TestNs in 18 msec 2024-01-08 10:56:42,909 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=44665] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-01-08 10:56:42,910 INFO [Listener at localhost/34349] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2024-01-08 10:56:42,910 INFO [Listener at localhost/34349] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-01-08 10:56:42,910 DEBUG [Listener at localhost/34349] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x255a256c to 127.0.0.1:52049 2024-01-08 10:56:42,910 DEBUG [Listener at localhost/34349] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-08 10:56:42,911 DEBUG [Listener at localhost/34349] util.JVMClusterUtil(237): Shutting down HBase Cluster 2024-01-08 10:56:42,911 DEBUG [Listener at localhost/34349] util.JVMClusterUtil(257): Found active master hash=237793193, stopped=false 2024-01-08 10:56:42,911 DEBUG [Listener at localhost/34349] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-01-08 10:56:42,911 INFO [Listener at localhost/34349] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,44665,1704711331544 2024-01-08 10:56:42,914 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-01-08 10:56:42,914 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): regionserver:39335-0x10106c67f690001, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-01-08 10:56:42,914 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-01-08 10:56:42,914 INFO [Listener at localhost/34349] procedure2.ProcedureExecutor(675): Stopping 2024-01-08 10:56:42,914 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): regionserver:38189-0x10106c67f690002, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-01-08 10:56:42,915 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-08 10:56:42,915 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:39335-0x10106c67f690001, quorum=127.0.0.1:52049, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-08 10:56:42,915 DEBUG [Listener at localhost/34349] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3096f690 to 127.0.0.1:52049 2024-01-08 10:56:42,915 DEBUG [Listener at localhost/34349] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-08 10:56:42,915 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:38189-0x10106c67f690002, quorum=127.0.0.1:52049, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-01-08 10:56:42,915 INFO [Listener at localhost/34349] regionserver.HRegionServer(2300): ***** STOPPING region server 'jenkins-hbase4.apache.org,39335,1704711332778' ***** 2024-01-08 10:56:42,915 INFO [Listener at localhost/34349] regionserver.HRegionServer(2314): STOPPED: Shutdown requested 2024-01-08 10:56:42,915 INFO [Listener at localhost/34349] regionserver.HRegionServer(2300): ***** STOPPING region server 'jenkins-hbase4.apache.org,38189,1704711332823' ***** 2024-01-08 10:56:42,915 INFO [Listener at localhost/34349] regionserver.HRegionServer(2314): STOPPED: Shutdown requested 2024-01-08 10:56:42,915 INFO [RS:1;jenkins-hbase4:38189] regionserver.HeapMemoryManager(220): Stopping 2024-01-08 10:56:42,916 INFO [RS:0;jenkins-hbase4:39335] regionserver.HeapMemoryManager(220): Stopping 2024-01-08 10:56:42,916 INFO [RS:1;jenkins-hbase4:38189] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-01-08 10:56:42,916 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-01-08 10:56:42,916 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-01-08 10:56:42,916 INFO [RS:0;jenkins-hbase4:39335] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-01-08 10:56:42,916 INFO [RS:1;jenkins-hbase4:38189] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-01-08 10:56:42,916 INFO [RS:0;jenkins-hbase4:39335] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-01-08 10:56:42,916 INFO [RS:1;jenkins-hbase4:38189] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,38189,1704711332823 2024-01-08 10:56:42,916 INFO [RS:1;jenkins-hbase4:38189] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-01-08 10:56:42,916 INFO [RS:0;jenkins-hbase4:39335] regionserver.HRegionServer(3308): Received CLOSE for 0499fb4abf5cf46f848299662aa32b7f 2024-01-08 10:56:42,916 DEBUG [RS:1;jenkins-hbase4:38189] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3c7afe35 to 127.0.0.1:52049 2024-01-08 10:56:42,917 DEBUG [RS:1;jenkins-hbase4:38189] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-08 10:56:42,917 INFO [RS:1;jenkins-hbase4:38189] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,38189,1704711332823; all regions closed. 2024-01-08 10:56:42,917 DEBUG [RS:1;jenkins-hbase4:38189] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-01-08 10:56:42,917 INFO [RS:0;jenkins-hbase4:39335] regionserver.HRegionServer(3308): Received CLOSE for d883bf22d50697f3557f80c625c49171 2024-01-08 10:56:42,917 INFO [RS:0;jenkins-hbase4:39335] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:56:42,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0499fb4abf5cf46f848299662aa32b7f, disabling compactions & flushes 2024-01-08 10:56:42,918 INFO [RS:0;jenkins-hbase4:39335] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-01-08 10:56:42,918 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1704711335937.0499fb4abf5cf46f848299662aa32b7f. 2024-01-08 10:56:42,918 DEBUG [RS:0;jenkins-hbase4:39335] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x43d7c6dd to 127.0.0.1:52049 2024-01-08 10:56:42,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1704711335937.0499fb4abf5cf46f848299662aa32b7f. 2024-01-08 10:56:42,918 DEBUG [RS:0;jenkins-hbase4:39335] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-08 10:56:42,918 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1704711335937.0499fb4abf5cf46f848299662aa32b7f. after waiting 0 ms 2024-01-08 10:56:42,919 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1704711335937.0499fb4abf5cf46f848299662aa32b7f. 2024-01-08 10:56:42,919 INFO [RS:0;jenkins-hbase4:39335] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-01-08 10:56:42,919 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 0499fb4abf5cf46f848299662aa32b7f 1/1 column families, dataSize=147 B heapSize=704 B 2024-01-08 10:56:42,919 INFO [RS:0;jenkins-hbase4:39335] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-01-08 10:56:42,919 INFO [RS:0;jenkins-hbase4:39335] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-01-08 10:56:42,919 INFO [RS:0;jenkins-hbase4:39335] regionserver.HRegionServer(3308): Received CLOSE for 1588230740 2024-01-08 10:56:42,920 INFO [RS:0;jenkins-hbase4:39335] regionserver.HRegionServer(1477): Waiting on 3 regions to close 2024-01-08 10:56:42,920 DEBUG [RS:0;jenkins-hbase4:39335] regionserver.HRegionServer(1481): Online Regions={0499fb4abf5cf46f848299662aa32b7f=hbase:namespace,,1704711335937.0499fb4abf5cf46f848299662aa32b7f., d883bf22d50697f3557f80c625c49171=hbase:quota,,1704711336658.d883bf22d50697f3557f80c625c49171., 1588230740=hbase:meta,,1.1588230740} 2024-01-08 10:56:42,920 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-01-08 10:56:42,920 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-01-08 10:56:42,920 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-01-08 10:56:42,920 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-01-08 10:56:42,920 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-01-08 10:56:42,920 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=14.15 KB heapSize=25.10 KB 2024-01-08 10:56:42,922 DEBUG [RS:0;jenkins-hbase4:39335] regionserver.HRegionServer(1507): Waiting on 0499fb4abf5cf46f848299662aa32b7f, 1588230740, d883bf22d50697f3557f80c625c49171 2024-01-08 10:56:42,931 DEBUG [RS:1;jenkins-hbase4:38189] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/oldWALs 2024-01-08 10:56:42,931 INFO [RS:1;jenkins-hbase4:38189] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C38189%2C1704711332823:(num 1704711334447) 2024-01-08 10:56:42,931 DEBUG [RS:1;jenkins-hbase4:38189] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-08 10:56:42,931 INFO [RS:1;jenkins-hbase4:38189] regionserver.LeaseManager(133): Closed leases 2024-01-08 10:56:42,931 INFO [RS:1;jenkins-hbase4:38189] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2024-01-08 10:56:42,931 INFO [RS:1;jenkins-hbase4:38189] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-01-08 10:56:42,931 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-01-08 10:56:42,931 INFO [RS:1;jenkins-hbase4:38189] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-01-08 10:56:42,931 INFO [RS:1;jenkins-hbase4:38189] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-01-08 10:56:42,932 INFO [RS:1;jenkins-hbase4:38189] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:38189 2024-01-08 10:56:42,938 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): regionserver:39335-0x10106c67f690001, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38189,1704711332823 2024-01-08 10:56:42,938 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): regionserver:38189-0x10106c67f690002, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,38189,1704711332823 2024-01-08 10:56:42,938 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-01-08 10:56:42,938 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): regionserver:38189-0x10106c67f690002, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-01-08 10:56:42,938 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): regionserver:39335-0x10106c67f690001, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-01-08 10:56:42,940 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,38189,1704711332823] 2024-01-08 10:56:42,941 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,38189,1704711332823; numProcessing=1 2024-01-08 10:56:42,942 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,38189,1704711332823 already deleted, retry=false 2024-01-08 10:56:42,942 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,38189,1704711332823 expired; onlineServers=1 2024-01-08 10:56:42,957 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-01-08 10:56:42,966 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=147 B at sequenceid=8 (bloomFilter=true), to=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/namespace/0499fb4abf5cf46f848299662aa32b7f/.tmp/info/38af06b16bd144ddbf98ff027a8adb04 2024-01-08 10:56:42,966 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=12.16 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/meta/1588230740/.tmp/info/0e2d012b5f8b45109074b6f561ef3a6b 2024-01-08 10:56:42,975 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0e2d012b5f8b45109074b6f561ef3a6b 2024-01-08 10:56:42,975 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 38af06b16bd144ddbf98ff027a8adb04 2024-01-08 10:56:42,976 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-01-08 10:56:42,976 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/namespace/0499fb4abf5cf46f848299662aa32b7f/.tmp/info/38af06b16bd144ddbf98ff027a8adb04 as hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/namespace/0499fb4abf5cf46f848299662aa32b7f/info/38af06b16bd144ddbf98ff027a8adb04 2024-01-08 10:56:42,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 38af06b16bd144ddbf98ff027a8adb04 2024-01-08 10:56:42,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/namespace/0499fb4abf5cf46f848299662aa32b7f/info/38af06b16bd144ddbf98ff027a8adb04, entries=3, sequenceid=8, filesize=5.0 K 2024-01-08 10:56:42,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~147 B/147, heapSize ~688 B/688, currentSize=0 B/0 for 0499fb4abf5cf46f848299662aa32b7f in 70ms, sequenceid=8, compaction requested=false 2024-01-08 10:56:42,990 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=478 B at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/meta/1588230740/.tmp/rep_barrier/023b2a58019f470893c1f07dbf0c0bbc 2024-01-08 10:56:42,996 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/namespace/0499fb4abf5cf46f848299662aa32b7f/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=1 2024-01-08 10:56:42,997 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1704711335937.0499fb4abf5cf46f848299662aa32b7f. 2024-01-08 10:56:42,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0499fb4abf5cf46f848299662aa32b7f: 2024-01-08 10:56:42,997 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1704711335937.0499fb4abf5cf46f848299662aa32b7f. 2024-01-08 10:56:42,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing d883bf22d50697f3557f80c625c49171, disabling compactions & flushes 2024-01-08 10:56:42,998 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:quota,,1704711336658.d883bf22d50697f3557f80c625c49171. 2024-01-08 10:56:42,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1704711336658.d883bf22d50697f3557f80c625c49171. 2024-01-08 10:56:42,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1704711336658.d883bf22d50697f3557f80c625c49171. after waiting 0 ms 2024-01-08 10:56:42,998 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1704711336658.d883bf22d50697f3557f80c625c49171. 2024-01-08 10:56:42,998 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing d883bf22d50697f3557f80c625c49171 2/2 column families, dataSize=726 B heapSize=2.44 KB 2024-01-08 10:56:43,000 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 023b2a58019f470893c1f07dbf0c0bbc 2024-01-08 10:56:43,041 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): regionserver:38189-0x10106c67f690002, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-08 10:56:43,041 INFO [RS:1;jenkins-hbase4:38189] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,38189,1704711332823; zookeeper connection closed. 2024-01-08 10:56:43,041 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): regionserver:38189-0x10106c67f690002, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-08 10:56:43,041 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@14b592cf] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@14b592cf 2024-01-08 10:56:43,122 DEBUG [RS:0;jenkins-hbase4:39335] regionserver.HRegionServer(1507): Waiting on 1588230740, d883bf22d50697f3557f80c625c49171 2024-01-08 10:56:43,186 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2024-01-08 10:56:43,186 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2024-01-08 10:56:43,322 DEBUG [RS:0;jenkins-hbase4:39335] regionserver.HRegionServer(1507): Waiting on 1588230740, d883bf22d50697f3557f80c625c49171 2024-01-08 10:56:43,422 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.53 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/meta/1588230740/.tmp/table/a4de7a8d58f2424ea0421146692dd50a 2024-01-08 10:56:43,422 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=597 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/quota/d883bf22d50697f3557f80c625c49171/.tmp/q/4fb0966f5d5040b89ae4b257f8b601dd 2024-01-08 10:56:43,430 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a4de7a8d58f2424ea0421146692dd50a 2024-01-08 10:56:43,430 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4fb0966f5d5040b89ae4b257f8b601dd 2024-01-08 10:56:43,431 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/meta/1588230740/.tmp/info/0e2d012b5f8b45109074b6f561ef3a6b as hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/meta/1588230740/info/0e2d012b5f8b45109074b6f561ef3a6b 2024-01-08 10:56:43,442 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0e2d012b5f8b45109074b6f561ef3a6b 2024-01-08 10:56:43,442 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/meta/1588230740/info/0e2d012b5f8b45109074b6f561ef3a6b, entries=30, sequenceid=66, filesize=8.0 K 2024-01-08 10:56:43,444 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/meta/1588230740/.tmp/rep_barrier/023b2a58019f470893c1f07dbf0c0bbc as hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/meta/1588230740/rep_barrier/023b2a58019f470893c1f07dbf0c0bbc 2024-01-08 10:56:43,445 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=129 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/quota/d883bf22d50697f3557f80c625c49171/.tmp/u/c301091271fa4c2fbe8abd9b3d0f13b4 2024-01-08 10:56:43,452 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 023b2a58019f470893c1f07dbf0c0bbc 2024-01-08 10:56:43,452 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c301091271fa4c2fbe8abd9b3d0f13b4 2024-01-08 10:56:43,453 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/meta/1588230740/rep_barrier/023b2a58019f470893c1f07dbf0c0bbc, entries=5, sequenceid=66, filesize=5.3 K 2024-01-08 10:56:43,454 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/quota/d883bf22d50697f3557f80c625c49171/.tmp/q/4fb0966f5d5040b89ae4b257f8b601dd as hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/quota/d883bf22d50697f3557f80c625c49171/q/4fb0966f5d5040b89ae4b257f8b601dd 2024-01-08 10:56:43,454 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/meta/1588230740/.tmp/table/a4de7a8d58f2424ea0421146692dd50a as hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/meta/1588230740/table/a4de7a8d58f2424ea0421146692dd50a 2024-01-08 10:56:43,462 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a4de7a8d58f2424ea0421146692dd50a 2024-01-08 10:56:43,462 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4fb0966f5d5040b89ae4b257f8b601dd 2024-01-08 10:56:43,462 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/meta/1588230740/table/a4de7a8d58f2424ea0421146692dd50a, entries=13, sequenceid=66, filesize=5.6 K 2024-01-08 10:56:43,462 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/quota/d883bf22d50697f3557f80c625c49171/q/4fb0966f5d5040b89ae4b257f8b601dd, entries=5, sequenceid=17, filesize=5.1 K 2024-01-08 10:56:43,463 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~14.15 KB/14494, heapSize ~25.05 KB/25656, currentSize=0 B/0 for 1588230740 in 543ms, sequenceid=66, compaction requested=false 2024-01-08 10:56:43,464 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/quota/d883bf22d50697f3557f80c625c49171/.tmp/u/c301091271fa4c2fbe8abd9b3d0f13b4 as hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/quota/d883bf22d50697f3557f80c625c49171/u/c301091271fa4c2fbe8abd9b3d0f13b4 2024-01-08 10:56:43,471 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/meta/1588230740/recovered.edits/69.seqid, newMaxSeqId=69, maxSeqId=1 2024-01-08 10:56:43,472 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-01-08 10:56:43,473 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-01-08 10:56:43,473 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-01-08 10:56:43,473 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2024-01-08 10:56:43,475 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c301091271fa4c2fbe8abd9b3d0f13b4 2024-01-08 10:56:43,476 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/quota/d883bf22d50697f3557f80c625c49171/u/c301091271fa4c2fbe8abd9b3d0f13b4, entries=4, sequenceid=17, filesize=5.0 K 2024-01-08 10:56:43,477 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~726 B/726, heapSize ~2.41 KB/2464, currentSize=0 B/0 for d883bf22d50697f3557f80c625c49171 in 479ms, sequenceid=17, compaction requested=false 2024-01-08 10:56:43,483 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/data/hbase/quota/d883bf22d50697f3557f80c625c49171/recovered.edits/20.seqid, newMaxSeqId=20, maxSeqId=1 2024-01-08 10:56:43,485 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:quota,,1704711336658.d883bf22d50697f3557f80c625c49171. 2024-01-08 10:56:43,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for d883bf22d50697f3557f80c625c49171: 2024-01-08 10:56:43,485 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:quota,,1704711336658.d883bf22d50697f3557f80c625c49171. 2024-01-08 10:56:43,522 INFO [RS:0;jenkins-hbase4:39335] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,39335,1704711332778; all regions closed. 2024-01-08 10:56:43,523 DEBUG [RS:0;jenkins-hbase4:39335] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-01-08 10:56:43,529 DEBUG [RS:0;jenkins-hbase4:39335] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/oldWALs 2024-01-08 10:56:43,529 INFO [RS:0;jenkins-hbase4:39335] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39335%2C1704711332778.meta:.meta(num 1704711334763) 2024-01-08 10:56:43,536 DEBUG [RS:0;jenkins-hbase4:39335] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/oldWALs 2024-01-08 10:56:43,536 INFO [RS:0;jenkins-hbase4:39335] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39335%2C1704711332778:(num 1704711334446) 2024-01-08 10:56:43,536 DEBUG [RS:0;jenkins-hbase4:39335] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-08 10:56:43,536 INFO [RS:0;jenkins-hbase4:39335] regionserver.LeaseManager(133): Closed leases 2024-01-08 10:56:43,536 INFO [RS:0;jenkins-hbase4:39335] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2024-01-08 10:56:43,537 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-01-08 10:56:43,537 INFO [RS:0;jenkins-hbase4:39335] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39335 2024-01-08 10:56:43,540 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): regionserver:39335-0x10106c67f690001, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39335,1704711332778 2024-01-08 10:56:43,540 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-01-08 10:56:43,541 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39335,1704711332778] 2024-01-08 10:56:43,541 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39335,1704711332778; numProcessing=2 2024-01-08 10:56:43,543 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39335,1704711332778 already deleted, retry=false 2024-01-08 10:56:43,543 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,39335,1704711332778 expired; onlineServers=0 2024-01-08 10:56:43,543 INFO [RegionServerTracker-0] regionserver.HRegionServer(2300): ***** STOPPING region server 'jenkins-hbase4.apache.org,44665,1704711331544' ***** 2024-01-08 10:56:43,544 INFO [RegionServerTracker-0] regionserver.HRegionServer(2314): STOPPED: Cluster shutdown set; onlineServer=0 2024-01-08 10:56:43,544 DEBUG [M:0;jenkins-hbase4:44665] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1328a805, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-01-08 10:56:43,545 INFO [M:0;jenkins-hbase4:44665] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,44665,1704711331544 2024-01-08 10:56:43,545 INFO [M:0;jenkins-hbase4:44665] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,44665,1704711331544; all regions closed. 2024-01-08 10:56:43,545 DEBUG [M:0;jenkins-hbase4:44665] ipc.AbstractRpcClient(489): Stopping rpc client 2024-01-08 10:56:43,545 DEBUG [M:0;jenkins-hbase4:44665] cleaner.LogCleaner(198): Cancelling LogCleaner 2024-01-08 10:56:43,545 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2024-01-08 10:56:43,545 DEBUG [M:0;jenkins-hbase4:44665] cleaner.HFileCleaner(317): Stopping file delete threads 2024-01-08 10:56:43,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1704711333941] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1704711333941,5,FailOnTimeoutGroup] 2024-01-08 10:56:43,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1704711333939] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1704711333939,5,FailOnTimeoutGroup] 2024-01-08 10:56:43,545 INFO [M:0;jenkins-hbase4:44665] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2024-01-08 10:56:43,545 INFO [M:0;jenkins-hbase4:44665] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2024-01-08 10:56:43,546 INFO [M:0;jenkins-hbase4:44665] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS] on shutdown 2024-01-08 10:56:43,546 DEBUG [M:0;jenkins-hbase4:44665] master.HMaster(1517): Stopping service threads 2024-01-08 10:56:43,546 INFO [M:0;jenkins-hbase4:44665] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2024-01-08 10:56:43,546 ERROR [M:0;jenkins-hbase4:44665] procedure2.ProcedureExecutor(699): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] 2024-01-08 10:56:43,546 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master Thread[IPC Client (7217721) connection to localhost/127.0.0.1:38469 from jenkins,5,PEWorkerGroup] Thread[HFileArchiver-8,5,PEWorkerGroup] Thread[HFileArchiver-9,5,PEWorkerGroup] 2024-01-08 10:56:43,546 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase Thread[HFileArchiver-10,5,PEWorkerGroup] Thread[HFileArchiver-11,5,PEWorkerGroup] Thread[HFileArchiver-12,5,PEWorkerGroup] 2024-01-08 10:56:43,547 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-01-08 10:56:43,547 INFO [M:0;jenkins-hbase4:44665] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2024-01-08 10:56:43,547 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2024-01-08 10:56:43,548 DEBUG [M:0;jenkins-hbase4:44665] zookeeper.ZKUtil(399): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2024-01-08 10:56:43,548 WARN [M:0;jenkins-hbase4:44665] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2024-01-08 10:56:43,548 INFO [M:0;jenkins-hbase4:44665] assignment.AssignmentManager(315): Stopping assignment manager 2024-01-08 10:56:43,548 INFO [M:0;jenkins-hbase4:44665] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2024-01-08 10:56:43,548 DEBUG [M:0;jenkins-hbase4:44665] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-01-08 10:56:43,549 INFO [M:0;jenkins-hbase4:44665] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-08 10:56:43,549 DEBUG [M:0;jenkins-hbase4:44665] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-08 10:56:43,549 DEBUG [M:0;jenkins-hbase4:44665] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-01-08 10:56:43,549 DEBUG [M:0;jenkins-hbase4:44665] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-08 10:56:43,549 INFO [M:0;jenkins-hbase4:44665] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=152.91 KB heapSize=184.78 KB 2024-01-08 10:56:43,566 INFO [M:0;jenkins-hbase4:44665] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=152.91 KB at sequenceid=376 (bloomFilter=true), to=hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8b1e0e21eed04b3faef22713dc0f5ce9 2024-01-08 10:56:43,572 INFO [M:0;jenkins-hbase4:44665] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8b1e0e21eed04b3faef22713dc0f5ce9 2024-01-08 10:56:43,573 DEBUG [M:0;jenkins-hbase4:44665] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/8b1e0e21eed04b3faef22713dc0f5ce9 as hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8b1e0e21eed04b3faef22713dc0f5ce9 2024-01-08 10:56:43,579 INFO [M:0;jenkins-hbase4:44665] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8b1e0e21eed04b3faef22713dc0f5ce9 2024-01-08 10:56:43,580 INFO [M:0;jenkins-hbase4:44665] regionserver.HStore(1080): Added hdfs://localhost:38469/user/jenkins/test-data/7783fa09-b287-0df2-a4f0-b17989666840/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/8b1e0e21eed04b3faef22713dc0f5ce9, entries=45, sequenceid=376, filesize=12.0 K 2024-01-08 10:56:43,581 INFO [M:0;jenkins-hbase4:44665] regionserver.HRegion(2948): Finished flush of dataSize ~152.91 KB/156583, heapSize ~184.77 KB/189200, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 32ms, sequenceid=376, compaction requested=false 2024-01-08 10:56:43,582 INFO [M:0;jenkins-hbase4:44665] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-01-08 10:56:43,582 DEBUG [M:0;jenkins-hbase4:44665] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-01-08 10:56:43,586 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-01-08 10:56:43,586 INFO [M:0;jenkins-hbase4:44665] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2024-01-08 10:56:43,587 INFO [M:0;jenkins-hbase4:44665] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:44665 2024-01-08 10:56:43,588 DEBUG [M:0;jenkins-hbase4:44665] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,44665,1704711331544 already deleted, retry=false 2024-01-08 10:56:43,642 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): regionserver:39335-0x10106c67f690001, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-08 10:56:43,642 INFO [RS:0;jenkins-hbase4:39335] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,39335,1704711332778; zookeeper connection closed. 2024-01-08 10:56:43,642 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): regionserver:39335-0x10106c67f690001, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-08 10:56:43,642 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@592e7a88] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@592e7a88 2024-01-08 10:56:43,642 INFO [Listener at localhost/34349] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2024-01-08 10:56:43,690 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-08 10:56:43,690 INFO [M:0;jenkins-hbase4:44665] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,44665,1704711331544; zookeeper connection closed. 2024-01-08 10:56:43,690 DEBUG [Listener at localhost/34349-EventThread] zookeeper.ZKWatcher(600): master:44665-0x10106c67f690000, quorum=127.0.0.1:52049, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-01-08 10:56:43,692 WARN [Listener at localhost/34349] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-01-08 10:56:43,695 INFO [Listener at localhost/34349] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-01-08 10:56:43,801 WARN [BP-1894690913-172.31.14.131-1704711328209 heartbeating to localhost/127.0.0.1:38469] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-01-08 10:56:43,801 WARN [BP-1894690913-172.31.14.131-1704711328209 heartbeating to localhost/127.0.0.1:38469] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1894690913-172.31.14.131-1704711328209 (Datanode Uuid 50255a6e-424e-44b2-9393-8da468798590) service to localhost/127.0.0.1:38469 2024-01-08 10:56:43,802 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/cluster_bcadc389-5d61-62b6-5c09-06ca34aa64a2/dfs/data/data3/current/BP-1894690913-172.31.14.131-1704711328209] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-01-08 10:56:43,803 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/cluster_bcadc389-5d61-62b6-5c09-06ca34aa64a2/dfs/data/data4/current/BP-1894690913-172.31.14.131-1704711328209] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-01-08 10:56:43,804 WARN [Listener at localhost/34349] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-01-08 10:56:43,806 INFO [Listener at localhost/34349] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-01-08 10:56:43,910 WARN [BP-1894690913-172.31.14.131-1704711328209 heartbeating to localhost/127.0.0.1:38469] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-01-08 10:56:43,910 WARN [BP-1894690913-172.31.14.131-1704711328209 heartbeating to localhost/127.0.0.1:38469] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1894690913-172.31.14.131-1704711328209 (Datanode Uuid 1a36a8dc-33f7-4928-a6f9-de7cadd8426c) service to localhost/127.0.0.1:38469 2024-01-08 10:56:43,910 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/cluster_bcadc389-5d61-62b6-5c09-06ca34aa64a2/dfs/data/data1/current/BP-1894690913-172.31.14.131-1704711328209] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-01-08 10:56:43,911 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/32d1c04f-9fa1-322c-8a6c-f5fab0c91879/cluster_bcadc389-5d61-62b6-5c09-06ca34aa64a2/dfs/data/data2/current/BP-1894690913-172.31.14.131-1704711328209] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-01-08 10:56:43,947 INFO [Listener at localhost/34349] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-01-08 10:56:44,065 INFO [Listener at localhost/34349] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2024-01-08 10:56:44,102 INFO [Listener at localhost/34349] hbase.HBaseTestingUtility(1293): Minicluster is down