2024-03-15 18:55:45,343 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle timeout: 13 mins 2024-03-15 18:55:45,566 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d 2024-03-15 18:55:45,581 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2024-03-15 18:55:45,582 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/cluster_06008907-b92e-1bc0-e4db-cb8d5189be26, deleteOnExit=true 2024-03-15 18:55:45,582 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2024-03-15 18:55:45,582 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/test.cache.data in system properties and HBase conf 2024-03-15 18:55:45,583 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/hadoop.tmp.dir in system properties and HBase conf 2024-03-15 18:55:45,583 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/hadoop.log.dir in system properties and HBase conf 2024-03-15 18:55:45,584 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/mapreduce.cluster.local.dir in system properties and HBase conf 2024-03-15 18:55:45,584 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/mapreduce.cluster.temp.dir in system properties and HBase conf 2024-03-15 18:55:45,584 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2024-03-15 18:55:45,703 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2024-03-15 18:55:46,112 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-03-15 18:55:46,117 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2024-03-15 18:55:46,117 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2024-03-15 18:55:46,118 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/yarn.nodemanager.log-dirs in system properties and HBase conf 2024-03-15 18:55:46,118 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-03-15 18:55:46,118 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2024-03-15 18:55:46,119 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2024-03-15 18:55:46,119 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-03-15 18:55:46,119 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/dfs.journalnode.edits.dir in system properties and HBase conf 2024-03-15 18:55:46,120 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2024-03-15 18:55:46,120 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/nfs.dump.dir in system properties and HBase conf 2024-03-15 18:55:46,121 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/java.io.tmpdir in system properties and HBase conf 2024-03-15 18:55:46,121 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/dfs.journalnode.edits.dir in system properties and HBase conf 2024-03-15 18:55:46,122 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2024-03-15 18:55:46,122 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2024-03-15 18:55:46,648 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-03-15 18:55:46,654 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-03-15 18:55:46,961 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2024-03-15 18:55:47,135 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2024-03-15 18:55:47,150 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-03-15 18:55:47,187 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2024-03-15 18:55:47,220 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/java.io.tmpdir/Jetty_localhost_41675_hdfs____.jpfy3j/webapp 2024-03-15 18:55:47,362 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:41675 2024-03-15 18:55:47,372 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-03-15 18:55:47,373 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-03-15 18:55:47,838 WARN [Listener at localhost/33087] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-03-15 18:55:47,906 WARN [Listener at localhost/33087] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-03-15 18:55:47,924 WARN [Listener at localhost/33087] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-03-15 18:55:47,930 INFO [Listener at localhost/33087] log.Slf4jLog(67): jetty-6.1.26 2024-03-15 18:55:47,935 INFO [Listener at localhost/33087] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/java.io.tmpdir/Jetty_localhost_42291_datanode____.xzfh59/webapp 2024-03-15 18:55:48,032 INFO [Listener at localhost/33087] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42291 2024-03-15 18:55:48,333 WARN [Listener at localhost/35307] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-03-15 18:55:48,344 WARN [Listener at localhost/35307] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-03-15 18:55:48,347 WARN [Listener at localhost/35307] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-03-15 18:55:48,349 INFO [Listener at localhost/35307] log.Slf4jLog(67): jetty-6.1.26 2024-03-15 18:55:48,356 INFO [Listener at localhost/35307] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/java.io.tmpdir/Jetty_localhost_37641_datanode____.s2uloq/webapp 2024-03-15 18:55:48,460 INFO [Listener at localhost/35307] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:37641 2024-03-15 18:55:48,468 WARN [Listener at localhost/33103] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-03-15 18:55:48,779 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x37e754e4c221d836: Processing first storage report for DS-61a02d57-b826-4d70-a286-1c01fa5722cd from datanode 7d0299ed-be4c-46e6-be55-d2b6048cf92d 2024-03-15 18:55:48,781 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x37e754e4c221d836: from storage DS-61a02d57-b826-4d70-a286-1c01fa5722cd node DatanodeRegistration(127.0.0.1:32845, datanodeUuid=7d0299ed-be4c-46e6-be55-d2b6048cf92d, infoPort=46383, infoSecurePort=0, ipcPort=35307, storageInfo=lv=-57;cid=testClusterID;nsid=826385145;c=1710528946734), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2024-03-15 18:55:48,782 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa9e5e06eafc01af6: Processing first storage report for DS-f0821978-6e07-40a7-b75a-b1658728867c from datanode 809f1f01-efaf-4c41-b57a-4be300f0c8dc 2024-03-15 18:55:48,782 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa9e5e06eafc01af6: from storage DS-f0821978-6e07-40a7-b75a-b1658728867c node DatanodeRegistration(127.0.0.1:40785, datanodeUuid=809f1f01-efaf-4c41-b57a-4be300f0c8dc, infoPort=38131, infoSecurePort=0, ipcPort=33103, storageInfo=lv=-57;cid=testClusterID;nsid=826385145;c=1710528946734), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2024-03-15 18:55:48,782 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x37e754e4c221d836: Processing first storage report for DS-a7f3bc81-0f25-49c6-b296-97ba8b768443 from datanode 7d0299ed-be4c-46e6-be55-d2b6048cf92d 2024-03-15 18:55:48,782 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x37e754e4c221d836: from storage DS-a7f3bc81-0f25-49c6-b296-97ba8b768443 node DatanodeRegistration(127.0.0.1:32845, datanodeUuid=7d0299ed-be4c-46e6-be55-d2b6048cf92d, infoPort=46383, infoSecurePort=0, ipcPort=35307, storageInfo=lv=-57;cid=testClusterID;nsid=826385145;c=1710528946734), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2024-03-15 18:55:48,783 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa9e5e06eafc01af6: Processing first storage report for DS-aa32eb4c-22bf-4818-80ab-ed682bb233c0 from datanode 809f1f01-efaf-4c41-b57a-4be300f0c8dc 2024-03-15 18:55:48,783 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa9e5e06eafc01af6: from storage DS-aa32eb4c-22bf-4818-80ab-ed682bb233c0 node DatanodeRegistration(127.0.0.1:40785, datanodeUuid=809f1f01-efaf-4c41-b57a-4be300f0c8dc, infoPort=38131, infoSecurePort=0, ipcPort=33103, storageInfo=lv=-57;cid=testClusterID;nsid=826385145;c=1710528946734), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-03-15 18:55:48,870 DEBUG [Listener at localhost/33103] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d 2024-03-15 18:55:48,983 INFO [Listener at localhost/33103] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/cluster_06008907-b92e-1bc0-e4db-cb8d5189be26/zookeeper_0, clientPort=63302, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/cluster_06008907-b92e-1bc0-e4db-cb8d5189be26/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/cluster_06008907-b92e-1bc0-e4db-cb8d5189be26/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2024-03-15 18:55:48,999 INFO [Listener at localhost/33103] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=63302 2024-03-15 18:55:49,007 INFO [Listener at localhost/33103] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-15 18:55:49,008 INFO [Listener at localhost/33103] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-15 18:55:49,694 INFO [Listener at localhost/33103] util.FSUtils(471): Created version file at hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6 with version=8 2024-03-15 18:55:49,694 INFO [Listener at localhost/33103] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/hbase-staging 2024-03-15 18:55:50,025 INFO [Listener at localhost/33103] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2024-03-15 18:55:50,489 INFO [Listener at localhost/33103] client.ConnectionUtils(126): master/jenkins-hbase4:0 server-side Connection retries=45 2024-03-15 18:55:50,523 INFO [Listener at localhost/33103] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-15 18:55:50,523 INFO [Listener at localhost/33103] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-03-15 18:55:50,524 INFO [Listener at localhost/33103] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-03-15 18:55:50,524 INFO [Listener at localhost/33103] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-15 18:55:50,524 INFO [Listener at localhost/33103] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-03-15 18:55:50,672 INFO [Listener at localhost/33103] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2024-03-15 18:55:50,755 DEBUG [Listener at localhost/33103] util.ClassSize(228): Using Unsafe to estimate memory layout 2024-03-15 18:55:50,853 INFO [Listener at localhost/33103] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35499 2024-03-15 18:55:50,863 INFO [Listener at localhost/33103] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-15 18:55:50,865 INFO [Listener at localhost/33103] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-15 18:55:50,887 INFO [Listener at localhost/33103] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35499 connecting to ZooKeeper ensemble=127.0.0.1:63302 2024-03-15 18:55:50,929 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:354990x0, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-03-15 18:55:50,931 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:35499-0x10068d932620000 connected 2024-03-15 18:55:50,961 DEBUG [Listener at localhost/33103] zookeeper.ZKUtil(165): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-03-15 18:55:50,962 DEBUG [Listener at localhost/33103] zookeeper.ZKUtil(165): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-15 18:55:50,965 DEBUG [Listener at localhost/33103] zookeeper.ZKUtil(165): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-03-15 18:55:50,973 DEBUG [Listener at localhost/33103] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35499 2024-03-15 18:55:50,974 DEBUG [Listener at localhost/33103] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35499 2024-03-15 18:55:50,974 DEBUG [Listener at localhost/33103] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35499 2024-03-15 18:55:50,974 DEBUG [Listener at localhost/33103] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35499 2024-03-15 18:55:50,975 DEBUG [Listener at localhost/33103] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35499 2024-03-15 18:55:50,981 INFO [Listener at localhost/33103] master.HMaster(445): hbase.rootdir=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6, hbase.cluster.distributed=false 2024-03-15 18:55:51,051 INFO [Listener at localhost/33103] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-03-15 18:55:51,052 INFO [Listener at localhost/33103] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-15 18:55:51,052 INFO [Listener at localhost/33103] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-03-15 18:55:51,052 INFO [Listener at localhost/33103] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-03-15 18:55:51,052 INFO [Listener at localhost/33103] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-15 18:55:51,052 INFO [Listener at localhost/33103] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-03-15 18:55:51,057 INFO [Listener at localhost/33103] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-03-15 18:55:51,060 INFO [Listener at localhost/33103] ipc.NettyRpcServer(120): Bind to /172.31.14.131:39929 2024-03-15 18:55:51,062 INFO [Listener at localhost/33103] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-03-15 18:55:51,068 DEBUG [Listener at localhost/33103] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-03-15 18:55:51,070 INFO [Listener at localhost/33103] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-15 18:55:51,071 INFO [Listener at localhost/33103] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-15 18:55:51,073 INFO [Listener at localhost/33103] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:39929 connecting to ZooKeeper ensemble=127.0.0.1:63302 2024-03-15 18:55:51,077 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): regionserver:399290x0, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-03-15 18:55:51,078 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:39929-0x10068d932620001 connected 2024-03-15 18:55:51,078 DEBUG [Listener at localhost/33103] zookeeper.ZKUtil(165): regionserver:39929-0x10068d932620001, quorum=127.0.0.1:63302, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-03-15 18:55:51,079 DEBUG [Listener at localhost/33103] zookeeper.ZKUtil(165): regionserver:39929-0x10068d932620001, quorum=127.0.0.1:63302, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-15 18:55:51,080 DEBUG [Listener at localhost/33103] zookeeper.ZKUtil(165): regionserver:39929-0x10068d932620001, quorum=127.0.0.1:63302, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-03-15 18:55:51,081 DEBUG [Listener at localhost/33103] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=39929 2024-03-15 18:55:51,081 DEBUG [Listener at localhost/33103] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=39929 2024-03-15 18:55:51,082 DEBUG [Listener at localhost/33103] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=39929 2024-03-15 18:55:51,082 DEBUG [Listener at localhost/33103] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=39929 2024-03-15 18:55:51,083 DEBUG [Listener at localhost/33103] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=39929 2024-03-15 18:55:51,095 INFO [Listener at localhost/33103] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-03-15 18:55:51,095 INFO [Listener at localhost/33103] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-15 18:55:51,095 INFO [Listener at localhost/33103] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-03-15 18:55:51,096 INFO [Listener at localhost/33103] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-03-15 18:55:51,096 INFO [Listener at localhost/33103] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-15 18:55:51,096 INFO [Listener at localhost/33103] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-03-15 18:55:51,096 INFO [Listener at localhost/33103] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-03-15 18:55:51,098 INFO [Listener at localhost/33103] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45283 2024-03-15 18:55:51,098 INFO [Listener at localhost/33103] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-03-15 18:55:51,099 DEBUG [Listener at localhost/33103] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-03-15 18:55:51,100 INFO [Listener at localhost/33103] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-15 18:55:51,102 INFO [Listener at localhost/33103] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-15 18:55:51,105 INFO [Listener at localhost/33103] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45283 connecting to ZooKeeper ensemble=127.0.0.1:63302 2024-03-15 18:55:51,110 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): regionserver:452830x0, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-03-15 18:55:51,111 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45283-0x10068d932620002 connected 2024-03-15 18:55:51,111 DEBUG [Listener at localhost/33103] zookeeper.ZKUtil(165): regionserver:45283-0x10068d932620002, quorum=127.0.0.1:63302, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-03-15 18:55:51,112 DEBUG [Listener at localhost/33103] zookeeper.ZKUtil(165): regionserver:45283-0x10068d932620002, quorum=127.0.0.1:63302, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-15 18:55:51,113 DEBUG [Listener at localhost/33103] zookeeper.ZKUtil(165): regionserver:45283-0x10068d932620002, quorum=127.0.0.1:63302, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-03-15 18:55:51,113 DEBUG [Listener at localhost/33103] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45283 2024-03-15 18:55:51,113 DEBUG [Listener at localhost/33103] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45283 2024-03-15 18:55:51,114 DEBUG [Listener at localhost/33103] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45283 2024-03-15 18:55:51,115 DEBUG [Listener at localhost/33103] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45283 2024-03-15 18:55:51,115 DEBUG [Listener at localhost/33103] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45283 2024-03-15 18:55:51,117 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2174): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35499,1710528949842 2024-03-15 18:55:51,126 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-03-15 18:55:51,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35499,1710528949842 2024-03-15 18:55:51,147 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): regionserver:45283-0x10068d932620002, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-03-15 18:55:51,147 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-03-15 18:55:51,147 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): regionserver:39929-0x10068d932620001, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-03-15 18:55:51,147 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-15 18:55:51,149 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-03-15 18:55:51,150 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35499,1710528949842 from backup master directory 2024-03-15 18:55:51,151 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(163): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-03-15 18:55:51,154 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35499,1710528949842 2024-03-15 18:55:51,154 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-03-15 18:55:51,154 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-03-15 18:55:51,155 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,35499,1710528949842 2024-03-15 18:55:51,157 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2024-03-15 18:55:51,159 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2024-03-15 18:55:51,246 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/hbase.id with ID: eddda7d7-cd13-4b81-bfe8-f9025c9cf78e 2024-03-15 18:55:51,291 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-15 18:55:51,305 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-15 18:55:51,348 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x39fb4f42 to 127.0.0.1:63302 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-03-15 18:55:51,383 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2f1bccab, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-03-15 18:55:51,406 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-15 18:55:51,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2024-03-15 18:55:51,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2024-03-15 18:55:51,426 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2024-03-15 18:55:51,427 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-03-15 18:55:51,431 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-03-15 18:55:51,433 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-03-15 18:55:51,467 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/MasterData/data/master/store-tmp 2024-03-15 18:55:51,502 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-15 18:55:51,502 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-03-15 18:55:51,502 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-15 18:55:51,503 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-15 18:55:51,503 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-03-15 18:55:51,503 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-15 18:55:51,503 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-15 18:55:51,503 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-03-15 18:55:51,505 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/MasterData/WALs/jenkins-hbase4.apache.org,35499,1710528949842 2024-03-15 18:55:51,525 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35499%2C1710528949842, suffix=, logDir=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/MasterData/WALs/jenkins-hbase4.apache.org,35499,1710528949842, archiveDir=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/MasterData/oldWALs, maxLogs=10 2024-03-15 18:55:51,585 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40785,DS-f0821978-6e07-40a7-b75a-b1658728867c,DISK] 2024-03-15 18:55:51,585 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32845,DS-61a02d57-b826-4d70-a286-1c01fa5722cd,DISK] 2024-03-15 18:55:51,593 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2024-03-15 18:55:51,663 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/MasterData/WALs/jenkins-hbase4.apache.org,35499,1710528949842/jenkins-hbase4.apache.org%2C35499%2C1710528949842.1710528951535 2024-03-15 18:55:51,663 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32845,DS-61a02d57-b826-4d70-a286-1c01fa5722cd,DISK], DatanodeInfoWithStorage[127.0.0.1:40785,DS-f0821978-6e07-40a7-b75a-b1658728867c,DISK]] 2024-03-15 18:55:51,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2024-03-15 18:55:51,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-15 18:55:51,668 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2024-03-15 18:55:51,670 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2024-03-15 18:55:51,727 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2024-03-15 18:55:51,734 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2024-03-15 18:55:51,758 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2024-03-15 18:55:51,771 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-15 18:55:51,777 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-03-15 18:55:51,778 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-03-15 18:55:51,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2024-03-15 18:55:51,798 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-15 18:55:51,799 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71427344, jitterRate=0.06435036659240723}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-15 18:55:51,799 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2024-03-15 18:55:51,801 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2024-03-15 18:55:51,820 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2024-03-15 18:55:51,820 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(608): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2024-03-15 18:55:51,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2024-03-15 18:55:51,823 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(628): Recovered RegionProcedureStore lease in 1 msec 2024-03-15 18:55:51,856 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(642): Loaded RegionProcedureStore in 32 msec 2024-03-15 18:55:51,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2024-03-15 18:55:51,882 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2024-03-15 18:55:51,888 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2024-03-15 18:55:51,914 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2024-03-15 18:55:51,917 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2024-03-15 18:55:51,919 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2024-03-15 18:55:51,924 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2024-03-15 18:55:51,929 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2024-03-15 18:55:51,933 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-15 18:55:51,934 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2024-03-15 18:55:51,935 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2024-03-15 18:55:51,947 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2024-03-15 18:55:51,952 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): regionserver:39929-0x10068d932620001, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-03-15 18:55:51,952 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): regionserver:45283-0x10068d932620002, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-03-15 18:55:51,952 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-03-15 18:55:51,953 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-15 18:55:51,954 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(745): Active/primary master=jenkins-hbase4.apache.org,35499,1710528949842, sessionid=0x10068d932620000, setting cluster-up flag (Was=false) 2024-03-15 18:55:51,971 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-15 18:55:51,978 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2024-03-15 18:55:51,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35499,1710528949842 2024-03-15 18:55:51,986 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-15 18:55:51,993 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2024-03-15 18:55:51,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35499,1710528949842 2024-03-15 18:55:51,998 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.hbase-snapshot/.tmp 2024-03-15 18:55:52,019 INFO [RS:1;jenkins-hbase4:45283] regionserver.HRegionServer(954): ClusterId : eddda7d7-cd13-4b81-bfe8-f9025c9cf78e 2024-03-15 18:55:52,019 INFO [RS:0;jenkins-hbase4:39929] regionserver.HRegionServer(954): ClusterId : eddda7d7-cd13-4b81-bfe8-f9025c9cf78e 2024-03-15 18:55:52,025 DEBUG [RS:0;jenkins-hbase4:39929] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-03-15 18:55:52,025 DEBUG [RS:1;jenkins-hbase4:45283] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-03-15 18:55:52,032 DEBUG [RS:0;jenkins-hbase4:39929] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-03-15 18:55:52,032 DEBUG [RS:0;jenkins-hbase4:39929] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-03-15 18:55:52,032 DEBUG [RS:1;jenkins-hbase4:45283] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-03-15 18:55:52,032 DEBUG [RS:1;jenkins-hbase4:45283] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-03-15 18:55:52,035 DEBUG [RS:0;jenkins-hbase4:39929] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-03-15 18:55:52,036 DEBUG [RS:1;jenkins-hbase4:45283] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-03-15 18:55:52,038 DEBUG [RS:0;jenkins-hbase4:39929] zookeeper.ReadOnlyZKClient(139): Connect 0x166a049f to 127.0.0.1:63302 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-03-15 18:55:52,039 DEBUG [RS:1;jenkins-hbase4:45283] zookeeper.ReadOnlyZKClient(139): Connect 0x7660be28 to 127.0.0.1:63302 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-03-15 18:55:52,044 DEBUG [RS:0;jenkins-hbase4:39929] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@18adf822, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-03-15 18:55:52,045 DEBUG [RS:0;jenkins-hbase4:39929] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1c926fef, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-03-15 18:55:52,045 DEBUG [RS:1;jenkins-hbase4:45283] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78a74e94, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-03-15 18:55:52,045 DEBUG [RS:1;jenkins-hbase4:45283] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7c98d558, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-03-15 18:55:52,053 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver loaded, priority=536870911. 2024-03-15 18:55:52,068 DEBUG [RS:0;jenkins-hbase4:39929] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:39929 2024-03-15 18:55:52,068 DEBUG [RS:1;jenkins-hbase4:45283] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:45283 2024-03-15 18:55:52,072 INFO [RS:0;jenkins-hbase4:39929] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-03-15 18:55:52,072 INFO [RS:1;jenkins-hbase4:45283] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-03-15 18:55:52,073 INFO [RS:0;jenkins-hbase4:39929] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-03-15 18:55:52,073 INFO [RS:1;jenkins-hbase4:45283] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-03-15 18:55:52,073 DEBUG [RS:0;jenkins-hbase4:39929] regionserver.HRegionServer(1025): About to register with Master. 2024-03-15 18:55:52,073 DEBUG [RS:1;jenkins-hbase4:45283] regionserver.HRegionServer(1025): About to register with Master. 2024-03-15 18:55:52,076 INFO [RS:0;jenkins-hbase4:39929] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase4.apache.org,35499,1710528949842 with isa=jenkins-hbase4.apache.org/172.31.14.131:39929, startcode=1710528951051 2024-03-15 18:55:52,076 INFO [RS:1;jenkins-hbase4:45283] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase4.apache.org,35499,1710528949842 with isa=jenkins-hbase4.apache.org/172.31.14.131:45283, startcode=1710528951095 2024-03-15 18:55:52,096 DEBUG [RS:1;jenkins-hbase4:45283] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-03-15 18:55:52,096 DEBUG [RS:0;jenkins-hbase4:39929] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-03-15 18:55:52,145 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2024-03-15 18:55:52,155 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-03-15 18:55:52,156 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-03-15 18:55:52,156 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-03-15 18:55:52,156 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:36259, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2024-03-15 18:55:52,156 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51089, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2024-03-15 18:55:52,156 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-03-15 18:55:52,157 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2024-03-15 18:55:52,157 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-15 18:55:52,157 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-03-15 18:55:52,157 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-15 18:55:52,160 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1710528982160 2024-03-15 18:55:52,163 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2024-03-15 18:55:52,166 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35499] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2838) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15910) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2024-03-15 18:55:52,166 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2024-03-15 18:55:52,166 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2024-03-15 18:55:52,173 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-03-15 18:55:52,175 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2024-03-15 18:55:52,176 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35499] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2838) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15910) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2024-03-15 18:55:52,185 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2024-03-15 18:55:52,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2024-03-15 18:55:52,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2024-03-15 18:55:52,186 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2024-03-15 18:55:52,187 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:52,190 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2024-03-15 18:55:52,191 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2024-03-15 18:55:52,192 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2024-03-15 18:55:52,195 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2024-03-15 18:55:52,196 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2024-03-15 18:55:52,198 DEBUG [RS:0;jenkins-hbase4:39929] regionserver.HRegionServer(2832): Master is not running yet 2024-03-15 18:55:52,198 DEBUG [RS:1;jenkins-hbase4:45283] regionserver.HRegionServer(2832): Master is not running yet 2024-03-15 18:55:52,198 WARN [RS:0;jenkins-hbase4:39929] regionserver.HRegionServer(1033): reportForDuty failed; sleeping 100 ms and then retrying. 2024-03-15 18:55:52,198 WARN [RS:1;jenkins-hbase4:45283] regionserver.HRegionServer(1033): reportForDuty failed; sleeping 100 ms and then retrying. 2024-03-15 18:55:52,199 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1710528952198,5,FailOnTimeoutGroup] 2024-03-15 18:55:52,200 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1710528952200,5,FailOnTimeoutGroup] 2024-03-15 18:55:52,200 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:52,200 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1466): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2024-03-15 18:55:52,201 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:52,202 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:52,215 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-03-15 18:55:52,216 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-03-15 18:55:52,216 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6 2024-03-15 18:55:52,233 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-15 18:55:52,236 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-03-15 18:55:52,239 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/meta/1588230740/info 2024-03-15 18:55:52,240 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-03-15 18:55:52,241 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-15 18:55:52,241 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-03-15 18:55:52,244 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/meta/1588230740/rep_barrier 2024-03-15 18:55:52,244 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-03-15 18:55:52,245 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-15 18:55:52,246 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-03-15 18:55:52,248 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/meta/1588230740/table 2024-03-15 18:55:52,248 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-03-15 18:55:52,249 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-15 18:55:52,250 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/meta/1588230740 2024-03-15 18:55:52,251 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/meta/1588230740 2024-03-15 18:55:52,255 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-03-15 18:55:52,257 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2024-03-15 18:55:52,261 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-15 18:55:52,262 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66506469, jitterRate=-0.008976384997367859}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-03-15 18:55:52,262 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2024-03-15 18:55:52,262 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-03-15 18:55:52,262 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-03-15 18:55:52,262 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-03-15 18:55:52,262 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-03-15 18:55:52,263 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-03-15 18:55:52,263 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-03-15 18:55:52,264 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-03-15 18:55:52,268 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2024-03-15 18:55:52,268 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2024-03-15 18:55:52,276 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2024-03-15 18:55:52,289 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2024-03-15 18:55:52,291 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2024-03-15 18:55:52,299 INFO [RS:0;jenkins-hbase4:39929] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase4.apache.org,35499,1710528949842 with isa=jenkins-hbase4.apache.org/172.31.14.131:39929, startcode=1710528951051 2024-03-15 18:55:52,299 INFO [RS:1;jenkins-hbase4:45283] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase4.apache.org,35499,1710528949842 with isa=jenkins-hbase4.apache.org/172.31.14.131:45283, startcode=1710528951095 2024-03-15 18:55:52,305 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35499] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,39929,1710528951051 2024-03-15 18:55:52,310 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35499] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,45283,1710528951095 2024-03-15 18:55:52,311 DEBUG [RS:0;jenkins-hbase4:39929] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6 2024-03-15 18:55:52,311 DEBUG [RS:0;jenkins-hbase4:39929] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:33087 2024-03-15 18:55:52,311 DEBUG [RS:0;jenkins-hbase4:39929] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-03-15 18:55:52,311 DEBUG [RS:1;jenkins-hbase4:45283] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6 2024-03-15 18:55:52,311 DEBUG [RS:1;jenkins-hbase4:45283] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:33087 2024-03-15 18:55:52,311 DEBUG [RS:1;jenkins-hbase4:45283] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-03-15 18:55:52,319 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-03-15 18:55:52,319 DEBUG [RS:0;jenkins-hbase4:39929] zookeeper.ZKUtil(163): regionserver:39929-0x10068d932620001, quorum=127.0.0.1:63302, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39929,1710528951051 2024-03-15 18:55:52,319 DEBUG [RS:1;jenkins-hbase4:45283] zookeeper.ZKUtil(163): regionserver:45283-0x10068d932620002, quorum=127.0.0.1:63302, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45283,1710528951095 2024-03-15 18:55:52,319 WARN [RS:0;jenkins-hbase4:39929] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-03-15 18:55:52,321 WARN [RS:1;jenkins-hbase4:45283] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-03-15 18:55:52,321 INFO [RS:0;jenkins-hbase4:39929] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-03-15 18:55:52,321 INFO [RS:1;jenkins-hbase4:45283] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-03-15 18:55:52,322 DEBUG [RS:0;jenkins-hbase4:39929] regionserver.HRegionServer(1950): logDir=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/WALs/jenkins-hbase4.apache.org,39929,1710528951051 2024-03-15 18:55:52,322 DEBUG [RS:1;jenkins-hbase4:45283] regionserver.HRegionServer(1950): logDir=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/WALs/jenkins-hbase4.apache.org,45283,1710528951095 2024-03-15 18:55:52,322 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,39929,1710528951051] 2024-03-15 18:55:52,322 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45283,1710528951095] 2024-03-15 18:55:52,333 DEBUG [RS:1;jenkins-hbase4:45283] zookeeper.ZKUtil(163): regionserver:45283-0x10068d932620002, quorum=127.0.0.1:63302, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39929,1710528951051 2024-03-15 18:55:52,333 DEBUG [RS:0;jenkins-hbase4:39929] zookeeper.ZKUtil(163): regionserver:39929-0x10068d932620001, quorum=127.0.0.1:63302, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,39929,1710528951051 2024-03-15 18:55:52,333 DEBUG [RS:1;jenkins-hbase4:45283] zookeeper.ZKUtil(163): regionserver:45283-0x10068d932620002, quorum=127.0.0.1:63302, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45283,1710528951095 2024-03-15 18:55:52,333 DEBUG [RS:0;jenkins-hbase4:39929] zookeeper.ZKUtil(163): regionserver:39929-0x10068d932620001, quorum=127.0.0.1:63302, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45283,1710528951095 2024-03-15 18:55:52,344 DEBUG [RS:1;jenkins-hbase4:45283] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-03-15 18:55:52,344 DEBUG [RS:0;jenkins-hbase4:39929] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-03-15 18:55:52,353 INFO [RS:0;jenkins-hbase4:39929] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-03-15 18:55:52,353 INFO [RS:1;jenkins-hbase4:45283] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-03-15 18:55:52,372 INFO [RS:0;jenkins-hbase4:39929] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-03-15 18:55:52,372 INFO [RS:1;jenkins-hbase4:45283] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-03-15 18:55:52,375 INFO [RS:0;jenkins-hbase4:39929] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-03-15 18:55:52,375 INFO [RS:1;jenkins-hbase4:45283] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-03-15 18:55:52,376 INFO [RS:0;jenkins-hbase4:39929] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:52,376 INFO [RS:1;jenkins-hbase4:45283] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:52,377 INFO [RS:0;jenkins-hbase4:39929] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-03-15 18:55:52,377 INFO [RS:1;jenkins-hbase4:45283] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-03-15 18:55:52,385 INFO [RS:1;jenkins-hbase4:45283] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:52,385 INFO [RS:0;jenkins-hbase4:39929] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:52,385 DEBUG [RS:1;jenkins-hbase4:45283] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-15 18:55:52,385 DEBUG [RS:0;jenkins-hbase4:39929] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-15 18:55:52,385 DEBUG [RS:1;jenkins-hbase4:45283] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-15 18:55:52,385 DEBUG [RS:0;jenkins-hbase4:39929] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-15 18:55:52,386 DEBUG [RS:1;jenkins-hbase4:45283] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-15 18:55:52,386 DEBUG [RS:0;jenkins-hbase4:39929] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-15 18:55:52,386 DEBUG [RS:1;jenkins-hbase4:45283] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-15 18:55:52,386 DEBUG [RS:0;jenkins-hbase4:39929] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-15 18:55:52,386 DEBUG [RS:1;jenkins-hbase4:45283] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-15 18:55:52,386 DEBUG [RS:0;jenkins-hbase4:39929] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-15 18:55:52,386 DEBUG [RS:1;jenkins-hbase4:45283] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-03-15 18:55:52,386 DEBUG [RS:0;jenkins-hbase4:39929] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-03-15 18:55:52,386 DEBUG [RS:1;jenkins-hbase4:45283] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-15 18:55:52,386 DEBUG [RS:0;jenkins-hbase4:39929] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-15 18:55:52,387 DEBUG [RS:0;jenkins-hbase4:39929] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-15 18:55:52,387 DEBUG [RS:1;jenkins-hbase4:45283] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-15 18:55:52,387 DEBUG [RS:0;jenkins-hbase4:39929] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-15 18:55:52,387 DEBUG [RS:1;jenkins-hbase4:45283] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-15 18:55:52,387 DEBUG [RS:0;jenkins-hbase4:39929] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-15 18:55:52,387 DEBUG [RS:1;jenkins-hbase4:45283] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-15 18:55:52,388 INFO [RS:0;jenkins-hbase4:39929] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:52,388 INFO [RS:0;jenkins-hbase4:39929] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:52,388 INFO [RS:1;jenkins-hbase4:45283] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:52,388 INFO [RS:0;jenkins-hbase4:39929] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:52,389 INFO [RS:1;jenkins-hbase4:45283] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:52,389 INFO [RS:0;jenkins-hbase4:39929] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:52,389 INFO [RS:1;jenkins-hbase4:45283] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:52,389 INFO [RS:1;jenkins-hbase4:45283] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:52,406 INFO [RS:1;jenkins-hbase4:45283] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-03-15 18:55:52,406 INFO [RS:0;jenkins-hbase4:39929] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-03-15 18:55:52,408 INFO [RS:1;jenkins-hbase4:45283] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45283,1710528951095-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:52,408 INFO [RS:0;jenkins-hbase4:39929] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,39929,1710528951051-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:52,425 INFO [RS:0;jenkins-hbase4:39929] regionserver.Replication(203): jenkins-hbase4.apache.org,39929,1710528951051 started 2024-03-15 18:55:52,425 INFO [RS:0;jenkins-hbase4:39929] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,39929,1710528951051, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:39929, sessionid=0x10068d932620001 2024-03-15 18:55:52,425 DEBUG [RS:0;jenkins-hbase4:39929] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-03-15 18:55:52,425 DEBUG [RS:0;jenkins-hbase4:39929] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,39929,1710528951051 2024-03-15 18:55:52,425 DEBUG [RS:0;jenkins-hbase4:39929] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39929,1710528951051' 2024-03-15 18:55:52,425 DEBUG [RS:0;jenkins-hbase4:39929] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-03-15 18:55:52,427 DEBUG [RS:0;jenkins-hbase4:39929] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-03-15 18:55:52,427 DEBUG [RS:0;jenkins-hbase4:39929] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-03-15 18:55:52,427 DEBUG [RS:0;jenkins-hbase4:39929] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-03-15 18:55:52,427 DEBUG [RS:0;jenkins-hbase4:39929] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,39929,1710528951051 2024-03-15 18:55:52,427 DEBUG [RS:0;jenkins-hbase4:39929] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,39929,1710528951051' 2024-03-15 18:55:52,427 DEBUG [RS:0;jenkins-hbase4:39929] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-03-15 18:55:52,428 DEBUG [RS:0;jenkins-hbase4:39929] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-03-15 18:55:52,429 INFO [RS:1;jenkins-hbase4:45283] regionserver.Replication(203): jenkins-hbase4.apache.org,45283,1710528951095 started 2024-03-15 18:55:52,429 INFO [RS:1;jenkins-hbase4:45283] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,45283,1710528951095, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45283, sessionid=0x10068d932620002 2024-03-15 18:55:52,429 DEBUG [RS:1;jenkins-hbase4:45283] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-03-15 18:55:52,429 DEBUG [RS:0;jenkins-hbase4:39929] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-03-15 18:55:52,429 DEBUG [RS:1;jenkins-hbase4:45283] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45283,1710528951095 2024-03-15 18:55:52,430 INFO [RS:0;jenkins-hbase4:39929] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-03-15 18:55:52,430 DEBUG [RS:1;jenkins-hbase4:45283] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45283,1710528951095' 2024-03-15 18:55:52,430 DEBUG [RS:1;jenkins-hbase4:45283] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-03-15 18:55:52,431 DEBUG [RS:1;jenkins-hbase4:45283] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-03-15 18:55:52,431 DEBUG [RS:1;jenkins-hbase4:45283] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-03-15 18:55:52,432 DEBUG [RS:1;jenkins-hbase4:45283] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-03-15 18:55:52,432 DEBUG [RS:1;jenkins-hbase4:45283] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45283,1710528951095 2024-03-15 18:55:52,432 INFO [RS:0;jenkins-hbase4:39929] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:52,432 DEBUG [RS:1;jenkins-hbase4:45283] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45283,1710528951095' 2024-03-15 18:55:52,432 DEBUG [RS:1;jenkins-hbase4:45283] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-03-15 18:55:52,433 DEBUG [RS:0;jenkins-hbase4:39929] zookeeper.ZKUtil(399): regionserver:39929-0x10068d932620001, quorum=127.0.0.1:63302, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-03-15 18:55:52,433 DEBUG [RS:1;jenkins-hbase4:45283] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-03-15 18:55:52,433 INFO [RS:0;jenkins-hbase4:39929] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-03-15 18:55:52,434 INFO [RS:0;jenkins-hbase4:39929] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:52,434 DEBUG [RS:1;jenkins-hbase4:45283] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-03-15 18:55:52,434 INFO [RS:1;jenkins-hbase4:45283] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-03-15 18:55:52,434 INFO [RS:0;jenkins-hbase4:39929] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:52,434 INFO [RS:1;jenkins-hbase4:45283] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:52,435 DEBUG [RS:1;jenkins-hbase4:45283] zookeeper.ZKUtil(399): regionserver:45283-0x10068d932620002, quorum=127.0.0.1:63302, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-03-15 18:55:52,435 INFO [RS:1;jenkins-hbase4:45283] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-03-15 18:55:52,435 INFO [RS:1;jenkins-hbase4:45283] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:52,435 INFO [RS:1;jenkins-hbase4:45283] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:52,443 DEBUG [jenkins-hbase4:35499] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=2, allServersCount=2 2024-03-15 18:55:52,446 DEBUG [jenkins-hbase4:35499] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-15 18:55:52,453 DEBUG [jenkins-hbase4:35499] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-15 18:55:52,453 DEBUG [jenkins-hbase4:35499] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-15 18:55:52,453 DEBUG [jenkins-hbase4:35499] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-15 18:55:52,455 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39929,1710528951051, state=OPENING 2024-03-15 18:55:52,462 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2024-03-15 18:55:52,464 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-15 18:55:52,465 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-03-15 18:55:52,469 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39929,1710528951051}] 2024-03-15 18:55:52,546 INFO [RS:1;jenkins-hbase4:45283] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45283%2C1710528951095, suffix=, logDir=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/WALs/jenkins-hbase4.apache.org,45283,1710528951095, archiveDir=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/oldWALs, maxLogs=32 2024-03-15 18:55:52,546 INFO [RS:0;jenkins-hbase4:39929] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39929%2C1710528951051, suffix=, logDir=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/WALs/jenkins-hbase4.apache.org,39929,1710528951051, archiveDir=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/oldWALs, maxLogs=32 2024-03-15 18:55:52,569 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32845,DS-61a02d57-b826-4d70-a286-1c01fa5722cd,DISK] 2024-03-15 18:55:52,575 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40785,DS-f0821978-6e07-40a7-b75a-b1658728867c,DISK] 2024-03-15 18:55:52,576 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32845,DS-61a02d57-b826-4d70-a286-1c01fa5722cd,DISK] 2024-03-15 18:55:52,577 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40785,DS-f0821978-6e07-40a7-b75a-b1658728867c,DISK] 2024-03-15 18:55:52,611 INFO [RS:1;jenkins-hbase4:45283] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/WALs/jenkins-hbase4.apache.org,45283,1710528951095/jenkins-hbase4.apache.org%2C45283%2C1710528951095.1710528952551 2024-03-15 18:55:52,611 INFO [RS:0;jenkins-hbase4:39929] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/WALs/jenkins-hbase4.apache.org,39929,1710528951051/jenkins-hbase4.apache.org%2C39929%2C1710528951051.1710528952551 2024-03-15 18:55:52,611 DEBUG [RS:1;jenkins-hbase4:45283] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40785,DS-f0821978-6e07-40a7-b75a-b1658728867c,DISK], DatanodeInfoWithStorage[127.0.0.1:32845,DS-61a02d57-b826-4d70-a286-1c01fa5722cd,DISK]] 2024-03-15 18:55:52,611 DEBUG [RS:0;jenkins-hbase4:39929] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:32845,DS-61a02d57-b826-4d70-a286-1c01fa5722cd,DISK], DatanodeInfoWithStorage[127.0.0.1:40785,DS-f0821978-6e07-40a7-b75a-b1658728867c,DISK]] 2024-03-15 18:55:52,653 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,39929,1710528951051 2024-03-15 18:55:52,655 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-03-15 18:55:52,658 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40230, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-03-15 18:55:52,672 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2024-03-15 18:55:52,672 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-03-15 18:55:52,675 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C39929%2C1710528951051.meta, suffix=.meta, logDir=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/WALs/jenkins-hbase4.apache.org,39929,1710528951051, archiveDir=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/oldWALs, maxLogs=32 2024-03-15 18:55:52,692 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:40785,DS-f0821978-6e07-40a7-b75a-b1658728867c,DISK] 2024-03-15 18:55:52,693 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:32845,DS-61a02d57-b826-4d70-a286-1c01fa5722cd,DISK] 2024-03-15 18:55:52,700 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/WALs/jenkins-hbase4.apache.org,39929,1710528951051/jenkins-hbase4.apache.org%2C39929%2C1710528951051.meta.1710528952676.meta 2024-03-15 18:55:52,700 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:40785,DS-f0821978-6e07-40a7-b75a-b1658728867c,DISK], DatanodeInfoWithStorage[127.0.0.1:32845,DS-61a02d57-b826-4d70-a286-1c01fa5722cd,DISK]] 2024-03-15 18:55:52,701 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2024-03-15 18:55:52,702 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2024-03-15 18:55:52,718 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2024-03-15 18:55:52,722 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2024-03-15 18:55:52,728 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2024-03-15 18:55:52,728 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-15 18:55:52,728 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2024-03-15 18:55:52,728 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2024-03-15 18:55:52,731 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-03-15 18:55:52,733 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/meta/1588230740/info 2024-03-15 18:55:52,733 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/meta/1588230740/info 2024-03-15 18:55:52,735 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-03-15 18:55:52,736 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-15 18:55:52,736 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-03-15 18:55:52,738 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/meta/1588230740/rep_barrier 2024-03-15 18:55:52,738 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/meta/1588230740/rep_barrier 2024-03-15 18:55:52,738 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-03-15 18:55:52,739 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-15 18:55:52,739 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-03-15 18:55:52,741 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/meta/1588230740/table 2024-03-15 18:55:52,741 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/meta/1588230740/table 2024-03-15 18:55:52,741 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-03-15 18:55:52,742 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-15 18:55:52,744 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/meta/1588230740 2024-03-15 18:55:52,747 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/meta/1588230740 2024-03-15 18:55:52,751 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-03-15 18:55:52,753 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2024-03-15 18:55:52,755 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71001729, jitterRate=0.058008208870887756}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-03-15 18:55:52,755 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2024-03-15 18:55:52,766 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1710528952646 2024-03-15 18:55:52,784 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:meta,,1.1588230740 2024-03-15 18:55:52,785 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2024-03-15 18:55:52,786 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,39929,1710528951051, state=OPEN 2024-03-15 18:55:52,790 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2024-03-15 18:55:52,790 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-03-15 18:55:52,794 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=3, resume processing ppid=2 2024-03-15 18:55:52,794 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,39929,1710528951051 in 321 msec 2024-03-15 18:55:52,800 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=2, resume processing ppid=1 2024-03-15 18:55:52,800 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 519 msec 2024-03-15 18:55:52,805 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 743 msec 2024-03-15 18:55:52,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(954): Wait for region servers to report in: status=null, state=RUNNING, startTime=1710528952805, completionTime=-1 2024-03-15 18:55:52,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2024-03-15 18:55:52,806 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2024-03-15 18:55:52,874 DEBUG [hconnection-0x3a944dea-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-15 18:55:52,877 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40236, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-03-15 18:55:52,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=2 2024-03-15 18:55:52,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1710529012897 2024-03-15 18:55:52,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1710529072897 2024-03-15 18:55:52,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 90 msec 2024-03-15 18:55:52,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35499,1710528949842-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:52,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35499,1710528949842-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:52,920 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35499,1710528949842-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:52,922 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35499, period=300000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:52,922 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:52,928 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2024-03-15 18:55:52,938 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2024-03-15 18:55:52,939 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-03-15 18:55:52,949 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2024-03-15 18:55:52,952 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2024-03-15 18:55:52,954 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-15 18:55:52,975 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/hbase/namespace/a3640c3e576627c2bc4fb1a7c0e740e5 2024-03-15 18:55:52,977 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/hbase/namespace/a3640c3e576627c2bc4fb1a7c0e740e5 empty. 2024-03-15 18:55:52,978 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/hbase/namespace/a3640c3e576627c2bc4fb1a7c0e740e5 2024-03-15 18:55:52,978 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2024-03-15 18:55:53,007 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2024-03-15 18:55:53,009 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => a3640c3e576627c2bc4fb1a7c0e740e5, NAME => 'hbase:namespace,,1710528952938.a3640c3e576627c2bc4fb1a7c0e740e5.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp 2024-03-15 18:55:53,025 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1710528952938.a3640c3e576627c2bc4fb1a7c0e740e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-15 18:55:53,025 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing a3640c3e576627c2bc4fb1a7c0e740e5, disabling compactions & flushes 2024-03-15 18:55:53,025 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1710528952938.a3640c3e576627c2bc4fb1a7c0e740e5. 2024-03-15 18:55:53,025 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1710528952938.a3640c3e576627c2bc4fb1a7c0e740e5. 2024-03-15 18:55:53,025 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1710528952938.a3640c3e576627c2bc4fb1a7c0e740e5. after waiting 0 ms 2024-03-15 18:55:53,025 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1710528952938.a3640c3e576627c2bc4fb1a7c0e740e5. 2024-03-15 18:55:53,026 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1710528952938.a3640c3e576627c2bc4fb1a7c0e740e5. 2024-03-15 18:55:53,026 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for a3640c3e576627c2bc4fb1a7c0e740e5: 2024-03-15 18:55:53,030 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2024-03-15 18:55:53,046 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1710528952938.a3640c3e576627c2bc4fb1a7c0e740e5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1710528953034"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1710528953034"}]},"ts":"1710528953034"} 2024-03-15 18:55:53,076 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-15 18:55:53,078 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-15 18:55:53,082 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710528953078"}]},"ts":"1710528953078"} 2024-03-15 18:55:53,085 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2024-03-15 18:55:53,090 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-15 18:55:53,092 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-15 18:55:53,092 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-15 18:55:53,092 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-15 18:55:53,094 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a3640c3e576627c2bc4fb1a7c0e740e5, ASSIGN}] 2024-03-15 18:55:53,097 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=a3640c3e576627c2bc4fb1a7c0e740e5, ASSIGN 2024-03-15 18:55:53,098 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=a3640c3e576627c2bc4fb1a7c0e740e5, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45283,1710528951095; forceNewPlan=false, retain=false 2024-03-15 18:55:53,251 INFO [jenkins-hbase4:35499] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-15 18:55:53,252 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a3640c3e576627c2bc4fb1a7c0e740e5, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45283,1710528951095 2024-03-15 18:55:53,252 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1710528952938.a3640c3e576627c2bc4fb1a7c0e740e5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1710528953251"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1710528953251"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1710528953251"}]},"ts":"1710528953251"} 2024-03-15 18:55:53,257 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure a3640c3e576627c2bc4fb1a7c0e740e5, server=jenkins-hbase4.apache.org,45283,1710528951095}] 2024-03-15 18:55:53,411 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,45283,1710528951095 2024-03-15 18:55:53,412 DEBUG [RSProcedureDispatcher-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-03-15 18:55:53,415 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35620, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-03-15 18:55:53,421 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1710528952938.a3640c3e576627c2bc4fb1a7c0e740e5. 2024-03-15 18:55:53,423 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a3640c3e576627c2bc4fb1a7c0e740e5, NAME => 'hbase:namespace,,1710528952938.a3640c3e576627c2bc4fb1a7c0e740e5.', STARTKEY => '', ENDKEY => ''} 2024-03-15 18:55:53,424 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace a3640c3e576627c2bc4fb1a7c0e740e5 2024-03-15 18:55:53,424 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1710528952938.a3640c3e576627c2bc4fb1a7c0e740e5.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-15 18:55:53,424 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a3640c3e576627c2bc4fb1a7c0e740e5 2024-03-15 18:55:53,424 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a3640c3e576627c2bc4fb1a7c0e740e5 2024-03-15 18:55:53,426 INFO [StoreOpener-a3640c3e576627c2bc4fb1a7c0e740e5-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region a3640c3e576627c2bc4fb1a7c0e740e5 2024-03-15 18:55:53,429 DEBUG [StoreOpener-a3640c3e576627c2bc4fb1a7c0e740e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/namespace/a3640c3e576627c2bc4fb1a7c0e740e5/info 2024-03-15 18:55:53,429 DEBUG [StoreOpener-a3640c3e576627c2bc4fb1a7c0e740e5-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/namespace/a3640c3e576627c2bc4fb1a7c0e740e5/info 2024-03-15 18:55:53,429 INFO [StoreOpener-a3640c3e576627c2bc4fb1a7c0e740e5-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3640c3e576627c2bc4fb1a7c0e740e5 columnFamilyName info 2024-03-15 18:55:53,430 INFO [StoreOpener-a3640c3e576627c2bc4fb1a7c0e740e5-1] regionserver.HStore(310): Store=a3640c3e576627c2bc4fb1a7c0e740e5/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-15 18:55:53,431 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/namespace/a3640c3e576627c2bc4fb1a7c0e740e5 2024-03-15 18:55:53,432 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/namespace/a3640c3e576627c2bc4fb1a7c0e740e5 2024-03-15 18:55:53,437 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a3640c3e576627c2bc4fb1a7c0e740e5 2024-03-15 18:55:53,441 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/namespace/a3640c3e576627c2bc4fb1a7c0e740e5/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-15 18:55:53,441 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a3640c3e576627c2bc4fb1a7c0e740e5; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64765049, jitterRate=-0.034925565123558044}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-15 18:55:53,442 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a3640c3e576627c2bc4fb1a7c0e740e5: 2024-03-15 18:55:53,445 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:namespace,,1710528952938.a3640c3e576627c2bc4fb1a7c0e740e5., pid=6, masterSystemTime=1710528953411 2024-03-15 18:55:53,450 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:namespace,,1710528952938.a3640c3e576627c2bc4fb1a7c0e740e5. 2024-03-15 18:55:53,451 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1710528952938.a3640c3e576627c2bc4fb1a7c0e740e5. 2024-03-15 18:55:53,452 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=a3640c3e576627c2bc4fb1a7c0e740e5, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45283,1710528951095 2024-03-15 18:55:53,452 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1710528952938.a3640c3e576627c2bc4fb1a7c0e740e5.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1710528953451"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1710528953451"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1710528953451"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1710528953451"}]},"ts":"1710528953451"} 2024-03-15 18:55:53,452 WARN [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35499] assignment.AssignmentManager(1312): Unable to acquire lock for regionNode state=OPEN, location=jenkins-hbase4.apache.org,45283,1710528951095, table=hbase:namespace, region=a3640c3e576627c2bc4fb1a7c0e740e5. It is likely that another thread is currently holding the lock. To avoid deadlock, skip execution for now. 2024-03-15 18:55:53,460 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=6, resume processing ppid=5 2024-03-15 18:55:53,460 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure a3640c3e576627c2bc4fb1a7c0e740e5, server=jenkins-hbase4.apache.org,45283,1710528951095 in 199 msec 2024-03-15 18:55:53,464 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=5, resume processing ppid=4 2024-03-15 18:55:53,464 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=a3640c3e576627c2bc4fb1a7c0e740e5, ASSIGN in 366 msec 2024-03-15 18:55:53,466 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-15 18:55:53,466 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710528953466"}]},"ts":"1710528953466"} 2024-03-15 18:55:53,469 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2024-03-15 18:55:53,473 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2024-03-15 18:55:53,476 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 533 msec 2024-03-15 18:55:53,552 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2024-03-15 18:55:53,554 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2024-03-15 18:55:53,554 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-15 18:55:53,576 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-15 18:55:53,579 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35628, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-03-15 18:55:53,591 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2024-03-15 18:55:53,608 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-03-15 18:55:53,614 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 29 msec 2024-03-15 18:55:53,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2024-03-15 18:55:53,636 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-03-15 18:55:53,641 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2024-03-15 18:55:53,650 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2024-03-15 18:55:53,653 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2024-03-15 18:55:53,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1084): Master has completed initialization 2.498sec 2024-03-15 18:55:53,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(103): Quota table not found. Creating... 2024-03-15 18:55:53,657 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-15 18:55:53,659 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:quota 2024-03-15 18:55:53,659 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(107): Initializing quota support 2024-03-15 18:55:53,661 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_PRE_OPERATION 2024-03-15 18:55:53,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(59): Namespace State Manager started. 2024-03-15 18:55:53,663 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-15 18:55:53,666 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/hbase/quota/cf8bc41b7e1f77cb9a84f24a0f02648e 2024-03-15 18:55:53,667 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/hbase/quota/cf8bc41b7e1f77cb9a84f24a0f02648e empty. 2024-03-15 18:55:53,669 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/hbase/quota/cf8bc41b7e1f77cb9a84f24a0f02648e 2024-03-15 18:55:53,669 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:quota regions 2024-03-15 18:55:53,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(222): Finished updating state of 2 namespaces. 2024-03-15 18:55:53,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceAuditor(50): NamespaceAuditor started. 2024-03-15 18:55:53,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:53,673 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:53,675 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2024-03-15 18:55:53,675 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2024-03-15 18:55:53,676 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35499,1710528949842-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2024-03-15 18:55:53,677 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35499,1710528949842-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2024-03-15 18:55:53,691 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/hbase/quota/.tabledesc/.tableinfo.0000000001 2024-03-15 18:55:53,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1176): Balancer post startup initialization complete, took 0 seconds 2024-03-15 18:55:53,692 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35499,1710528949842-OldWALsDirSizeChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-15 18:55:53,698 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(7675): creating {ENCODED => cf8bc41b7e1f77cb9a84f24a0f02648e, NAME => 'hbase:quota,,1710528953657.cf8bc41b7e1f77cb9a84f24a0f02648e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp 2024-03-15 18:55:53,717 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(866): Instantiated hbase:quota,,1710528953657.cf8bc41b7e1f77cb9a84f24a0f02648e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-15 18:55:53,717 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1604): Closing cf8bc41b7e1f77cb9a84f24a0f02648e, disabling compactions & flushes 2024-03-15 18:55:53,717 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1626): Closing region hbase:quota,,1710528953657.cf8bc41b7e1f77cb9a84f24a0f02648e. 2024-03-15 18:55:53,717 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1710528953657.cf8bc41b7e1f77cb9a84f24a0f02648e. 2024-03-15 18:55:53,717 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1710528953657.cf8bc41b7e1f77cb9a84f24a0f02648e. after waiting 0 ms 2024-03-15 18:55:53,717 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1710528953657.cf8bc41b7e1f77cb9a84f24a0f02648e. 2024-03-15 18:55:53,717 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1838): Closed hbase:quota,,1710528953657.cf8bc41b7e1f77cb9a84f24a0f02648e. 2024-03-15 18:55:53,717 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1558): Region close journal for cf8bc41b7e1f77cb9a84f24a0f02648e: 2024-03-15 18:55:53,722 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ADD_TO_META 2024-03-15 18:55:53,724 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:quota,,1710528953657.cf8bc41b7e1f77cb9a84f24a0f02648e.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1710528953724"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1710528953724"}]},"ts":"1710528953724"} 2024-03-15 18:55:53,726 DEBUG [Listener at localhost/33103] zookeeper.ReadOnlyZKClient(139): Connect 0x57016e43 to 127.0.0.1:63302 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-03-15 18:55:53,727 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-15 18:55:53,729 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-15 18:55:53,730 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710528953729"}]},"ts":"1710528953729"} 2024-03-15 18:55:53,731 DEBUG [Listener at localhost/33103] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7310d836, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-03-15 18:55:53,732 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLING in hbase:meta 2024-03-15 18:55:53,738 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-15 18:55:53,740 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-15 18:55:53,740 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-15 18:55:53,741 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-15 18:55:53,741 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=cf8bc41b7e1f77cb9a84f24a0f02648e, ASSIGN}] 2024-03-15 18:55:53,743 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=cf8bc41b7e1f77cb9a84f24a0f02648e, ASSIGN 2024-03-15 18:55:53,745 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:quota, region=cf8bc41b7e1f77cb9a84f24a0f02648e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45283,1710528951095; forceNewPlan=false, retain=false 2024-03-15 18:55:53,747 DEBUG [hconnection-0x52cb5591-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-15 18:55:53,760 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40244, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-03-15 18:55:53,770 INFO [Listener at localhost/33103] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35499,1710528949842 2024-03-15 18:55:53,772 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:55:53,775 DEBUG [Listener at localhost/33103] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-03-15 18:55:53,877 DEBUG [Listener at localhost/33103] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-03-15 18:55:53,896 INFO [jenkins-hbase4:35499] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-15 18:55:53,897 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=cf8bc41b7e1f77cb9a84f24a0f02648e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45283,1710528951095 2024-03-15 18:55:53,897 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:quota,,1710528953657.cf8bc41b7e1f77cb9a84f24a0f02648e.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1710528953896"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1710528953896"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1710528953896"}]},"ts":"1710528953896"} 2024-03-15 18:55:53,900 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure cf8bc41b7e1f77cb9a84f24a0f02648e, server=jenkins-hbase4.apache.org,45283,1710528951095}] 2024-03-15 18:55:53,980 DEBUG [Listener at localhost/33103] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-03-15 18:55:54,053 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,45283,1710528951095 2024-03-15 18:55:54,059 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:quota,,1710528953657.cf8bc41b7e1f77cb9a84f24a0f02648e. 2024-03-15 18:55:54,059 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => cf8bc41b7e1f77cb9a84f24a0f02648e, NAME => 'hbase:quota,,1710528953657.cf8bc41b7e1f77cb9a84f24a0f02648e.', STARTKEY => '', ENDKEY => ''} 2024-03-15 18:55:54,059 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table quota cf8bc41b7e1f77cb9a84f24a0f02648e 2024-03-15 18:55:54,059 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:quota,,1710528953657.cf8bc41b7e1f77cb9a84f24a0f02648e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-15 18:55:54,060 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for cf8bc41b7e1f77cb9a84f24a0f02648e 2024-03-15 18:55:54,060 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for cf8bc41b7e1f77cb9a84f24a0f02648e 2024-03-15 18:55:54,062 INFO [StoreOpener-cf8bc41b7e1f77cb9a84f24a0f02648e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family q of region cf8bc41b7e1f77cb9a84f24a0f02648e 2024-03-15 18:55:54,064 DEBUG [StoreOpener-cf8bc41b7e1f77cb9a84f24a0f02648e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/quota/cf8bc41b7e1f77cb9a84f24a0f02648e/q 2024-03-15 18:55:54,064 DEBUG [StoreOpener-cf8bc41b7e1f77cb9a84f24a0f02648e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/quota/cf8bc41b7e1f77cb9a84f24a0f02648e/q 2024-03-15 18:55:54,064 INFO [StoreOpener-cf8bc41b7e1f77cb9a84f24a0f02648e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf8bc41b7e1f77cb9a84f24a0f02648e columnFamilyName q 2024-03-15 18:55:54,065 INFO [StoreOpener-cf8bc41b7e1f77cb9a84f24a0f02648e-1] regionserver.HStore(310): Store=cf8bc41b7e1f77cb9a84f24a0f02648e/q, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-15 18:55:54,065 INFO [StoreOpener-cf8bc41b7e1f77cb9a84f24a0f02648e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family u of region cf8bc41b7e1f77cb9a84f24a0f02648e 2024-03-15 18:55:54,068 DEBUG [StoreOpener-cf8bc41b7e1f77cb9a84f24a0f02648e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/quota/cf8bc41b7e1f77cb9a84f24a0f02648e/u 2024-03-15 18:55:54,068 DEBUG [StoreOpener-cf8bc41b7e1f77cb9a84f24a0f02648e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/quota/cf8bc41b7e1f77cb9a84f24a0f02648e/u 2024-03-15 18:55:54,068 INFO [StoreOpener-cf8bc41b7e1f77cb9a84f24a0f02648e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region cf8bc41b7e1f77cb9a84f24a0f02648e columnFamilyName u 2024-03-15 18:55:54,069 INFO [StoreOpener-cf8bc41b7e1f77cb9a84f24a0f02648e-1] regionserver.HStore(310): Store=cf8bc41b7e1f77cb9a84f24a0f02648e/u, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-15 18:55:54,071 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/quota/cf8bc41b7e1f77cb9a84f24a0f02648e 2024-03-15 18:55:54,072 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/quota/cf8bc41b7e1f77cb9a84f24a0f02648e 2024-03-15 18:55:54,075 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:quota descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2024-03-15 18:55:54,078 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for cf8bc41b7e1f77cb9a84f24a0f02648e 2024-03-15 18:55:54,081 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/quota/cf8bc41b7e1f77cb9a84f24a0f02648e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-15 18:55:54,082 DEBUG [Listener at localhost/33103] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-03-15 18:55:54,082 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened cf8bc41b7e1f77cb9a84f24a0f02648e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74366838, jitterRate=0.10815224051475525}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2024-03-15 18:55:54,082 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for cf8bc41b7e1f77cb9a84f24a0f02648e: 2024-03-15 18:55:54,084 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:quota,,1710528953657.cf8bc41b7e1f77cb9a84f24a0f02648e., pid=11, masterSystemTime=1710528954053 2024-03-15 18:55:54,087 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:quota,,1710528953657.cf8bc41b7e1f77cb9a84f24a0f02648e. 2024-03-15 18:55:54,087 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:quota,,1710528953657.cf8bc41b7e1f77cb9a84f24a0f02648e. 2024-03-15 18:55:54,088 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=cf8bc41b7e1f77cb9a84f24a0f02648e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45283,1710528951095 2024-03-15 18:55:54,088 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:quota,,1710528953657.cf8bc41b7e1f77cb9a84f24a0f02648e.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1710528954088"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1710528954088"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1710528954088"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1710528954088"}]},"ts":"1710528954088"} 2024-03-15 18:55:54,094 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=11, resume processing ppid=10 2024-03-15 18:55:54,094 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure cf8bc41b7e1f77cb9a84f24a0f02648e, server=jenkins-hbase4.apache.org,45283,1710528951095 in 191 msec 2024-03-15 18:55:54,097 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=10, resume processing ppid=9 2024-03-15 18:55:54,097 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:quota, region=cf8bc41b7e1f77cb9a84f24a0f02648e, ASSIGN in 353 msec 2024-03-15 18:55:54,098 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-15 18:55:54,098 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710528954098"}]},"ts":"1710528954098"} 2024-03-15 18:55:54,101 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLED in hbase:meta 2024-03-15 18:55:54,104 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_POST_OPERATION 2024-03-15 18:55:54,106 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:quota in 447 msec 2024-03-15 18:55:54,196 DEBUG [Listener at localhost/33103] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-03-15 18:55:54,199 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43306, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2024-03-15 18:55:54,213 DEBUG [hconnection-0x52cb5591-shared-pool-3] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-15 18:55:54,216 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35642, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-03-15 18:55:54,229 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35499] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-15 18:55:54,231 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35499] procedure2.ProcedureExecutor(1075): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin0 2024-03-15 18:55:54,234 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_PRE_OPERATION 2024-03-15 18:55:54,235 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-15 18:55:54,238 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/default/TestQuotaAdmin0/154690127c6d9ab903c5d72a71661ab4 2024-03-15 18:55:54,239 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/default/TestQuotaAdmin0/154690127c6d9ab903c5d72a71661ab4 empty. 2024-03-15 18:55:54,239 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35499] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin0" procId is: 12 2024-03-15 18:55:54,239 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/default/TestQuotaAdmin0/154690127c6d9ab903c5d72a71661ab4 2024-03-15 18:55:54,239 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-03-15 18:55:54,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-03-15 18:55:54,259 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/default/TestQuotaAdmin0/.tabledesc/.tableinfo.0000000001 2024-03-15 18:55:54,260 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(7675): creating {ENCODED => 154690127c6d9ab903c5d72a71661ab4, NAME => 'TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp 2024-03-15 18:55:54,278 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-15 18:55:54,278 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1604): Closing 154690127c6d9ab903c5d72a71661ab4, disabling compactions & flushes 2024-03-15 18:55:54,278 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4. 2024-03-15 18:55:54,278 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4. 2024-03-15 18:55:54,278 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4. after waiting 0 ms 2024-03-15 18:55:54,278 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4. 2024-03-15 18:55:54,278 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4. 2024-03-15 18:55:54,278 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1558): Region close journal for 154690127c6d9ab903c5d72a71661ab4: 2024-03-15 18:55:54,282 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ADD_TO_META 2024-03-15 18:55:54,284 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710528954284"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1710528954284"}]},"ts":"1710528954284"} 2024-03-15 18:55:54,287 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-15 18:55:54,289 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-15 18:55:54,289 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710528954289"}]},"ts":"1710528954289"} 2024-03-15 18:55:54,291 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLING in hbase:meta 2024-03-15 18:55:54,296 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-15 18:55:54,297 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-15 18:55:54,297 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-15 18:55:54,297 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-15 18:55:54,297 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=154690127c6d9ab903c5d72a71661ab4, ASSIGN}] 2024-03-15 18:55:54,299 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=154690127c6d9ab903c5d72a71661ab4, ASSIGN 2024-03-15 18:55:54,300 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin0, region=154690127c6d9ab903c5d72a71661ab4, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45283,1710528951095; forceNewPlan=false, retain=false 2024-03-15 18:55:54,450 INFO [jenkins-hbase4:35499] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-15 18:55:54,451 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=154690127c6d9ab903c5d72a71661ab4, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45283,1710528951095 2024-03-15 18:55:54,452 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710528954451"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1710528954451"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1710528954451"}]},"ts":"1710528954451"} 2024-03-15 18:55:54,455 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; OpenRegionProcedure 154690127c6d9ab903c5d72a71661ab4, server=jenkins-hbase4.apache.org,45283,1710528951095}] 2024-03-15 18:55:54,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-03-15 18:55:54,608 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,45283,1710528951095 2024-03-15 18:55:54,614 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4. 2024-03-15 18:55:54,614 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 154690127c6d9ab903c5d72a71661ab4, NAME => 'TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4.', STARTKEY => '', ENDKEY => ''} 2024-03-15 18:55:54,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin0 154690127c6d9ab903c5d72a71661ab4 2024-03-15 18:55:54,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-15 18:55:54,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 154690127c6d9ab903c5d72a71661ab4 2024-03-15 18:55:54,615 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 154690127c6d9ab903c5d72a71661ab4 2024-03-15 18:55:54,617 INFO [StoreOpener-154690127c6d9ab903c5d72a71661ab4-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 154690127c6d9ab903c5d72a71661ab4 2024-03-15 18:55:54,619 DEBUG [StoreOpener-154690127c6d9ab903c5d72a71661ab4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/default/TestQuotaAdmin0/154690127c6d9ab903c5d72a71661ab4/cf 2024-03-15 18:55:54,619 DEBUG [StoreOpener-154690127c6d9ab903c5d72a71661ab4-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/default/TestQuotaAdmin0/154690127c6d9ab903c5d72a71661ab4/cf 2024-03-15 18:55:54,620 INFO [StoreOpener-154690127c6d9ab903c5d72a71661ab4-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 154690127c6d9ab903c5d72a71661ab4 columnFamilyName cf 2024-03-15 18:55:54,621 INFO [StoreOpener-154690127c6d9ab903c5d72a71661ab4-1] regionserver.HStore(310): Store=154690127c6d9ab903c5d72a71661ab4/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-15 18:55:54,623 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/default/TestQuotaAdmin0/154690127c6d9ab903c5d72a71661ab4 2024-03-15 18:55:54,624 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/default/TestQuotaAdmin0/154690127c6d9ab903c5d72a71661ab4 2024-03-15 18:55:54,629 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 154690127c6d9ab903c5d72a71661ab4 2024-03-15 18:55:54,632 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/default/TestQuotaAdmin0/154690127c6d9ab903c5d72a71661ab4/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-15 18:55:54,633 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 154690127c6d9ab903c5d72a71661ab4; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64369491, jitterRate=-0.040819838643074036}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-15 18:55:54,633 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 154690127c6d9ab903c5d72a71661ab4: 2024-03-15 18:55:54,634 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4., pid=14, masterSystemTime=1710528954608 2024-03-15 18:55:54,637 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4. 2024-03-15 18:55:54,637 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4. 2024-03-15 18:55:54,638 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=154690127c6d9ab903c5d72a71661ab4, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45283,1710528951095 2024-03-15 18:55:54,639 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710528954638"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1710528954638"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1710528954638"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1710528954638"}]},"ts":"1710528954638"} 2024-03-15 18:55:54,645 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=14, resume processing ppid=13 2024-03-15 18:55:54,645 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=14, ppid=13, state=SUCCESS; OpenRegionProcedure 154690127c6d9ab903c5d72a71661ab4, server=jenkins-hbase4.apache.org,45283,1710528951095 in 187 msec 2024-03-15 18:55:54,648 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=13, resume processing ppid=12 2024-03-15 18:55:54,649 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=154690127c6d9ab903c5d72a71661ab4, ASSIGN in 348 msec 2024-03-15 18:55:54,650 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-15 18:55:54,650 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710528954650"}]},"ts":"1710528954650"} 2024-03-15 18:55:54,652 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLED in hbase:meta 2024-03-15 18:55:54,656 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_POST_OPERATION 2024-03-15 18:55:54,658 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=12, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin0 in 427 msec 2024-03-15 18:55:55,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-03-15 18:55:55,004 INFO [Listener at localhost/33103] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin0, procId: 12 completed 2024-03-15 18:55:55,004 DEBUG [Listener at localhost/33103] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin0 get assigned. Timeout = 60000ms 2024-03-15 18:55:55,005 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:55:55,009 INFO [Listener at localhost/33103] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin0 assigned to meta. Checking AM states. 2024-03-15 18:55:55,009 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:55:55,010 INFO [Listener at localhost/33103] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin0 assigned. 2024-03-15 18:55:55,010 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:55:55,024 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-03-15 18:55:55,026 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43314, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=MasterService 2024-03-15 18:55:55,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35499] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-15 18:55:55,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35499] procedure2.ProcedureExecutor(1075): Stored pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin1 2024-03-15 18:55:55,031 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_PRE_OPERATION 2024-03-15 18:55:55,032 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35499] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin1" procId is: 15 2024-03-15 18:55:55,033 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-15 18:55:55,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-03-15 18:55:55,036 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/default/TestQuotaAdmin1/01d491e85fa856a05e0d6c641f921ab7 2024-03-15 18:55:55,037 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/default/TestQuotaAdmin1/01d491e85fa856a05e0d6c641f921ab7 empty. 2024-03-15 18:55:55,038 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/default/TestQuotaAdmin1/01d491e85fa856a05e0d6c641f921ab7 2024-03-15 18:55:55,038 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-03-15 18:55:55,060 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/default/TestQuotaAdmin1/.tabledesc/.tableinfo.0000000001 2024-03-15 18:55:55,062 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 01d491e85fa856a05e0d6c641f921ab7, NAME => 'TestQuotaAdmin1,,1710528955027.01d491e85fa856a05e0d6c641f921ab7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp 2024-03-15 18:55:55,071 DEBUG [hconnection-0x33a5831b-metaLookup-shared--pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-15 18:55:55,076 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40256, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2024-03-15 18:55:55,078 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1710528955027.01d491e85fa856a05e0d6c641f921ab7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-15 18:55:55,079 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1604): Closing 01d491e85fa856a05e0d6c641f921ab7, disabling compactions & flushes 2024-03-15 18:55:55,079 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1710528955027.01d491e85fa856a05e0d6c641f921ab7. 2024-03-15 18:55:55,079 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1710528955027.01d491e85fa856a05e0d6c641f921ab7. 2024-03-15 18:55:55,079 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1710528955027.01d491e85fa856a05e0d6c641f921ab7. after waiting 0 ms 2024-03-15 18:55:55,079 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1710528955027.01d491e85fa856a05e0d6c641f921ab7. 2024-03-15 18:55:55,079 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1710528955027.01d491e85fa856a05e0d6c641f921ab7. 2024-03-15 18:55:55,079 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1558): Region close journal for 01d491e85fa856a05e0d6c641f921ab7: 2024-03-15 18:55:55,085 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ADD_TO_META 2024-03-15 18:55:55,087 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1710528955027.01d491e85fa856a05e0d6c641f921ab7.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710528955086"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1710528955086"}]},"ts":"1710528955086"} 2024-03-15 18:55:55,089 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-15 18:55:55,090 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-15 18:55:55,091 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710528955090"}]},"ts":"1710528955090"} 2024-03-15 18:55:55,092 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLING in hbase:meta 2024-03-15 18:55:55,097 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-15 18:55:55,098 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-15 18:55:55,099 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-15 18:55:55,099 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-15 18:55:55,099 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=01d491e85fa856a05e0d6c641f921ab7, ASSIGN}] 2024-03-15 18:55:55,101 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=01d491e85fa856a05e0d6c641f921ab7, ASSIGN 2024-03-15 18:55:55,102 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin1, region=01d491e85fa856a05e0d6c641f921ab7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39929,1710528951051; forceNewPlan=false, retain=false 2024-03-15 18:55:55,252 INFO [jenkins-hbase4:35499] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-15 18:55:55,253 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=01d491e85fa856a05e0d6c641f921ab7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39929,1710528951051 2024-03-15 18:55:55,253 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1710528955027.01d491e85fa856a05e0d6c641f921ab7.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710528955253"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1710528955253"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1710528955253"}]},"ts":"1710528955253"} 2024-03-15 18:55:55,257 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure 01d491e85fa856a05e0d6c641f921ab7, server=jenkins-hbase4.apache.org,39929,1710528951051}] 2024-03-15 18:55:55,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-03-15 18:55:55,409 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,39929,1710528951051 2024-03-15 18:55:55,415 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin1,,1710528955027.01d491e85fa856a05e0d6c641f921ab7. 2024-03-15 18:55:55,415 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 01d491e85fa856a05e0d6c641f921ab7, NAME => 'TestQuotaAdmin1,,1710528955027.01d491e85fa856a05e0d6c641f921ab7.', STARTKEY => '', ENDKEY => ''} 2024-03-15 18:55:55,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin1 01d491e85fa856a05e0d6c641f921ab7 2024-03-15 18:55:55,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1710528955027.01d491e85fa856a05e0d6c641f921ab7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-15 18:55:55,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 01d491e85fa856a05e0d6c641f921ab7 2024-03-15 18:55:55,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 01d491e85fa856a05e0d6c641f921ab7 2024-03-15 18:55:55,418 INFO [StoreOpener-01d491e85fa856a05e0d6c641f921ab7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 01d491e85fa856a05e0d6c641f921ab7 2024-03-15 18:55:55,420 DEBUG [StoreOpener-01d491e85fa856a05e0d6c641f921ab7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/default/TestQuotaAdmin1/01d491e85fa856a05e0d6c641f921ab7/cf 2024-03-15 18:55:55,420 DEBUG [StoreOpener-01d491e85fa856a05e0d6c641f921ab7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/default/TestQuotaAdmin1/01d491e85fa856a05e0d6c641f921ab7/cf 2024-03-15 18:55:55,421 INFO [StoreOpener-01d491e85fa856a05e0d6c641f921ab7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 01d491e85fa856a05e0d6c641f921ab7 columnFamilyName cf 2024-03-15 18:55:55,422 INFO [StoreOpener-01d491e85fa856a05e0d6c641f921ab7-1] regionserver.HStore(310): Store=01d491e85fa856a05e0d6c641f921ab7/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-15 18:55:55,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/default/TestQuotaAdmin1/01d491e85fa856a05e0d6c641f921ab7 2024-03-15 18:55:55,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/default/TestQuotaAdmin1/01d491e85fa856a05e0d6c641f921ab7 2024-03-15 18:55:55,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 01d491e85fa856a05e0d6c641f921ab7 2024-03-15 18:55:55,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/default/TestQuotaAdmin1/01d491e85fa856a05e0d6c641f921ab7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-15 18:55:55,435 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 01d491e85fa856a05e0d6c641f921ab7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71562224, jitterRate=0.0663602352142334}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-15 18:55:55,436 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 01d491e85fa856a05e0d6c641f921ab7: 2024-03-15 18:55:55,437 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin1,,1710528955027.01d491e85fa856a05e0d6c641f921ab7., pid=17, masterSystemTime=1710528955409 2024-03-15 18:55:55,440 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin1,,1710528955027.01d491e85fa856a05e0d6c641f921ab7. 2024-03-15 18:55:55,440 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin1,,1710528955027.01d491e85fa856a05e0d6c641f921ab7. 2024-03-15 18:55:55,441 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=01d491e85fa856a05e0d6c641f921ab7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39929,1710528951051 2024-03-15 18:55:55,441 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin1,,1710528955027.01d491e85fa856a05e0d6c641f921ab7.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710528955440"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1710528955440"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1710528955440"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1710528955440"}]},"ts":"1710528955440"} 2024-03-15 18:55:55,446 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=17, resume processing ppid=16 2024-03-15 18:55:55,446 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure 01d491e85fa856a05e0d6c641f921ab7, server=jenkins-hbase4.apache.org,39929,1710528951051 in 187 msec 2024-03-15 18:55:55,449 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=16, resume processing ppid=15 2024-03-15 18:55:55,450 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=01d491e85fa856a05e0d6c641f921ab7, ASSIGN in 347 msec 2024-03-15 18:55:55,451 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-15 18:55:55,452 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710528955452"}]},"ts":"1710528955452"} 2024-03-15 18:55:55,454 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLED in hbase:meta 2024-03-15 18:55:55,457 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_POST_OPERATION 2024-03-15 18:55:55,460 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=15, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin1 in 430 msec 2024-03-15 18:55:55,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-03-15 18:55:55,787 INFO [Listener at localhost/33103] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin1, procId: 15 completed 2024-03-15 18:55:55,788 DEBUG [Listener at localhost/33103] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin1 get assigned. Timeout = 60000ms 2024-03-15 18:55:55,788 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:55:55,791 INFO [Listener at localhost/33103] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin1 assigned to meta. Checking AM states. 2024-03-15 18:55:55,791 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:55:55,791 INFO [Listener at localhost/33103] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin1 assigned. 2024-03-15 18:55:55,792 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:55:55,801 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-03-15 18:55:55,805 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43536, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService 2024-03-15 18:55:55,806 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-15 18:55:55,808 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] procedure2.ProcedureExecutor(1075): Stored pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin2 2024-03-15 18:55:55,810 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_PRE_OPERATION 2024-03-15 18:55:55,811 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin2" procId is: 18 2024-03-15 18:55:55,812 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-15 18:55:55,812 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-03-15 18:55:55,814 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/default/TestQuotaAdmin2/49346bec8e755881a1bcdb88ae39af22 2024-03-15 18:55:55,815 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/default/TestQuotaAdmin2/49346bec8e755881a1bcdb88ae39af22 empty. 2024-03-15 18:55:55,816 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/default/TestQuotaAdmin2/49346bec8e755881a1bcdb88ae39af22 2024-03-15 18:55:55,816 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-03-15 18:55:55,816 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-15 18:55:55,818 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51936, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2024-03-15 18:55:55,837 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/default/TestQuotaAdmin2/.tabledesc/.tableinfo.0000000001 2024-03-15 18:55:55,839 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(7675): creating {ENCODED => 49346bec8e755881a1bcdb88ae39af22, NAME => 'TestQuotaAdmin2,,1710528955806.49346bec8e755881a1bcdb88ae39af22.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp 2024-03-15 18:55:55,854 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1710528955806.49346bec8e755881a1bcdb88ae39af22.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-15 18:55:55,855 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1604): Closing 49346bec8e755881a1bcdb88ae39af22, disabling compactions & flushes 2024-03-15 18:55:55,855 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1710528955806.49346bec8e755881a1bcdb88ae39af22. 2024-03-15 18:55:55,855 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1710528955806.49346bec8e755881a1bcdb88ae39af22. 2024-03-15 18:55:55,855 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1710528955806.49346bec8e755881a1bcdb88ae39af22. after waiting 0 ms 2024-03-15 18:55:55,855 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1710528955806.49346bec8e755881a1bcdb88ae39af22. 2024-03-15 18:55:55,855 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1710528955806.49346bec8e755881a1bcdb88ae39af22. 2024-03-15 18:55:55,855 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1558): Region close journal for 49346bec8e755881a1bcdb88ae39af22: 2024-03-15 18:55:55,859 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ADD_TO_META 2024-03-15 18:55:55,861 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1710528955806.49346bec8e755881a1bcdb88ae39af22.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710528955861"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1710528955861"}]},"ts":"1710528955861"} 2024-03-15 18:55:55,863 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-15 18:55:55,865 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-15 18:55:55,865 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710528955865"}]},"ts":"1710528955865"} 2024-03-15 18:55:55,867 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLING in hbase:meta 2024-03-15 18:55:55,871 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-15 18:55:55,872 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-15 18:55:55,873 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-15 18:55:55,873 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-15 18:55:55,873 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=49346bec8e755881a1bcdb88ae39af22, ASSIGN}] 2024-03-15 18:55:55,874 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=49346bec8e755881a1bcdb88ae39af22, ASSIGN 2024-03-15 18:55:55,876 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin2, region=49346bec8e755881a1bcdb88ae39af22, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39929,1710528951051; forceNewPlan=false, retain=false 2024-03-15 18:55:56,026 INFO [jenkins-hbase4:35499] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-15 18:55:56,027 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=49346bec8e755881a1bcdb88ae39af22, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39929,1710528951051 2024-03-15 18:55:56,027 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1710528955806.49346bec8e755881a1bcdb88ae39af22.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710528956027"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1710528956027"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1710528956027"}]},"ts":"1710528956027"} 2024-03-15 18:55:56,030 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE; OpenRegionProcedure 49346bec8e755881a1bcdb88ae39af22, server=jenkins-hbase4.apache.org,39929,1710528951051}] 2024-03-15 18:55:56,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-03-15 18:55:56,183 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,39929,1710528951051 2024-03-15 18:55:56,188 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin2,,1710528955806.49346bec8e755881a1bcdb88ae39af22. 2024-03-15 18:55:56,188 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 49346bec8e755881a1bcdb88ae39af22, NAME => 'TestQuotaAdmin2,,1710528955806.49346bec8e755881a1bcdb88ae39af22.', STARTKEY => '', ENDKEY => ''} 2024-03-15 18:55:56,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin2 49346bec8e755881a1bcdb88ae39af22 2024-03-15 18:55:56,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1710528955806.49346bec8e755881a1bcdb88ae39af22.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-15 18:55:56,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 49346bec8e755881a1bcdb88ae39af22 2024-03-15 18:55:56,189 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 49346bec8e755881a1bcdb88ae39af22 2024-03-15 18:55:56,191 INFO [StoreOpener-49346bec8e755881a1bcdb88ae39af22-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 49346bec8e755881a1bcdb88ae39af22 2024-03-15 18:55:56,193 DEBUG [StoreOpener-49346bec8e755881a1bcdb88ae39af22-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/default/TestQuotaAdmin2/49346bec8e755881a1bcdb88ae39af22/cf 2024-03-15 18:55:56,193 DEBUG [StoreOpener-49346bec8e755881a1bcdb88ae39af22-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/default/TestQuotaAdmin2/49346bec8e755881a1bcdb88ae39af22/cf 2024-03-15 18:55:56,194 INFO [StoreOpener-49346bec8e755881a1bcdb88ae39af22-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 49346bec8e755881a1bcdb88ae39af22 columnFamilyName cf 2024-03-15 18:55:56,194 INFO [StoreOpener-49346bec8e755881a1bcdb88ae39af22-1] regionserver.HStore(310): Store=49346bec8e755881a1bcdb88ae39af22/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-15 18:55:56,196 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/default/TestQuotaAdmin2/49346bec8e755881a1bcdb88ae39af22 2024-03-15 18:55:56,197 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/default/TestQuotaAdmin2/49346bec8e755881a1bcdb88ae39af22 2024-03-15 18:55:56,202 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 49346bec8e755881a1bcdb88ae39af22 2024-03-15 18:55:56,205 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/default/TestQuotaAdmin2/49346bec8e755881a1bcdb88ae39af22/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-15 18:55:56,206 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 49346bec8e755881a1bcdb88ae39af22; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58975243, jitterRate=-0.12120039761066437}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-15 18:55:56,206 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 49346bec8e755881a1bcdb88ae39af22: 2024-03-15 18:55:56,207 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin2,,1710528955806.49346bec8e755881a1bcdb88ae39af22., pid=20, masterSystemTime=1710528956183 2024-03-15 18:55:56,210 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin2,,1710528955806.49346bec8e755881a1bcdb88ae39af22. 2024-03-15 18:55:56,210 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin2,,1710528955806.49346bec8e755881a1bcdb88ae39af22. 2024-03-15 18:55:56,211 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=49346bec8e755881a1bcdb88ae39af22, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39929,1710528951051 2024-03-15 18:55:56,211 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin2,,1710528955806.49346bec8e755881a1bcdb88ae39af22.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710528956211"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1710528956211"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1710528956211"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1710528956211"}]},"ts":"1710528956211"} 2024-03-15 18:55:56,216 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=20, resume processing ppid=19 2024-03-15 18:55:56,216 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=20, ppid=19, state=SUCCESS; OpenRegionProcedure 49346bec8e755881a1bcdb88ae39af22, server=jenkins-hbase4.apache.org,39929,1710528951051 in 183 msec 2024-03-15 18:55:56,219 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=19, resume processing ppid=18 2024-03-15 18:55:56,219 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=19, ppid=18, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=49346bec8e755881a1bcdb88ae39af22, ASSIGN in 343 msec 2024-03-15 18:55:56,221 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-15 18:55:56,221 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710528956221"}]},"ts":"1710528956221"} 2024-03-15 18:55:56,223 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLED in hbase:meta 2024-03-15 18:55:56,227 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_POST_OPERATION 2024-03-15 18:55:56,228 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=18, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin2 in 421 msec 2024-03-15 18:55:56,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-03-15 18:55:56,567 INFO [Listener at localhost/33103] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin2, procId: 18 completed 2024-03-15 18:55:56,567 DEBUG [Listener at localhost/33103] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin2 get assigned. Timeout = 60000ms 2024-03-15 18:55:56,567 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:55:56,570 INFO [Listener at localhost/33103] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin2 assigned to meta. Checking AM states. 2024-03-15 18:55:56,571 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:55:56,571 INFO [Listener at localhost/33103] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin2 assigned. 2024-03-15 18:55:56,571 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:55:56,585 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.HMaster$15(3020): Client=jenkins//172.31.14.131 creating {NAME => 'TestNs'} 2024-03-15 18:55:56,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] procedure2.ProcedureExecutor(1075): Stored pid=21, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=TestNs 2024-03-15 18:55:56,594 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-03-15 18:55:56,600 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-03-15 18:55:56,606 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=21, state=SUCCESS; CreateNamespaceProcedure, namespace=TestNs in 18 msec 2024-03-15 18:55:56,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-03-15 18:55:56,848 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-15 18:55:56,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] procedure2.ProcedureExecutor(1075): Stored pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestNs:TestTable 2024-03-15 18:55:56,852 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_PRE_OPERATION 2024-03-15 18:55:56,852 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "TestNs" qualifier: "TestTable" procId is: 22 2024-03-15 18:55:56,853 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-15 18:55:56,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-03-15 18:55:56,856 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/TestNs/TestTable/200c48e3c898617869f3925d68300580 2024-03-15 18:55:56,856 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/TestNs/TestTable/01d0cab38ec50c2dc5581987dc8f8b89 2024-03-15 18:55:56,857 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/TestNs/TestTable/200c48e3c898617869f3925d68300580 empty. 2024-03-15 18:55:56,857 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/TestNs/TestTable/01d0cab38ec50c2dc5581987dc8f8b89 empty. 2024-03-15 18:55:56,857 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/TestNs/TestTable/200c48e3c898617869f3925d68300580 2024-03-15 18:55:56,858 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/TestNs/TestTable/01d0cab38ec50c2dc5581987dc8f8b89 2024-03-15 18:55:56,858 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-03-15 18:55:56,875 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/TestNs/TestTable/.tabledesc/.tableinfo.0000000001 2024-03-15 18:55:56,877 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(7675): creating {ENCODED => 01d0cab38ec50c2dc5581987dc8f8b89, NAME => 'TestNs:TestTable,1,1710528956848.01d0cab38ec50c2dc5581987dc8f8b89.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp 2024-03-15 18:55:56,878 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(7675): creating {ENCODED => 200c48e3c898617869f3925d68300580, NAME => 'TestNs:TestTable,,1710528956848.200c48e3c898617869f3925d68300580.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp 2024-03-15 18:55:56,926 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1710528956848.200c48e3c898617869f3925d68300580.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-15 18:55:56,926 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1604): Closing 200c48e3c898617869f3925d68300580, disabling compactions & flushes 2024-03-15 18:55:56,926 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1710528956848.200c48e3c898617869f3925d68300580. 2024-03-15 18:55:56,926 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1710528956848.200c48e3c898617869f3925d68300580. 2024-03-15 18:55:56,927 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1710528956848.200c48e3c898617869f3925d68300580. after waiting 0 ms 2024-03-15 18:55:56,927 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1710528956848.200c48e3c898617869f3925d68300580. 2024-03-15 18:55:56,927 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1710528956848.200c48e3c898617869f3925d68300580. 2024-03-15 18:55:56,930 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1558): Region close journal for 200c48e3c898617869f3925d68300580: 2024-03-15 18:55:56,932 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1710528956848.01d0cab38ec50c2dc5581987dc8f8b89.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-15 18:55:56,932 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1604): Closing 01d0cab38ec50c2dc5581987dc8f8b89, disabling compactions & flushes 2024-03-15 18:55:56,932 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1710528956848.01d0cab38ec50c2dc5581987dc8f8b89. 2024-03-15 18:55:56,932 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1710528956848.01d0cab38ec50c2dc5581987dc8f8b89. 2024-03-15 18:55:56,932 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1710528956848.01d0cab38ec50c2dc5581987dc8f8b89. after waiting 0 ms 2024-03-15 18:55:56,932 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1710528956848.01d0cab38ec50c2dc5581987dc8f8b89. 2024-03-15 18:55:56,932 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1710528956848.01d0cab38ec50c2dc5581987dc8f8b89. 2024-03-15 18:55:56,933 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1558): Region close journal for 01d0cab38ec50c2dc5581987dc8f8b89: 2024-03-15 18:55:56,937 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ADD_TO_META 2024-03-15 18:55:56,938 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,,1710528956848.200c48e3c898617869f3925d68300580.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1710528956938"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1710528956938"}]},"ts":"1710528956938"} 2024-03-15 18:55:56,939 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1710528956848.01d0cab38ec50c2dc5581987dc8f8b89.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1710528956938"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1710528956938"}]},"ts":"1710528956938"} 2024-03-15 18:55:56,943 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2024-03-15 18:55:56,944 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-15 18:55:56,945 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710528956944"}]},"ts":"1710528956944"} 2024-03-15 18:55:56,947 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLING in hbase:meta 2024-03-15 18:55:56,951 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-15 18:55:56,953 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-15 18:55:56,953 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-15 18:55:56,953 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-15 18:55:56,953 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=200c48e3c898617869f3925d68300580, ASSIGN}, {pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=01d0cab38ec50c2dc5581987dc8f8b89, ASSIGN}] 2024-03-15 18:55:56,955 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=01d0cab38ec50c2dc5581987dc8f8b89, ASSIGN 2024-03-15 18:55:56,955 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=200c48e3c898617869f3925d68300580, ASSIGN 2024-03-15 18:55:56,956 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=01d0cab38ec50c2dc5581987dc8f8b89, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45283,1710528951095; forceNewPlan=false, retain=false 2024-03-15 18:55:56,956 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=200c48e3c898617869f3925d68300580, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,39929,1710528951051; forceNewPlan=false, retain=false 2024-03-15 18:55:57,105 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-03-15 18:55:57,106 INFO [jenkins-hbase4:35499] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2024-03-15 18:55:57,108 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=01d0cab38ec50c2dc5581987dc8f8b89, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45283,1710528951095 2024-03-15 18:55:57,108 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=200c48e3c898617869f3925d68300580, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,39929,1710528951051 2024-03-15 18:55:57,108 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1710528956848.01d0cab38ec50c2dc5581987dc8f8b89.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1710528957107"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1710528957107"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1710528957107"}]},"ts":"1710528957107"} 2024-03-15 18:55:57,108 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1710528956848.200c48e3c898617869f3925d68300580.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1710528957107"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1710528957107"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1710528957107"}]},"ts":"1710528957107"} 2024-03-15 18:55:57,110 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 01d0cab38ec50c2dc5581987dc8f8b89, server=jenkins-hbase4.apache.org,45283,1710528951095}] 2024-03-15 18:55:57,112 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=26, ppid=23, state=RUNNABLE; OpenRegionProcedure 200c48e3c898617869f3925d68300580, server=jenkins-hbase4.apache.org,39929,1710528951051}] 2024-03-15 18:55:57,263 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,45283,1710528951095 2024-03-15 18:55:57,265 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,39929,1710528951051 2024-03-15 18:55:57,268 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,1,1710528956848.01d0cab38ec50c2dc5581987dc8f8b89. 2024-03-15 18:55:57,268 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 01d0cab38ec50c2dc5581987dc8f8b89, NAME => 'TestNs:TestTable,1,1710528956848.01d0cab38ec50c2dc5581987dc8f8b89.', STARTKEY => '1', ENDKEY => ''} 2024-03-15 18:55:57,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable 01d0cab38ec50c2dc5581987dc8f8b89 2024-03-15 18:55:57,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1710528956848.01d0cab38ec50c2dc5581987dc8f8b89.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-15 18:55:57,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 01d0cab38ec50c2dc5581987dc8f8b89 2024-03-15 18:55:57,269 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 01d0cab38ec50c2dc5581987dc8f8b89 2024-03-15 18:55:57,269 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,,1710528956848.200c48e3c898617869f3925d68300580. 2024-03-15 18:55:57,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 200c48e3c898617869f3925d68300580, NAME => 'TestNs:TestTable,,1710528956848.200c48e3c898617869f3925d68300580.', STARTKEY => '', ENDKEY => '1'} 2024-03-15 18:55:57,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable 200c48e3c898617869f3925d68300580 2024-03-15 18:55:57,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1710528956848.200c48e3c898617869f3925d68300580.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-15 18:55:57,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 200c48e3c898617869f3925d68300580 2024-03-15 18:55:57,270 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 200c48e3c898617869f3925d68300580 2024-03-15 18:55:57,271 INFO [StoreOpener-01d0cab38ec50c2dc5581987dc8f8b89-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 01d0cab38ec50c2dc5581987dc8f8b89 2024-03-15 18:55:57,272 INFO [StoreOpener-200c48e3c898617869f3925d68300580-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 200c48e3c898617869f3925d68300580 2024-03-15 18:55:57,273 DEBUG [StoreOpener-01d0cab38ec50c2dc5581987dc8f8b89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/TestNs/TestTable/01d0cab38ec50c2dc5581987dc8f8b89/cf 2024-03-15 18:55:57,273 DEBUG [StoreOpener-01d0cab38ec50c2dc5581987dc8f8b89-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/TestNs/TestTable/01d0cab38ec50c2dc5581987dc8f8b89/cf 2024-03-15 18:55:57,274 DEBUG [StoreOpener-200c48e3c898617869f3925d68300580-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/TestNs/TestTable/200c48e3c898617869f3925d68300580/cf 2024-03-15 18:55:57,274 INFO [StoreOpener-01d0cab38ec50c2dc5581987dc8f8b89-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 01d0cab38ec50c2dc5581987dc8f8b89 columnFamilyName cf 2024-03-15 18:55:57,274 DEBUG [StoreOpener-200c48e3c898617869f3925d68300580-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/TestNs/TestTable/200c48e3c898617869f3925d68300580/cf 2024-03-15 18:55:57,275 INFO [StoreOpener-200c48e3c898617869f3925d68300580-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 200c48e3c898617869f3925d68300580 columnFamilyName cf 2024-03-15 18:55:57,275 INFO [StoreOpener-01d0cab38ec50c2dc5581987dc8f8b89-1] regionserver.HStore(310): Store=01d0cab38ec50c2dc5581987dc8f8b89/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-15 18:55:57,277 INFO [StoreOpener-200c48e3c898617869f3925d68300580-1] regionserver.HStore(310): Store=200c48e3c898617869f3925d68300580/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-15 18:55:57,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/TestNs/TestTable/01d0cab38ec50c2dc5581987dc8f8b89 2024-03-15 18:55:57,278 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/TestNs/TestTable/01d0cab38ec50c2dc5581987dc8f8b89 2024-03-15 18:55:57,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/TestNs/TestTable/200c48e3c898617869f3925d68300580 2024-03-15 18:55:57,279 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/TestNs/TestTable/200c48e3c898617869f3925d68300580 2024-03-15 18:55:57,283 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 01d0cab38ec50c2dc5581987dc8f8b89 2024-03-15 18:55:57,284 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 200c48e3c898617869f3925d68300580 2024-03-15 18:55:57,286 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/TestNs/TestTable/01d0cab38ec50c2dc5581987dc8f8b89/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-15 18:55:57,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/TestNs/TestTable/200c48e3c898617869f3925d68300580/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-15 18:55:57,287 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 01d0cab38ec50c2dc5581987dc8f8b89; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68204940, jitterRate=0.016332805156707764}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-15 18:55:57,287 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 01d0cab38ec50c2dc5581987dc8f8b89: 2024-03-15 18:55:57,287 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 200c48e3c898617869f3925d68300580; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72193922, jitterRate=0.07577326893806458}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-15 18:55:57,288 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 200c48e3c898617869f3925d68300580: 2024-03-15 18:55:57,289 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestNs:TestTable,1,1710528956848.01d0cab38ec50c2dc5581987dc8f8b89., pid=25, masterSystemTime=1710528957263 2024-03-15 18:55:57,289 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestNs:TestTable,,1710528956848.200c48e3c898617869f3925d68300580., pid=26, masterSystemTime=1710528957265 2024-03-15 18:55:57,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestNs:TestTable,1,1710528956848.01d0cab38ec50c2dc5581987dc8f8b89. 2024-03-15 18:55:57,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,1,1710528956848.01d0cab38ec50c2dc5581987dc8f8b89. 2024-03-15 18:55:57,292 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=01d0cab38ec50c2dc5581987dc8f8b89, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45283,1710528951095 2024-03-15 18:55:57,292 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,1,1710528956848.01d0cab38ec50c2dc5581987dc8f8b89.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1710528957292"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1710528957292"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1710528957292"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1710528957292"}]},"ts":"1710528957292"} 2024-03-15 18:55:57,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestNs:TestTable,,1710528956848.200c48e3c898617869f3925d68300580. 2024-03-15 18:55:57,292 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,,1710528956848.200c48e3c898617869f3925d68300580. 2024-03-15 18:55:57,293 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=200c48e3c898617869f3925d68300580, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,39929,1710528951051 2024-03-15 18:55:57,294 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,,1710528956848.200c48e3c898617869f3925d68300580.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1710528957293"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1710528957293"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1710528957293"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1710528957293"}]},"ts":"1710528957293"} 2024-03-15 18:55:57,298 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=25, resume processing ppid=24 2024-03-15 18:55:57,298 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 01d0cab38ec50c2dc5581987dc8f8b89, server=jenkins-hbase4.apache.org,45283,1710528951095 in 185 msec 2024-03-15 18:55:57,300 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=26, resume processing ppid=23 2024-03-15 18:55:57,301 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=26, ppid=23, state=SUCCESS; OpenRegionProcedure 200c48e3c898617869f3925d68300580, server=jenkins-hbase4.apache.org,39929,1710528951051 in 185 msec 2024-03-15 18:55:57,302 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=24, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=01d0cab38ec50c2dc5581987dc8f8b89, ASSIGN in 345 msec 2024-03-15 18:55:57,303 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=23, resume processing ppid=22 2024-03-15 18:55:57,303 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=23, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=200c48e3c898617869f3925d68300580, ASSIGN in 348 msec 2024-03-15 18:55:57,304 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-15 18:55:57,304 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710528957304"}]},"ts":"1710528957304"} 2024-03-15 18:55:57,306 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLED in hbase:meta 2024-03-15 18:55:57,310 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_POST_OPERATION 2024-03-15 18:55:57,313 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=22, state=SUCCESS; CreateTableProcedure table=TestNs:TestTable in 462 msec 2024-03-15 18:55:57,607 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-03-15 18:55:57,608 INFO [Listener at localhost/33103] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: TestNs:TestTable, procId: 22 completed 2024-03-15 18:55:57,608 DEBUG [Listener at localhost/33103] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestNs:TestTable get assigned. Timeout = 60000ms 2024-03-15 18:55:57,608 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:55:57,612 INFO [Listener at localhost/33103] hbase.HBaseTestingUtility(3484): All regions for table TestNs:TestTable assigned to meta. Checking AM states. 2024-03-15 18:55:57,613 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:55:57,613 INFO [Listener at localhost/33103] hbase.HBaseTestingUtility(3504): All regions for table TestNs:TestTable assigned. 2024-03-15 18:55:57,613 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:55:57,657 INFO [Listener at localhost/33103] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=304, OpenFileDescriptor=631, MaxFileDescriptor=60000, SystemLoadAverage=173, ProcessCount=168, AvailableMemoryMB=3234 2024-03-15 18:55:57,947 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:55:57,947 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-15 18:55:57,947 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710532557695 bypass), TestNs=QuotaState(ts=1710532557695 bypass)} 2024-03-15 18:55:57,947 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1710532557695 bypass), TestQuotaAdmin2=QuotaState(ts=1710532557695 bypass), TestQuotaAdmin1=QuotaState(ts=1710532557695 bypass)} 2024-03-15 18:55:57,947 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1710532557695 [ TestNs:TestTable ])} 2024-03-15 18:55:57,947 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710532557695 bypass)} 2024-03-15 18:55:58,198 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:55:58,198 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-15 18:55:58,198 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710532557695 bypass), TestNs=QuotaState(ts=1710532557695 bypass)} 2024-03-15 18:55:58,198 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1710532557695 bypass), TestNs:TestTable=QuotaState(ts=1710532557695 bypass)} 2024-03-15 18:55:58,198 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1710532557695 [ TestNs:TestTable ])} 2024-03-15 18:55:58,198 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710532557695 bypass)} 2024-03-15 18:55:58,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:55:58,215 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 90 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:35642 deadline: 1710528968214, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:55:58,248 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2024-03-15 18:55:58,350 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2024-03-15 18:55:58,351 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestNs:TestTable' 2024-03-15 18:55:58,352 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin2' 2024-03-15 18:55:58,352 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin1' 2024-03-15 18:55:58,353 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin0' 2024-03-15 18:55:58,354 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2024-03-15 18:55:58,354 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:quota' 2024-03-15 18:55:58,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:55:58,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 92 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:35642 deadline: 1710528968215, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:55:58,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:55:58,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 94 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:35642 deadline: 1710528968215, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:55:59,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:55:59,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 96 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:35642 deadline: 1710528968214, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:00,021 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-03-15 18:56:00,021 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver Metrics about HBase MasterObservers 2024-03-15 18:56:00,022 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-03-15 18:56:00,022 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2024-03-15 18:56:00,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:00,995 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 98 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:35642 deadline: 1710528968215, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:03,514 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:03,515 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 100 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:35642 deadline: 1710528968214, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:03,516 ERROR [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10312: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1710528956848.01d0cab38ec50c2dc5581987dc8f8b89., hostname=jenkins-hbase4.apache.org,45283,1710528951095, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-15 18:56:03,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:03,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 101 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:35642 deadline: 1710528973518, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:03,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:03,774 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 103 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:35642 deadline: 1710528973519, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:04,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:04,283 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 105 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:35642 deadline: 1710528973518, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:05,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:05,043 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 107 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:35642 deadline: 1710528973519, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:06,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:06,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 109 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:35642 deadline: 1710528973518, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:08,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:08,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 111 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:35642 deadline: 1710528973519, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:08,832 ERROR [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10315: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1710528956848.01d0cab38ec50c2dc5581987dc8f8b89., hostname=jenkins-hbase4.apache.org,45283,1710528951095, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-15 18:56:09,094 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:56:09,094 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-15 18:56:09,094 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710536157695 bypass), TestNs=QuotaState(ts=1710536157695 bypass)} 2024-03-15 18:56:09,094 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1710536157695 bypass), TestQuotaAdmin2=QuotaState(ts=1710536157695 bypass), TestQuotaAdmin1=QuotaState(ts=1710536157695 bypass)} 2024-03-15 18:56:09,094 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1710536157695 bypass)} 2024-03-15 18:56:09,094 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710536157695 bypass)} 2024-03-15 18:56:09,344 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:56:09,345 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-15 18:56:09,345 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710536157695 bypass), TestNs=QuotaState(ts=1710536157695 bypass)} 2024-03-15 18:56:09,345 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1710536157695 bypass), TestNs:TestTable=QuotaState(ts=1710536157695 bypass)} 2024-03-15 18:56:09,345 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1710536157695 bypass)} 2024-03-15 18:56:09,345 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710536157695 bypass)} 2024-03-15 18:56:09,361 INFO [Listener at localhost/33103] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=290 (was 304), OpenFileDescriptor=600 (was 631), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=147 (was 173), ProcessCount=168 (was 168), AvailableMemoryMB=3217 (was 3234) 2024-03-15 18:56:09,375 INFO [Listener at localhost/33103] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=290, OpenFileDescriptor=600, MaxFileDescriptor=60000, SystemLoadAverage=147, ProcessCount=168, AvailableMemoryMB=3217 2024-03-15 18:56:09,640 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:56:09,640 INFO [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-03-15 18:56:09,891 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-15 18:56:09,892 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710539757795 bypass), TestNs=QuotaState(ts=1710539757795 bypass)} 2024-03-15 18:56:09,892 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1710539757795 bypass), TestQuotaAdmin2=QuotaState(ts=1710539757795 bypass), TestQuotaAdmin1=QuotaState(ts=1710539757795 bypass)} 2024-03-15 18:56:09,892 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1710539757795 [ default ])} 2024-03-15 18:56:09,892 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710539757795 bypass)} 2024-03-15 18:56:10,143 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:56:10,143 INFO [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-03-15 18:56:10,393 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-15 18:56:10,395 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710539757895 bypass), TestNs=QuotaState(ts=1710539757895 bypass)} 2024-03-15 18:56:10,396 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1710539757895 bypass), TestNs:TestTable=QuotaState(ts=1710539757895 bypass)} 2024-03-15 18:56:10,396 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1710539757895 [ default ])} 2024-03-15 18:56:10,397 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710539757895 bypass)} 2024-03-15 18:56:10,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-15 18:56:10,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 123 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:35642 deadline: 1710528980407, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-15 18:56:10,661 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-15 18:56:10,662 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 125 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:35642 deadline: 1710528980406, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-15 18:56:11,166 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-15 18:56:11,167 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 127 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:35642 deadline: 1710528980407, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-15 18:56:11,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-15 18:56:11,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 129 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35642 deadline: 1710528980406, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-15 18:56:13,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-15 18:56:13,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 131 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35642 deadline: 1710528980406, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-15 18:56:15,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-15 18:56:15,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 133 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35642 deadline: 1710528980407, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-15 18:56:15,716 ERROR [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10313: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4., hostname=jenkins-hbase4.apache.org,45283,1710528951095, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:199) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor41.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-15 18:56:15,735 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:15,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 140 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35642 deadline: 1710528985735, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:15,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:15,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 142 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35642 deadline: 1710528985736, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:16,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:16,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 144 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35642 deadline: 1710528985736, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:17,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:17,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 146 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35642 deadline: 1710528985736, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:18,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:18,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 148 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35642 deadline: 1710528985736, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:21,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:21,027 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 150 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35642 deadline: 1710528985735, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:21,028 ERROR [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10302: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4., hostname=jenkins-hbase4.apache.org,45283,1710528951095, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:200) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor41.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-15 18:56:21,286 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:56:21,287 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-15 18:56:21,287 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710543357895 bypass), TestNs=QuotaState(ts=1710543357895 bypass)} 2024-03-15 18:56:21,287 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1710543357895 bypass), TestQuotaAdmin2=QuotaState(ts=1710543357895 bypass), TestQuotaAdmin1=QuotaState(ts=1710543357895 bypass)} 2024-03-15 18:56:21,287 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1710543357895 bypass)} 2024-03-15 18:56:21,287 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710543357895 bypass)} 2024-03-15 18:56:21,537 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:56:21,537 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-15 18:56:21,537 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710543357895 bypass), TestNs=QuotaState(ts=1710543357895 bypass)} 2024-03-15 18:56:21,538 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1710543357895 bypass), TestNs:TestTable=QuotaState(ts=1710543357895 bypass)} 2024-03-15 18:56:21,538 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1710543357895 bypass)} 2024-03-15 18:56:21,538 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710543357895 bypass)} 2024-03-15 18:56:21,552 INFO [Listener at localhost/33103] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=290 (was 290), OpenFileDescriptor=599 (was 600), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=144 (was 147), ProcessCount=168 (was 168), AvailableMemoryMB=3086 (was 3217) 2024-03-15 18:56:21,566 INFO [Listener at localhost/33103] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=290, OpenFileDescriptor=599, MaxFileDescriptor=60000, SystemLoadAverage=144, ProcessCount=168, AvailableMemoryMB=3085 2024-03-15 18:56:21,830 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:56:21,830 INFO [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-03-15 18:56:22,081 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-15 18:56:22,082 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710546957995 bypass), TestNs=QuotaState(ts=1710546957995 bypass)} 2024-03-15 18:56:22,082 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1710546957995 bypass), TestQuotaAdmin2=QuotaState(ts=1710546957995 bypass), TestQuotaAdmin1=QuotaState(ts=1710546957995 bypass)} 2024-03-15 18:56:22,082 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1710546957995 global-limiter)} 2024-03-15 18:56:22,083 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710546957995 bypass)} 2024-03-15 18:56:22,333 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:56:22,333 INFO [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-03-15 18:56:22,584 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-15 18:56:22,584 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710546958095 bypass), TestNs=QuotaState(ts=1710546958095 bypass)} 2024-03-15 18:56:22,585 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1710546958095 bypass), TestNs:TestTable=QuotaState(ts=1710546958095 bypass)} 2024-03-15 18:56:22,585 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1710546958095 global-limiter)} 2024-03-15 18:56:22,585 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710546958095 bypass)} 2024-03-15 18:56:22,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:22,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 163 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35642 deadline: 1710528992600, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:22,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:22,857 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 165 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35642 deadline: 1710528992600, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:23,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:23,363 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 167 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35642 deadline: 1710528992600, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:24,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:24,120 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 169 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35642 deadline: 1710528992601, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:25,386 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:25,387 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 171 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35642 deadline: 1710528992601, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:27,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:27,891 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 173 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35642 deadline: 1710528992601, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:27,892 ERROR [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10295: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4., hostname=jenkins-hbase4.apache.org,45283,1710528951095, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:178) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor41.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-15 18:56:27,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-15 18:56:27,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 177 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35642 deadline: 1710528997900, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-15 18:56:28,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-15 18:56:28,156 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 179 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35642 deadline: 1710528997901, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-15 18:56:28,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-15 18:56:28,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 181 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35642 deadline: 1710528997900, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-15 18:56:29,420 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-15 18:56:29,421 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 183 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35642 deadline: 1710528997900, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-15 18:56:30,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-15 18:56:30,686 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 185 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35642 deadline: 1710528997900, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-15 18:56:33,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-15 18:56:33,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 187 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35642 deadline: 1710528997901, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-15 18:56:33,213 ERROR [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=3 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10327: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-3' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4., hostname=jenkins-hbase4.apache.org,45283,1710528951095, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor41.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-15 18:56:33,471 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:56:33,472 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-15 18:56:33,472 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710550558095 bypass), TestNs=QuotaState(ts=1710550558095 bypass)} 2024-03-15 18:56:33,472 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1710550558095 bypass), TestQuotaAdmin2=QuotaState(ts=1710550558095 bypass), TestQuotaAdmin1=QuotaState(ts=1710550558095 bypass)} 2024-03-15 18:56:33,472 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1710550558095 bypass)} 2024-03-15 18:56:33,472 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710550558095 bypass)} 2024-03-15 18:56:33,722 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:56:33,723 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-15 18:56:33,723 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710550558095 bypass), TestNs=QuotaState(ts=1710550558095 bypass)} 2024-03-15 18:56:33,723 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1710550558095 bypass), TestNs:TestTable=QuotaState(ts=1710550558095 bypass)} 2024-03-15 18:56:33,723 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1710550558095 bypass)} 2024-03-15 18:56:33,723 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710550558095 bypass)} 2024-03-15 18:56:33,739 INFO [Listener at localhost/33103] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=281 (was 290), OpenFileDescriptor=597 (was 599), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=199 (was 144) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=3060 (was 3085) 2024-03-15 18:56:33,766 INFO [Listener at localhost/33103] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=281, OpenFileDescriptor=597, MaxFileDescriptor=60000, SystemLoadAverage=199, ProcessCount=168, AvailableMemoryMB=3060 2024-03-15 18:56:34,024 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:56:34,025 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-15 18:56:34,026 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710554158095 bypass), TestNs=QuotaState(ts=1710554158095 bypass)} 2024-03-15 18:56:34,028 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1710554158095 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin2=QuotaState(ts=1710554158095 bypass), TestQuotaAdmin1=QuotaState(ts=1710554158095 bypass)} 2024-03-15 18:56:34,028 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-15 18:56:34,029 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710554158095 bypass)} 2024-03-15 18:56:34,280 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:56:34,280 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-15 18:56:34,280 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710554158095 bypass), TestNs=QuotaState(ts=1710554158095 bypass)} 2024-03-15 18:56:34,281 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1710554158095 bypass), TestNs:TestTable=QuotaState(ts=1710554158095 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000)))} 2024-03-15 18:56:34,281 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-15 18:56:34,281 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710554158095 bypass)} 2024-03-15 18:56:34,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:34,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 202 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:35642 deadline: 1710529004302, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:34,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:34,556 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 204 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:35642 deadline: 1710529004301, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:35,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:35,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 206 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:35642 deadline: 1710529004301, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:35,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:35,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 208 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:35642 deadline: 1710529004301, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:37,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:37,075 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 210 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:35642 deadline: 1710529004302, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:39,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:39,602 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 212 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:35642 deadline: 1710529004301, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:39,603 ERROR [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10339: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1710528956848.01d0cab38ec50c2dc5581987dc8f8b89., hostname=jenkins-hbase4.apache.org,45283,1710528951095, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor41.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-15 18:56:39,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:39,605 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 213 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:35642 deadline: 1710529009605, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:39,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:39,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 215 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:35642 deadline: 1710529009604, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:40,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:40,365 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 217 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:35642 deadline: 1710529009604, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:41,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:41,125 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 219 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:35642 deadline: 1710529009605, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:42,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:42,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 221 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:35642 deadline: 1710529009605, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:44,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:44,903 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 223 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:35642 deadline: 1710529009604, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-15 18:56:44,903 ERROR [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10315: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1710528956848.01d0cab38ec50c2dc5581987dc8f8b89., hostname=jenkins-hbase4.apache.org,45283,1710528951095, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor41.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-15 18:56:45,161 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:56:45,161 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-15 18:56:45,161 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710557758095 bypass), TestNs=QuotaState(ts=1710557758095 bypass)} 2024-03-15 18:56:45,161 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1710557758095 bypass), TestQuotaAdmin2=QuotaState(ts=1710557758095 bypass), TestQuotaAdmin1=QuotaState(ts=1710557758095 bypass)} 2024-03-15 18:56:45,161 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-15 18:56:45,161 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710557758095 bypass)} 2024-03-15 18:56:45,412 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:56:45,412 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-15 18:56:45,412 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710557758095 bypass), TestNs=QuotaState(ts=1710557758095 bypass)} 2024-03-15 18:56:45,412 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1710557758095 bypass), TestNs:TestTable=QuotaState(ts=1710557758095 bypass)} 2024-03-15 18:56:45,412 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1710557758095 bypass)} 2024-03-15 18:56:45,412 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710557758095 bypass)} 2024-03-15 18:56:45,426 INFO [Listener at localhost/33103] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=280 (was 281), OpenFileDescriptor=597 (was 597), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=213 (was 199) - SystemLoadAverage LEAK? -, ProcessCount=171 (was 168) - ProcessCount LEAK? -, AvailableMemoryMB=3032 (was 3060) 2024-03-15 18:56:45,439 INFO [Listener at localhost/33103] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=280, OpenFileDescriptor=597, MaxFileDescriptor=60000, SystemLoadAverage=213, ProcessCount=171, AvailableMemoryMB=3031 2024-03-15 18:56:45,703 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:56:45,703 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-15 18:56:45,704 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710561358095 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1710561358095 bypass)} 2024-03-15 18:56:45,704 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1710561358095 bypass), TestQuotaAdmin2=QuotaState(ts=1710561358095 bypass), TestQuotaAdmin1=QuotaState(ts=1710561358095 bypass)} 2024-03-15 18:56:45,704 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-15 18:56:45,704 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710561358095 bypass)} 2024-03-15 18:56:45,955 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:56:45,955 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-15 18:56:45,956 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710561358095 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1710561358095 bypass)} 2024-03-15 18:56:45,956 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1710561358095 bypass), TestNs:TestTable=QuotaState(ts=1710561358095 bypass)} 2024-03-15 18:56:45,956 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-15 18:56:45,956 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710561358095 bypass)} 2024-03-15 18:56:45,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-15 18:56:45,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 235 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35642 deadline: 1710529015971, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-15 18:56:46,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-15 18:56:46,225 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 237 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35642 deadline: 1710529015970, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-15 18:56:46,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-15 18:56:46,729 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 239 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35642 deadline: 1710529015971, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-15 18:56:47,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-15 18:56:47,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 241 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35642 deadline: 1710529015971, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-15 18:56:48,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-15 18:56:48,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 243 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35642 deadline: 1710529015970, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-15 18:56:51,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-15 18:56:51,266 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 245 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:35642 deadline: 1710529015970, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-15 18:56:51,267 ERROR [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10344: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4., hostname=jenkins-hbase4.apache.org,45283,1710528951095, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:128) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor41.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-15 18:56:51,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:51,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 252 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35642 deadline: 1710529021276, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:51,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:51,532 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 254 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35642 deadline: 1710529021276, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:52,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:52,038 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 256 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35642 deadline: 1710529021276, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:52,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:52,793 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 258 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35642 deadline: 1710529021277, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:54,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:54,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 260 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35642 deadline: 1710529021277, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:56,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:56,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=45283] ipc.CallRunner(144): callId: 262 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:35642 deadline: 1710529021277, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-15 18:56:56,577 ERROR [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10311: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4., hostname=jenkins-hbase4.apache.org,45283,1710528951095, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor41.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-15 18:56:56,835 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:56:56,835 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-15 18:56:56,835 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710564958095 bypass), TestNs=QuotaState(ts=1710564958095 bypass)} 2024-03-15 18:56:56,835 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1710564958095 bypass), TestQuotaAdmin2=QuotaState(ts=1710564958095 bypass), TestQuotaAdmin1=QuotaState(ts=1710564958095 bypass)} 2024-03-15 18:56:56,835 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-15 18:56:56,835 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710564958095 bypass)} 2024-03-15 18:56:57,085 INFO [Listener at localhost/33103] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-15 18:56:57,086 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-15 18:56:57,086 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1710564958095 bypass), TestNs=QuotaState(ts=1710564958095 bypass)} 2024-03-15 18:56:57,086 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1710564958095 bypass), TestNs:TestTable=QuotaState(ts=1710564958095 bypass)} 2024-03-15 18:56:57,086 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1710564958095 bypass)} 2024-03-15 18:56:57,086 DEBUG [Listener at localhost/33103] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1710564958095 bypass)} 2024-03-15 18:56:57,101 INFO [Listener at localhost/33103] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=266 (was 280), OpenFileDescriptor=588 (was 597), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=210 (was 213), ProcessCount=171 (was 171), AvailableMemoryMB=3033 (was 3031) - AvailableMemoryMB LEAK? - 2024-03-15 18:56:57,105 INFO [Listener at localhost/33103] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin0 2024-03-15 18:56:57,110 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin0 2024-03-15 18:56:57,118 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] procedure2.ProcedureExecutor(1075): Stored pid=27, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin0 2024-03-15 18:56:57,122 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710529017122"}]},"ts":"1710529017122"} 2024-03-15 18:56:57,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-03-15 18:56:57,124 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLING in hbase:meta 2024-03-15 18:56:57,126 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set TestQuotaAdmin0 to state=DISABLING 2024-03-15 18:56:57,128 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=154690127c6d9ab903c5d72a71661ab4, UNASSIGN}] 2024-03-15 18:56:57,129 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=154690127c6d9ab903c5d72a71661ab4, UNASSIGN 2024-03-15 18:56:57,130 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=154690127c6d9ab903c5d72a71661ab4, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45283,1710528951095 2024-03-15 18:56:57,130 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710529017130"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1710529017130"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1710529017130"}]},"ts":"1710529017130"} 2024-03-15 18:56:57,132 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure 154690127c6d9ab903c5d72a71661ab4, server=jenkins-hbase4.apache.org,45283,1710528951095}] 2024-03-15 18:56:57,266 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase4.apache.org,45283,1710528951095, timeout=1710529017287, delay=21, operations=[pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure 154690127c6d9ab903c5d72a71661ab4, server=jenkins-hbase4.apache.org,45283,1710528951095]] 2024-03-15 18:56:57,289 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,45283,1710528951095 2024-03-15 18:56:57,291 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 154690127c6d9ab903c5d72a71661ab4 2024-03-15 18:56:57,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 154690127c6d9ab903c5d72a71661ab4, disabling compactions & flushes 2024-03-15 18:56:57,292 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4. 2024-03-15 18:56:57,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4. 2024-03-15 18:56:57,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4. after waiting 0 ms 2024-03-15 18:56:57,292 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4. 2024-03-15 18:56:57,293 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 154690127c6d9ab903c5d72a71661ab4 1/1 column families, dataSize=578 B heapSize=2.11 KB 2024-03-15 18:56:57,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=578 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/default/TestQuotaAdmin0/154690127c6d9ab903c5d72a71661ab4/.tmp/cf/cbc95c711ee54039bb96645cadedac62 2024-03-15 18:56:57,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-03-15 18:56:57,413 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/default/TestQuotaAdmin0/154690127c6d9ab903c5d72a71661ab4/.tmp/cf/cbc95c711ee54039bb96645cadedac62 as hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/default/TestQuotaAdmin0/154690127c6d9ab903c5d72a71661ab4/cf/cbc95c711ee54039bb96645cadedac62 2024-03-15 18:56:57,423 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/default/TestQuotaAdmin0/154690127c6d9ab903c5d72a71661ab4/cf/cbc95c711ee54039bb96645cadedac62, entries=6, sequenceid=21, filesize=4.7 K 2024-03-15 18:56:57,426 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~578 B/578, heapSize ~2.09 KB/2144, currentSize=0 B/0 for 154690127c6d9ab903c5d72a71661ab4 in 133ms, sequenceid=21, compaction requested=false 2024-03-15 18:56:57,434 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/default/TestQuotaAdmin0/154690127c6d9ab903c5d72a71661ab4/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2024-03-15 18:56:57,436 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4. 2024-03-15 18:56:57,436 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 154690127c6d9ab903c5d72a71661ab4: 2024-03-15 18:56:57,438 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 154690127c6d9ab903c5d72a71661ab4 2024-03-15 18:56:57,439 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=154690127c6d9ab903c5d72a71661ab4, regionState=CLOSED 2024-03-15 18:56:57,439 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710529017439"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1710529017439"}]},"ts":"1710529017439"} 2024-03-15 18:56:57,443 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=29, resume processing ppid=28 2024-03-15 18:56:57,443 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=29, ppid=28, state=SUCCESS; CloseRegionProcedure 154690127c6d9ab903c5d72a71661ab4, server=jenkins-hbase4.apache.org,45283,1710528951095 in 309 msec 2024-03-15 18:56:57,445 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=28, resume processing ppid=27 2024-03-15 18:56:57,445 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=154690127c6d9ab903c5d72a71661ab4, UNASSIGN in 315 msec 2024-03-15 18:56:57,446 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710529017446"}]},"ts":"1710529017446"} 2024-03-15 18:56:57,447 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLED in hbase:meta 2024-03-15 18:56:57,449 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set TestQuotaAdmin0 to state=DISABLED 2024-03-15 18:56:57,452 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=27, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin0 in 338 msec 2024-03-15 18:56:57,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-03-15 18:56:57,876 INFO [Listener at localhost/33103] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin0, procId: 27 completed 2024-03-15 18:56:57,880 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin0 2024-03-15 18:56:57,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] procedure2.ProcedureExecutor(1075): Stored pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-15 18:56:57,889 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-15 18:56:57,891 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=30, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-15 18:56:57,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-03-15 18:56:57,898 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/default/TestQuotaAdmin0/154690127c6d9ab903c5d72a71661ab4 2024-03-15 18:56:57,902 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/default/TestQuotaAdmin0/154690127c6d9ab903c5d72a71661ab4/cf, FileablePath, hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/default/TestQuotaAdmin0/154690127c6d9ab903c5d72a71661ab4/recovered.edits] 2024-03-15 18:56:57,911 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/default/TestQuotaAdmin0/154690127c6d9ab903c5d72a71661ab4/cf/cbc95c711ee54039bb96645cadedac62 to hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/archive/data/default/TestQuotaAdmin0/154690127c6d9ab903c5d72a71661ab4/cf/cbc95c711ee54039bb96645cadedac62 2024-03-15 18:56:57,916 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/default/TestQuotaAdmin0/154690127c6d9ab903c5d72a71661ab4/recovered.edits/24.seqid to hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/archive/data/default/TestQuotaAdmin0/154690127c6d9ab903c5d72a71661ab4/recovered.edits/24.seqid 2024-03-15 18:56:57,918 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/default/TestQuotaAdmin0/154690127c6d9ab903c5d72a71661ab4 2024-03-15 18:56:57,918 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-03-15 18:56:57,922 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=30, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-15 18:56:57,942 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin0 from hbase:meta 2024-03-15 18:56:57,945 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin0' descriptor. 2024-03-15 18:56:57,947 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=30, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-15 18:56:57,947 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin0' from region states. 2024-03-15 18:56:57,947 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1710529017947"}]},"ts":"9223372036854775807"} 2024-03-15 18:56:57,949 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-03-15 18:56:57,949 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 154690127c6d9ab903c5d72a71661ab4, NAME => 'TestQuotaAdmin0,,1710528954225.154690127c6d9ab903c5d72a71661ab4.', STARTKEY => '', ENDKEY => ''}] 2024-03-15 18:56:57,949 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin0' as deleted. 2024-03-15 18:56:57,949 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1710529017949"}]},"ts":"9223372036854775807"} 2024-03-15 18:56:57,951 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin0 state from META 2024-03-15 18:56:57,953 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=30, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-15 18:56:57,955 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=30, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin0 in 71 msec 2024-03-15 18:56:58,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-03-15 18:56:58,147 INFO [Listener at localhost/33103] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin0, procId: 30 completed 2024-03-15 18:56:58,148 INFO [Listener at localhost/33103] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin1 2024-03-15 18:56:58,148 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin1 2024-03-15 18:56:58,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] procedure2.ProcedureExecutor(1075): Stored pid=31, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin1 2024-03-15 18:56:58,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-03-15 18:56:58,153 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710529018153"}]},"ts":"1710529018153"} 2024-03-15 18:56:58,155 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLING in hbase:meta 2024-03-15 18:56:58,157 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set TestQuotaAdmin1 to state=DISABLING 2024-03-15 18:56:58,158 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=01d491e85fa856a05e0d6c641f921ab7, UNASSIGN}] 2024-03-15 18:56:58,159 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=01d491e85fa856a05e0d6c641f921ab7, UNASSIGN 2024-03-15 18:56:58,160 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=01d491e85fa856a05e0d6c641f921ab7, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39929,1710528951051 2024-03-15 18:56:58,160 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1710528955027.01d491e85fa856a05e0d6c641f921ab7.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710529018160"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1710529018160"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1710529018160"}]},"ts":"1710529018160"} 2024-03-15 18:56:58,162 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=33, ppid=32, state=RUNNABLE; CloseRegionProcedure 01d491e85fa856a05e0d6c641f921ab7, server=jenkins-hbase4.apache.org,39929,1710528951051}] 2024-03-15 18:56:58,313 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,39929,1710528951051 2024-03-15 18:56:58,314 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 01d491e85fa856a05e0d6c641f921ab7 2024-03-15 18:56:58,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 01d491e85fa856a05e0d6c641f921ab7, disabling compactions & flushes 2024-03-15 18:56:58,315 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1710528955027.01d491e85fa856a05e0d6c641f921ab7. 2024-03-15 18:56:58,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1710528955027.01d491e85fa856a05e0d6c641f921ab7. 2024-03-15 18:56:58,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1710528955027.01d491e85fa856a05e0d6c641f921ab7. after waiting 0 ms 2024-03-15 18:56:58,315 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1710528955027.01d491e85fa856a05e0d6c641f921ab7. 2024-03-15 18:56:58,322 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/default/TestQuotaAdmin1/01d491e85fa856a05e0d6c641f921ab7/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-03-15 18:56:58,323 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1710528955027.01d491e85fa856a05e0d6c641f921ab7. 2024-03-15 18:56:58,323 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 01d491e85fa856a05e0d6c641f921ab7: 2024-03-15 18:56:58,325 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 01d491e85fa856a05e0d6c641f921ab7 2024-03-15 18:56:58,326 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=01d491e85fa856a05e0d6c641f921ab7, regionState=CLOSED 2024-03-15 18:56:58,326 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1710528955027.01d491e85fa856a05e0d6c641f921ab7.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710529018326"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1710529018326"}]},"ts":"1710529018326"} 2024-03-15 18:56:58,330 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=33, resume processing ppid=32 2024-03-15 18:56:58,330 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=33, ppid=32, state=SUCCESS; CloseRegionProcedure 01d491e85fa856a05e0d6c641f921ab7, server=jenkins-hbase4.apache.org,39929,1710528951051 in 166 msec 2024-03-15 18:56:58,332 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=32, resume processing ppid=31 2024-03-15 18:56:58,333 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=32, ppid=31, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=01d491e85fa856a05e0d6c641f921ab7, UNASSIGN in 172 msec 2024-03-15 18:56:58,333 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710529018333"}]},"ts":"1710529018333"} 2024-03-15 18:56:58,335 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLED in hbase:meta 2024-03-15 18:56:58,337 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set TestQuotaAdmin1 to state=DISABLED 2024-03-15 18:56:58,339 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=31, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin1 in 189 msec 2024-03-15 18:56:58,403 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-03-15 18:56:58,404 INFO [Listener at localhost/33103] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin1, procId: 31 completed 2024-03-15 18:56:58,405 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin1 2024-03-15 18:56:58,406 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] procedure2.ProcedureExecutor(1075): Stored pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-15 18:56:58,408 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-15 18:56:58,409 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=34, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-15 18:56:58,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-03-15 18:56:58,414 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/default/TestQuotaAdmin1/01d491e85fa856a05e0d6c641f921ab7 2024-03-15 18:56:58,416 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/default/TestQuotaAdmin1/01d491e85fa856a05e0d6c641f921ab7/cf, FileablePath, hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/default/TestQuotaAdmin1/01d491e85fa856a05e0d6c641f921ab7/recovered.edits] 2024-03-15 18:56:58,425 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/default/TestQuotaAdmin1/01d491e85fa856a05e0d6c641f921ab7/recovered.edits/4.seqid to hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/archive/data/default/TestQuotaAdmin1/01d491e85fa856a05e0d6c641f921ab7/recovered.edits/4.seqid 2024-03-15 18:56:58,426 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/default/TestQuotaAdmin1/01d491e85fa856a05e0d6c641f921ab7 2024-03-15 18:56:58,426 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-03-15 18:56:58,429 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=34, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-15 18:56:58,432 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin1 from hbase:meta 2024-03-15 18:56:58,434 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin1' descriptor. 2024-03-15 18:56:58,436 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=34, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-15 18:56:58,436 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin1' from region states. 2024-03-15 18:56:58,436 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1,,1710528955027.01d491e85fa856a05e0d6c641f921ab7.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1710529018436"}]},"ts":"9223372036854775807"} 2024-03-15 18:56:58,438 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-03-15 18:56:58,438 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 01d491e85fa856a05e0d6c641f921ab7, NAME => 'TestQuotaAdmin1,,1710528955027.01d491e85fa856a05e0d6c641f921ab7.', STARTKEY => '', ENDKEY => ''}] 2024-03-15 18:56:58,438 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin1' as deleted. 2024-03-15 18:56:58,438 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1710529018438"}]},"ts":"9223372036854775807"} 2024-03-15 18:56:58,440 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin1 state from META 2024-03-15 18:56:58,442 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=34, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-15 18:56:58,444 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=34, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin1 in 37 msec 2024-03-15 18:56:58,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-03-15 18:56:58,674 INFO [Listener at localhost/33103] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin1, procId: 34 completed 2024-03-15 18:56:58,675 INFO [Listener at localhost/33103] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin2 2024-03-15 18:56:58,676 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin2 2024-03-15 18:56:58,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] procedure2.ProcedureExecutor(1075): Stored pid=35, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin2 2024-03-15 18:56:58,682 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-03-15 18:56:58,684 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710529018683"}]},"ts":"1710529018683"} 2024-03-15 18:56:58,686 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLING in hbase:meta 2024-03-15 18:56:58,691 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set TestQuotaAdmin2 to state=DISABLING 2024-03-15 18:56:58,693 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=49346bec8e755881a1bcdb88ae39af22, UNASSIGN}] 2024-03-15 18:56:58,694 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=49346bec8e755881a1bcdb88ae39af22, UNASSIGN 2024-03-15 18:56:58,695 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=49346bec8e755881a1bcdb88ae39af22, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39929,1710528951051 2024-03-15 18:56:58,695 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1710528955806.49346bec8e755881a1bcdb88ae39af22.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710529018695"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1710529018695"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1710529018695"}]},"ts":"1710529018695"} 2024-03-15 18:56:58,697 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; CloseRegionProcedure 49346bec8e755881a1bcdb88ae39af22, server=jenkins-hbase4.apache.org,39929,1710528951051}] 2024-03-15 18:56:58,850 DEBUG [RSProcedureDispatcher-pool-5] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,39929,1710528951051 2024-03-15 18:56:58,850 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 49346bec8e755881a1bcdb88ae39af22 2024-03-15 18:56:58,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 49346bec8e755881a1bcdb88ae39af22, disabling compactions & flushes 2024-03-15 18:56:58,851 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1710528955806.49346bec8e755881a1bcdb88ae39af22. 2024-03-15 18:56:58,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1710528955806.49346bec8e755881a1bcdb88ae39af22. 2024-03-15 18:56:58,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1710528955806.49346bec8e755881a1bcdb88ae39af22. after waiting 0 ms 2024-03-15 18:56:58,851 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1710528955806.49346bec8e755881a1bcdb88ae39af22. 2024-03-15 18:56:58,856 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/default/TestQuotaAdmin2/49346bec8e755881a1bcdb88ae39af22/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-03-15 18:56:58,858 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1710528955806.49346bec8e755881a1bcdb88ae39af22. 2024-03-15 18:56:58,858 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 49346bec8e755881a1bcdb88ae39af22: 2024-03-15 18:56:58,860 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 49346bec8e755881a1bcdb88ae39af22 2024-03-15 18:56:58,860 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=49346bec8e755881a1bcdb88ae39af22, regionState=CLOSED 2024-03-15 18:56:58,861 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1710528955806.49346bec8e755881a1bcdb88ae39af22.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1710529018860"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1710529018860"}]},"ts":"1710529018860"} 2024-03-15 18:56:58,865 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=37, resume processing ppid=36 2024-03-15 18:56:58,865 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=37, ppid=36, state=SUCCESS; CloseRegionProcedure 49346bec8e755881a1bcdb88ae39af22, server=jenkins-hbase4.apache.org,39929,1710528951051 in 165 msec 2024-03-15 18:56:58,867 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=36, resume processing ppid=35 2024-03-15 18:56:58,867 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=49346bec8e755881a1bcdb88ae39af22, UNASSIGN in 172 msec 2024-03-15 18:56:58,868 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710529018868"}]},"ts":"1710529018868"} 2024-03-15 18:56:58,870 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLED in hbase:meta 2024-03-15 18:56:58,872 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set TestQuotaAdmin2 to state=DISABLED 2024-03-15 18:56:58,874 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=35, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin2 in 197 msec 2024-03-15 18:56:58,933 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-03-15 18:56:58,933 INFO [Listener at localhost/33103] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin2, procId: 35 completed 2024-03-15 18:56:58,934 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin2 2024-03-15 18:56:58,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] procedure2.ProcedureExecutor(1075): Stored pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-15 18:56:58,937 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-15 18:56:58,938 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=38, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-15 18:56:58,940 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-03-15 18:56:58,943 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/default/TestQuotaAdmin2/49346bec8e755881a1bcdb88ae39af22 2024-03-15 18:56:58,945 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/default/TestQuotaAdmin2/49346bec8e755881a1bcdb88ae39af22/cf, FileablePath, hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/default/TestQuotaAdmin2/49346bec8e755881a1bcdb88ae39af22/recovered.edits] 2024-03-15 18:56:58,953 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/default/TestQuotaAdmin2/49346bec8e755881a1bcdb88ae39af22/recovered.edits/4.seqid to hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/archive/data/default/TestQuotaAdmin2/49346bec8e755881a1bcdb88ae39af22/recovered.edits/4.seqid 2024-03-15 18:56:58,953 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/default/TestQuotaAdmin2/49346bec8e755881a1bcdb88ae39af22 2024-03-15 18:56:58,953 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-03-15 18:56:58,956 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=38, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-15 18:56:58,958 WARN [PEWorker-5] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin2 from hbase:meta 2024-03-15 18:56:58,960 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin2' descriptor. 2024-03-15 18:56:58,961 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=38, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-15 18:56:58,961 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin2' from region states. 2024-03-15 18:56:58,961 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2,,1710528955806.49346bec8e755881a1bcdb88ae39af22.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1710529018961"}]},"ts":"9223372036854775807"} 2024-03-15 18:56:58,962 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-03-15 18:56:58,963 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 49346bec8e755881a1bcdb88ae39af22, NAME => 'TestQuotaAdmin2,,1710528955806.49346bec8e755881a1bcdb88ae39af22.', STARTKEY => '', ENDKEY => ''}] 2024-03-15 18:56:58,963 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin2' as deleted. 2024-03-15 18:56:58,963 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1710529018963"}]},"ts":"9223372036854775807"} 2024-03-15 18:56:58,964 INFO [PEWorker-5] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin2 state from META 2024-03-15 18:56:58,967 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(130): Finished pid=38, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-15 18:56:58,968 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=38, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin2 in 33 msec 2024-03-15 18:56:59,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-03-15 18:56:59,192 INFO [Listener at localhost/33103] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin2, procId: 38 completed 2024-03-15 18:56:59,192 INFO [Listener at localhost/33103] client.HBaseAdmin$15(890): Started disable of TestNs:TestTable 2024-03-15 18:56:59,193 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestNs:TestTable 2024-03-15 18:56:59,194 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] procedure2.ProcedureExecutor(1075): Stored pid=39, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestNs:TestTable 2024-03-15 18:56:59,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-03-15 18:56:59,198 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710529019198"}]},"ts":"1710529019198"} 2024-03-15 18:56:59,200 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLING in hbase:meta 2024-03-15 18:56:59,202 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set TestNs:TestTable to state=DISABLING 2024-03-15 18:56:59,203 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=200c48e3c898617869f3925d68300580, UNASSIGN}, {pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=01d0cab38ec50c2dc5581987dc8f8b89, UNASSIGN}] 2024-03-15 18:56:59,204 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=01d0cab38ec50c2dc5581987dc8f8b89, UNASSIGN 2024-03-15 18:56:59,204 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=200c48e3c898617869f3925d68300580, UNASSIGN 2024-03-15 18:56:59,205 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=01d0cab38ec50c2dc5581987dc8f8b89, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45283,1710528951095 2024-03-15 18:56:59,205 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=200c48e3c898617869f3925d68300580, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,39929,1710528951051 2024-03-15 18:56:59,206 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1710528956848.01d0cab38ec50c2dc5581987dc8f8b89.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1710529019205"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1710529019205"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1710529019205"}]},"ts":"1710529019205"} 2024-03-15 18:56:59,206 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1710528956848.200c48e3c898617869f3925d68300580.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1710529019205"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1710529019205"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1710529019205"}]},"ts":"1710529019205"} 2024-03-15 18:56:59,207 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=42, ppid=41, state=RUNNABLE; CloseRegionProcedure 01d0cab38ec50c2dc5581987dc8f8b89, server=jenkins-hbase4.apache.org,45283,1710528951095}] 2024-03-15 18:56:59,212 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=43, ppid=40, state=RUNNABLE; CloseRegionProcedure 200c48e3c898617869f3925d68300580, server=jenkins-hbase4.apache.org,39929,1710528951051}] 2024-03-15 18:56:59,363 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,45283,1710528951095 2024-03-15 18:56:59,364 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 01d0cab38ec50c2dc5581987dc8f8b89 2024-03-15 18:56:59,366 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,39929,1710528951051 2024-03-15 18:56:59,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 01d0cab38ec50c2dc5581987dc8f8b89, disabling compactions & flushes 2024-03-15 18:56:59,366 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1710528956848.01d0cab38ec50c2dc5581987dc8f8b89. 2024-03-15 18:56:59,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1710528956848.01d0cab38ec50c2dc5581987dc8f8b89. 2024-03-15 18:56:59,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1710528956848.01d0cab38ec50c2dc5581987dc8f8b89. after waiting 0 ms 2024-03-15 18:56:59,366 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1710528956848.01d0cab38ec50c2dc5581987dc8f8b89. 2024-03-15 18:56:59,367 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 200c48e3c898617869f3925d68300580 2024-03-15 18:56:59,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 200c48e3c898617869f3925d68300580, disabling compactions & flushes 2024-03-15 18:56:59,368 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1710528956848.200c48e3c898617869f3925d68300580. 2024-03-15 18:56:59,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1710528956848.200c48e3c898617869f3925d68300580. 2024-03-15 18:56:59,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1710528956848.200c48e3c898617869f3925d68300580. after waiting 0 ms 2024-03-15 18:56:59,368 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1710528956848.200c48e3c898617869f3925d68300580. 2024-03-15 18:56:59,378 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/TestNs/TestTable/01d0cab38ec50c2dc5581987dc8f8b89/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-03-15 18:56:59,379 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/TestNs/TestTable/200c48e3c898617869f3925d68300580/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-03-15 18:56:59,380 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1710528956848.01d0cab38ec50c2dc5581987dc8f8b89. 2024-03-15 18:56:59,380 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 01d0cab38ec50c2dc5581987dc8f8b89: 2024-03-15 18:56:59,381 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1710528956848.200c48e3c898617869f3925d68300580. 2024-03-15 18:56:59,381 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 200c48e3c898617869f3925d68300580: 2024-03-15 18:56:59,384 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 01d0cab38ec50c2dc5581987dc8f8b89 2024-03-15 18:56:59,385 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=01d0cab38ec50c2dc5581987dc8f8b89, regionState=CLOSED 2024-03-15 18:56:59,385 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1710528956848.01d0cab38ec50c2dc5581987dc8f8b89.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1710529019385"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1710529019385"}]},"ts":"1710529019385"} 2024-03-15 18:56:59,385 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 200c48e3c898617869f3925d68300580 2024-03-15 18:56:59,386 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=200c48e3c898617869f3925d68300580, regionState=CLOSED 2024-03-15 18:56:59,386 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,,1710528956848.200c48e3c898617869f3925d68300580.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1710529019386"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1710529019386"}]},"ts":"1710529019386"} 2024-03-15 18:56:59,390 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=42, resume processing ppid=41 2024-03-15 18:56:59,390 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=42, ppid=41, state=SUCCESS; CloseRegionProcedure 01d0cab38ec50c2dc5581987dc8f8b89, server=jenkins-hbase4.apache.org,45283,1710528951095 in 180 msec 2024-03-15 18:56:59,391 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=43, resume processing ppid=40 2024-03-15 18:56:59,394 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=43, ppid=40, state=SUCCESS; CloseRegionProcedure 200c48e3c898617869f3925d68300580, server=jenkins-hbase4.apache.org,39929,1710528951051 in 180 msec 2024-03-15 18:56:59,395 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=41, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=01d0cab38ec50c2dc5581987dc8f8b89, UNASSIGN in 187 msec 2024-03-15 18:56:59,396 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=40, resume processing ppid=39 2024-03-15 18:56:59,396 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=200c48e3c898617869f3925d68300580, UNASSIGN in 189 msec 2024-03-15 18:56:59,398 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1710529019398"}]},"ts":"1710529019398"} 2024-03-15 18:56:59,405 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLED in hbase:meta 2024-03-15 18:56:59,408 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set TestNs:TestTable to state=DISABLED 2024-03-15 18:56:59,412 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=39, state=SUCCESS; DisableTableProcedure table=TestNs:TestTable in 217 msec 2024-03-15 18:56:59,449 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-03-15 18:56:59,449 INFO [Listener at localhost/33103] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: TestNs:TestTable, procId: 39 completed 2024-03-15 18:56:59,450 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestNs:TestTable 2024-03-15 18:56:59,451 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] procedure2.ProcedureExecutor(1075): Stored pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestNs:TestTable 2024-03-15 18:56:59,454 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-15 18:56:59,455 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=44, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-15 18:56:59,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-03-15 18:56:59,465 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/TestNs/TestTable/200c48e3c898617869f3925d68300580 2024-03-15 18:56:59,465 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/TestNs/TestTable/01d0cab38ec50c2dc5581987dc8f8b89 2024-03-15 18:56:59,470 DEBUG [HFileArchiver-11] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/TestNs/TestTable/200c48e3c898617869f3925d68300580/cf, FileablePath, hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/TestNs/TestTable/200c48e3c898617869f3925d68300580/recovered.edits] 2024-03-15 18:56:59,471 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/TestNs/TestTable/01d0cab38ec50c2dc5581987dc8f8b89/cf, FileablePath, hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/TestNs/TestTable/01d0cab38ec50c2dc5581987dc8f8b89/recovered.edits] 2024-03-15 18:56:59,485 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/TestNs/TestTable/01d0cab38ec50c2dc5581987dc8f8b89/recovered.edits/4.seqid to hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/archive/data/TestNs/TestTable/01d0cab38ec50c2dc5581987dc8f8b89/recovered.edits/4.seqid 2024-03-15 18:56:59,486 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/TestNs/TestTable/01d0cab38ec50c2dc5581987dc8f8b89 2024-03-15 18:56:59,490 DEBUG [HFileArchiver-11] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/TestNs/TestTable/200c48e3c898617869f3925d68300580/recovered.edits/4.seqid to hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/archive/data/TestNs/TestTable/200c48e3c898617869f3925d68300580/recovered.edits/4.seqid 2024-03-15 18:56:59,491 DEBUG [HFileArchiver-11] backup.HFileArchiver(596): Deleted hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/.tmp/data/TestNs/TestTable/200c48e3c898617869f3925d68300580 2024-03-15 18:56:59,491 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-03-15 18:56:59,496 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=44, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-15 18:56:59,498 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of TestNs:TestTable from hbase:meta 2024-03-15 18:56:59,501 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'TestNs:TestTable' descriptor. 2024-03-15 18:56:59,505 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=44, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-15 18:56:59,505 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'TestNs:TestTable' from region states. 2024-03-15 18:56:59,505 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,,1710528956848.200c48e3c898617869f3925d68300580.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1710529019505"}]},"ts":"9223372036854775807"} 2024-03-15 18:56:59,505 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,1,1710528956848.01d0cab38ec50c2dc5581987dc8f8b89.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1710529019505"}]},"ts":"9223372036854775807"} 2024-03-15 18:56:59,508 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2024-03-15 18:56:59,508 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 200c48e3c898617869f3925d68300580, NAME => 'TestNs:TestTable,,1710528956848.200c48e3c898617869f3925d68300580.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 01d0cab38ec50c2dc5581987dc8f8b89, NAME => 'TestNs:TestTable,1,1710528956848.01d0cab38ec50c2dc5581987dc8f8b89.', STARTKEY => '1', ENDKEY => ''}] 2024-03-15 18:56:59,508 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'TestNs:TestTable' as deleted. 2024-03-15 18:56:59,508 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1710529019508"}]},"ts":"9223372036854775807"} 2024-03-15 18:56:59,510 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table TestNs:TestTable state from META 2024-03-15 18:56:59,514 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=44, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-15 18:56:59,517 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=44, state=SUCCESS; DeleteTableProcedure table=TestNs:TestTable in 64 msec 2024-03-15 18:56:59,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-03-15 18:56:59,709 INFO [Listener at localhost/33103] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: TestNs:TestTable, procId: 44 completed 2024-03-15 18:56:59,714 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.HMaster$17(3092): Client=jenkins//172.31.14.131 delete TestNs 2024-03-15 18:56:59,721 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] procedure2.ProcedureExecutor(1075): Stored pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE; DeleteNamespaceProcedure, namespace=TestNs 2024-03-15 18:56:59,723 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-15 18:56:59,727 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_FROM_NS_TABLE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-15 18:56:59,729 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_FROM_ZK, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-15 18:56:59,730 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-03-15 18:56:59,731 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace/TestNs 2024-03-15 18:56:59,731 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-03-15 18:56:59,732 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_DIRECTORIES, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-15 18:56:59,736 INFO [PEWorker-2] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_NAMESPACE_QUOTA, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-15 18:56:59,738 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=45, state=SUCCESS; DeleteNamespaceProcedure, namespace=TestNs in 22 msec 2024-03-15 18:56:59,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35499] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-03-15 18:56:59,981 INFO [Listener at localhost/33103] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2024-03-15 18:56:59,982 INFO [Listener at localhost/33103] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-03-15 18:56:59,982 DEBUG [Listener at localhost/33103] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57016e43 to 127.0.0.1:63302 2024-03-15 18:56:59,982 DEBUG [Listener at localhost/33103] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-15 18:56:59,982 DEBUG [Listener at localhost/33103] util.JVMClusterUtil(237): Shutting down HBase Cluster 2024-03-15 18:56:59,982 DEBUG [Listener at localhost/33103] util.JVMClusterUtil(257): Found active master hash=679653739, stopped=false 2024-03-15 18:56:59,983 DEBUG [Listener at localhost/33103] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-03-15 18:56:59,983 INFO [Listener at localhost/33103] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35499,1710528949842 2024-03-15 18:56:59,985 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-03-15 18:56:59,986 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): regionserver:45283-0x10068d932620002, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-03-15 18:56:59,986 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-15 18:56:59,986 INFO [Listener at localhost/33103] procedure2.ProcedureExecutor(675): Stopping 2024-03-15 18:56:59,985 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): regionserver:39929-0x10068d932620001, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-03-15 18:56:59,986 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-15 18:56:59,986 DEBUG [Listener at localhost/33103] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x39fb4f42 to 127.0.0.1:63302 2024-03-15 18:56:59,986 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:45283-0x10068d932620002, quorum=127.0.0.1:63302, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-15 18:56:59,986 DEBUG [Listener at localhost/33103] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-15 18:56:59,987 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:39929-0x10068d932620001, quorum=127.0.0.1:63302, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-15 18:56:59,987 INFO [Listener at localhost/33103] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,39929,1710528951051' ***** 2024-03-15 18:56:59,987 INFO [Listener at localhost/33103] regionserver.HRegionServer(2313): STOPPED: Shutdown requested 2024-03-15 18:56:59,987 INFO [Listener at localhost/33103] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,45283,1710528951095' ***** 2024-03-15 18:56:59,987 INFO [Listener at localhost/33103] regionserver.HRegionServer(2313): STOPPED: Shutdown requested 2024-03-15 18:56:59,987 INFO [RS:0;jenkins-hbase4:39929] regionserver.HeapMemoryManager(220): Stopping 2024-03-15 18:56:59,987 INFO [RS:1;jenkins-hbase4:45283] regionserver.HeapMemoryManager(220): Stopping 2024-03-15 18:56:59,987 INFO [RS:0;jenkins-hbase4:39929] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-03-15 18:56:59,987 INFO [RS:0;jenkins-hbase4:39929] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-03-15 18:56:59,987 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-03-15 18:56:59,987 INFO [RS:0;jenkins-hbase4:39929] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,39929,1710528951051 2024-03-15 18:56:59,987 INFO [RS:0;jenkins-hbase4:39929] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-03-15 18:56:59,988 DEBUG [RS:0;jenkins-hbase4:39929] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x166a049f to 127.0.0.1:63302 2024-03-15 18:56:59,988 INFO [RS:1;jenkins-hbase4:45283] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-03-15 18:56:59,988 DEBUG [RS:0;jenkins-hbase4:39929] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-15 18:56:59,988 INFO [RS:1;jenkins-hbase4:45283] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-03-15 18:56:59,988 INFO [RS:0;jenkins-hbase4:39929] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-03-15 18:56:59,988 INFO [RS:0;jenkins-hbase4:39929] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-03-15 18:56:59,988 INFO [RS:1;jenkins-hbase4:45283] regionserver.HRegionServer(3307): Received CLOSE for cf8bc41b7e1f77cb9a84f24a0f02648e 2024-03-15 18:56:59,988 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-03-15 18:56:59,988 INFO [RS:0;jenkins-hbase4:39929] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-03-15 18:56:59,988 INFO [RS:0;jenkins-hbase4:39929] regionserver.HRegionServer(3307): Received CLOSE for 1588230740 2024-03-15 18:56:59,988 INFO [RS:1;jenkins-hbase4:45283] regionserver.HRegionServer(3307): Received CLOSE for a3640c3e576627c2bc4fb1a7c0e740e5 2024-03-15 18:56:59,988 INFO [RS:1;jenkins-hbase4:45283] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,45283,1710528951095 2024-03-15 18:56:59,989 INFO [RS:0;jenkins-hbase4:39929] regionserver.HRegionServer(1477): Waiting on 1 regions to close 2024-03-15 18:56:59,989 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing cf8bc41b7e1f77cb9a84f24a0f02648e, disabling compactions & flushes 2024-03-15 18:56:59,989 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-03-15 18:56:59,990 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:quota,,1710528953657.cf8bc41b7e1f77cb9a84f24a0f02648e. 2024-03-15 18:56:59,990 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-03-15 18:56:59,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1710528953657.cf8bc41b7e1f77cb9a84f24a0f02648e. 2024-03-15 18:56:59,990 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-03-15 18:56:59,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1710528953657.cf8bc41b7e1f77cb9a84f24a0f02648e. after waiting 0 ms 2024-03-15 18:56:59,989 DEBUG [RS:0;jenkins-hbase4:39929] regionserver.HRegionServer(1481): Online Regions={1588230740=hbase:meta,,1.1588230740} 2024-03-15 18:56:59,989 INFO [RS:1;jenkins-hbase4:45283] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-03-15 18:56:59,990 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1710528953657.cf8bc41b7e1f77cb9a84f24a0f02648e. 2024-03-15 18:56:59,990 DEBUG [RS:1;jenkins-hbase4:45283] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x7660be28 to 127.0.0.1:63302 2024-03-15 18:56:59,990 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-03-15 18:56:59,990 DEBUG [RS:1;jenkins-hbase4:45283] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-15 18:56:59,990 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing cf8bc41b7e1f77cb9a84f24a0f02648e 2/2 column families, dataSize=726 B heapSize=2.44 KB 2024-03-15 18:56:59,990 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-03-15 18:56:59,990 INFO [RS:1;jenkins-hbase4:45283] regionserver.HRegionServer(1477): Waiting on 2 regions to close 2024-03-15 18:56:59,990 DEBUG [RS:1;jenkins-hbase4:45283] regionserver.HRegionServer(1481): Online Regions={cf8bc41b7e1f77cb9a84f24a0f02648e=hbase:quota,,1710528953657.cf8bc41b7e1f77cb9a84f24a0f02648e., a3640c3e576627c2bc4fb1a7c0e740e5=hbase:namespace,,1710528952938.a3640c3e576627c2bc4fb1a7c0e740e5.} 2024-03-15 18:56:59,990 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=14.15 KB heapSize=25.10 KB 2024-03-15 18:56:59,991 DEBUG [RS:1;jenkins-hbase4:45283] regionserver.HRegionServer(1507): Waiting on a3640c3e576627c2bc4fb1a7c0e740e5, cf8bc41b7e1f77cb9a84f24a0f02648e 2024-03-15 18:56:59,991 DEBUG [RS:0;jenkins-hbase4:39929] regionserver.HRegionServer(1507): Waiting on 1588230740 2024-03-15 18:57:00,020 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-03-15 18:57:00,021 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=597 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/quota/cf8bc41b7e1f77cb9a84f24a0f02648e/.tmp/q/423b503bc70647699e9142ece7846a6d 2024-03-15 18:57:00,030 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 423b503bc70647699e9142ece7846a6d 2024-03-15 18:57:00,043 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-03-15 18:57:00,043 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-03-15 18:57:00,045 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=129 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/quota/cf8bc41b7e1f77cb9a84f24a0f02648e/.tmp/u/07cd446820bb41fc8991a35b34a28e15 2024-03-15 18:57:00,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 07cd446820bb41fc8991a35b34a28e15 2024-03-15 18:57:00,053 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/quota/cf8bc41b7e1f77cb9a84f24a0f02648e/.tmp/q/423b503bc70647699e9142ece7846a6d as hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/quota/cf8bc41b7e1f77cb9a84f24a0f02648e/q/423b503bc70647699e9142ece7846a6d 2024-03-15 18:57:00,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 423b503bc70647699e9142ece7846a6d 2024-03-15 18:57:00,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/quota/cf8bc41b7e1f77cb9a84f24a0f02648e/q/423b503bc70647699e9142ece7846a6d, entries=5, sequenceid=17, filesize=5.1 K 2024-03-15 18:57:00,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/quota/cf8bc41b7e1f77cb9a84f24a0f02648e/.tmp/u/07cd446820bb41fc8991a35b34a28e15 as hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/quota/cf8bc41b7e1f77cb9a84f24a0f02648e/u/07cd446820bb41fc8991a35b34a28e15 2024-03-15 18:57:00,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 07cd446820bb41fc8991a35b34a28e15 2024-03-15 18:57:00,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/quota/cf8bc41b7e1f77cb9a84f24a0f02648e/u/07cd446820bb41fc8991a35b34a28e15, entries=4, sequenceid=17, filesize=5.0 K 2024-03-15 18:57:00,072 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~726 B/726, heapSize ~2.41 KB/2464, currentSize=0 B/0 for cf8bc41b7e1f77cb9a84f24a0f02648e in 81ms, sequenceid=17, compaction requested=false 2024-03-15 18:57:00,082 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/quota/cf8bc41b7e1f77cb9a84f24a0f02648e/recovered.edits/20.seqid, newMaxSeqId=20, maxSeqId=1 2024-03-15 18:57:00,083 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:quota,,1710528953657.cf8bc41b7e1f77cb9a84f24a0f02648e. 2024-03-15 18:57:00,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for cf8bc41b7e1f77cb9a84f24a0f02648e: 2024-03-15 18:57:00,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:quota,,1710528953657.cf8bc41b7e1f77cb9a84f24a0f02648e. 2024-03-15 18:57:00,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a3640c3e576627c2bc4fb1a7c0e740e5, disabling compactions & flushes 2024-03-15 18:57:00,083 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1710528952938.a3640c3e576627c2bc4fb1a7c0e740e5. 2024-03-15 18:57:00,083 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1710528952938.a3640c3e576627c2bc4fb1a7c0e740e5. 2024-03-15 18:57:00,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1710528952938.a3640c3e576627c2bc4fb1a7c0e740e5. after waiting 0 ms 2024-03-15 18:57:00,084 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1710528952938.a3640c3e576627c2bc4fb1a7c0e740e5. 2024-03-15 18:57:00,084 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing a3640c3e576627c2bc4fb1a7c0e740e5 1/1 column families, dataSize=147 B heapSize=704 B 2024-03-15 18:57:00,103 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=147 B at sequenceid=8 (bloomFilter=true), to=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/namespace/a3640c3e576627c2bc4fb1a7c0e740e5/.tmp/info/0fd3b00c339d4d0aae66adcc2d84de40 2024-03-15 18:57:00,111 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0fd3b00c339d4d0aae66adcc2d84de40 2024-03-15 18:57:00,113 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/namespace/a3640c3e576627c2bc4fb1a7c0e740e5/.tmp/info/0fd3b00c339d4d0aae66adcc2d84de40 as hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/namespace/a3640c3e576627c2bc4fb1a7c0e740e5/info/0fd3b00c339d4d0aae66adcc2d84de40 2024-03-15 18:57:00,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0fd3b00c339d4d0aae66adcc2d84de40 2024-03-15 18:57:00,122 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/namespace/a3640c3e576627c2bc4fb1a7c0e740e5/info/0fd3b00c339d4d0aae66adcc2d84de40, entries=3, sequenceid=8, filesize=5.0 K 2024-03-15 18:57:00,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~147 B/147, heapSize ~688 B/688, currentSize=0 B/0 for a3640c3e576627c2bc4fb1a7c0e740e5 in 39ms, sequenceid=8, compaction requested=false 2024-03-15 18:57:00,129 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/namespace/a3640c3e576627c2bc4fb1a7c0e740e5/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=1 2024-03-15 18:57:00,130 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1710528952938.a3640c3e576627c2bc4fb1a7c0e740e5. 2024-03-15 18:57:00,130 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a3640c3e576627c2bc4fb1a7c0e740e5: 2024-03-15 18:57:00,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1710528952938.a3640c3e576627c2bc4fb1a7c0e740e5. 2024-03-15 18:57:00,191 INFO [RS:1;jenkins-hbase4:45283] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,45283,1710528951095; all regions closed. 2024-03-15 18:57:00,192 DEBUG [RS:1;jenkins-hbase4:45283] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-03-15 18:57:00,192 DEBUG [RS:0;jenkins-hbase4:39929] regionserver.HRegionServer(1507): Waiting on 1588230740 2024-03-15 18:57:00,201 DEBUG [RS:1;jenkins-hbase4:45283] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/oldWALs 2024-03-15 18:57:00,201 INFO [RS:1;jenkins-hbase4:45283] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45283%2C1710528951095:(num 1710528952551) 2024-03-15 18:57:00,201 DEBUG [RS:1;jenkins-hbase4:45283] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-15 18:57:00,201 INFO [RS:1;jenkins-hbase4:45283] regionserver.LeaseManager(133): Closed leases 2024-03-15 18:57:00,202 INFO [RS:1;jenkins-hbase4:45283] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2024-03-15 18:57:00,202 INFO [RS:1;jenkins-hbase4:45283] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-03-15 18:57:00,202 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-03-15 18:57:00,202 INFO [RS:1;jenkins-hbase4:45283] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-03-15 18:57:00,202 INFO [RS:1;jenkins-hbase4:45283] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-03-15 18:57:00,203 INFO [RS:1;jenkins-hbase4:45283] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45283 2024-03-15 18:57:00,209 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): regionserver:45283-0x10068d932620002, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45283,1710528951095 2024-03-15 18:57:00,209 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-03-15 18:57:00,209 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): regionserver:45283-0x10068d932620002, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-03-15 18:57:00,209 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): regionserver:39929-0x10068d932620001, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45283,1710528951095 2024-03-15 18:57:00,209 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): regionserver:39929-0x10068d932620001, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-03-15 18:57:00,210 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45283,1710528951095] 2024-03-15 18:57:00,211 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45283,1710528951095; numProcessing=1 2024-03-15 18:57:00,212 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45283,1710528951095 already deleted, retry=false 2024-03-15 18:57:00,212 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,45283,1710528951095 expired; onlineServers=1 2024-03-15 18:57:00,311 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): regionserver:45283-0x10068d932620002, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-15 18:57:00,311 INFO [RS:1;jenkins-hbase4:45283] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,45283,1710528951095; zookeeper connection closed. 2024-03-15 18:57:00,311 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): regionserver:45283-0x10068d932620002, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-15 18:57:00,312 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@60eddbca] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@60eddbca 2024-03-15 18:57:00,392 DEBUG [RS:0;jenkins-hbase4:39929] regionserver.HRegionServer(1507): Waiting on 1588230740 2024-03-15 18:57:00,407 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2024-03-15 18:57:00,407 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2024-03-15 18:57:00,422 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=12.16 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/meta/1588230740/.tmp/info/e5cd60722c26469ca9483882af253f8c 2024-03-15 18:57:00,432 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e5cd60722c26469ca9483882af253f8c 2024-03-15 18:57:00,449 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=478 B at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/meta/1588230740/.tmp/rep_barrier/b36b61b596b74a9182e455493d4640da 2024-03-15 18:57:00,457 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b36b61b596b74a9182e455493d4640da 2024-03-15 18:57:00,474 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.53 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/meta/1588230740/.tmp/table/92b8545fb1e64b7994fd87c78178369c 2024-03-15 18:57:00,481 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 92b8545fb1e64b7994fd87c78178369c 2024-03-15 18:57:00,483 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/meta/1588230740/.tmp/info/e5cd60722c26469ca9483882af253f8c as hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/meta/1588230740/info/e5cd60722c26469ca9483882af253f8c 2024-03-15 18:57:00,490 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e5cd60722c26469ca9483882af253f8c 2024-03-15 18:57:00,491 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/meta/1588230740/info/e5cd60722c26469ca9483882af253f8c, entries=30, sequenceid=66, filesize=8.0 K 2024-03-15 18:57:00,493 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/meta/1588230740/.tmp/rep_barrier/b36b61b596b74a9182e455493d4640da as hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/meta/1588230740/rep_barrier/b36b61b596b74a9182e455493d4640da 2024-03-15 18:57:00,500 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for b36b61b596b74a9182e455493d4640da 2024-03-15 18:57:00,500 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/meta/1588230740/rep_barrier/b36b61b596b74a9182e455493d4640da, entries=5, sequenceid=66, filesize=5.3 K 2024-03-15 18:57:00,505 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/meta/1588230740/.tmp/table/92b8545fb1e64b7994fd87c78178369c as hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/meta/1588230740/table/92b8545fb1e64b7994fd87c78178369c 2024-03-15 18:57:00,514 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 92b8545fb1e64b7994fd87c78178369c 2024-03-15 18:57:00,514 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/meta/1588230740/table/92b8545fb1e64b7994fd87c78178369c, entries=13, sequenceid=66, filesize=5.6 K 2024-03-15 18:57:00,515 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~14.15 KB/14494, heapSize ~25.05 KB/25656, currentSize=0 B/0 for 1588230740 in 525ms, sequenceid=66, compaction requested=false 2024-03-15 18:57:00,527 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/data/hbase/meta/1588230740/recovered.edits/69.seqid, newMaxSeqId=69, maxSeqId=1 2024-03-15 18:57:00,528 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-03-15 18:57:00,528 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-03-15 18:57:00,528 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-03-15 18:57:00,528 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2024-03-15 18:57:00,592 INFO [RS:0;jenkins-hbase4:39929] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,39929,1710528951051; all regions closed. 2024-03-15 18:57:00,592 DEBUG [RS:0;jenkins-hbase4:39929] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-03-15 18:57:00,599 DEBUG [RS:0;jenkins-hbase4:39929] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/oldWALs 2024-03-15 18:57:00,599 INFO [RS:0;jenkins-hbase4:39929] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39929%2C1710528951051.meta:.meta(num 1710528952676) 2024-03-15 18:57:00,605 DEBUG [RS:0;jenkins-hbase4:39929] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/oldWALs 2024-03-15 18:57:00,605 INFO [RS:0;jenkins-hbase4:39929] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C39929%2C1710528951051:(num 1710528952551) 2024-03-15 18:57:00,605 DEBUG [RS:0;jenkins-hbase4:39929] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-15 18:57:00,605 INFO [RS:0;jenkins-hbase4:39929] regionserver.LeaseManager(133): Closed leases 2024-03-15 18:57:00,606 INFO [RS:0;jenkins-hbase4:39929] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2024-03-15 18:57:00,606 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-03-15 18:57:00,607 INFO [RS:0;jenkins-hbase4:39929] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:39929 2024-03-15 18:57:00,609 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): regionserver:39929-0x10068d932620001, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,39929,1710528951051 2024-03-15 18:57:00,609 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-03-15 18:57:00,610 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,39929,1710528951051] 2024-03-15 18:57:00,610 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,39929,1710528951051; numProcessing=2 2024-03-15 18:57:00,612 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,39929,1710528951051 already deleted, retry=false 2024-03-15 18:57:00,612 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,39929,1710528951051 expired; onlineServers=0 2024-03-15 18:57:00,612 INFO [RegionServerTracker-0] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,35499,1710528949842' ***** 2024-03-15 18:57:00,612 INFO [RegionServerTracker-0] regionserver.HRegionServer(2313): STOPPED: Cluster shutdown set; onlineServer=0 2024-03-15 18:57:00,613 DEBUG [M:0;jenkins-hbase4:35499] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@65a8ee77, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-03-15 18:57:00,613 INFO [M:0;jenkins-hbase4:35499] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,35499,1710528949842 2024-03-15 18:57:00,613 INFO [M:0;jenkins-hbase4:35499] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,35499,1710528949842; all regions closed. 2024-03-15 18:57:00,613 DEBUG [M:0;jenkins-hbase4:35499] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-15 18:57:00,613 DEBUG [M:0;jenkins-hbase4:35499] cleaner.LogCleaner(198): Cancelling LogCleaner 2024-03-15 18:57:00,613 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2024-03-15 18:57:00,613 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1710528952198] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1710528952198,5,FailOnTimeoutGroup] 2024-03-15 18:57:00,613 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1710528952200] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1710528952200,5,FailOnTimeoutGroup] 2024-03-15 18:57:00,613 DEBUG [M:0;jenkins-hbase4:35499] cleaner.HFileCleaner(317): Stopping file delete threads 2024-03-15 18:57:00,614 INFO [M:0;jenkins-hbase4:35499] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2024-03-15 18:57:00,614 INFO [M:0;jenkins-hbase4:35499] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2024-03-15 18:57:00,614 INFO [M:0;jenkins-hbase4:35499] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS] on shutdown 2024-03-15 18:57:00,614 DEBUG [M:0;jenkins-hbase4:35499] master.HMaster(1517): Stopping service threads 2024-03-15 18:57:00,614 INFO [M:0;jenkins-hbase4:35499] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2024-03-15 18:57:00,614 ERROR [M:0;jenkins-hbase4:35499] procedure2.ProcedureExecutor(699): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-8,5,PEWorkerGroup] Thread[HFileArchiver-9,5,PEWorkerGroup] Thread[HFileArchiver-10,5,PEWorkerGroup] Thread[HFileArchiver-11,5,PEWorkerGroup] Thread[HFileArchiver-12,5,PEWorkerGroup] 2024-03-15 18:57:00,615 INFO [M:0;jenkins-hbase4:35499] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2024-03-15 18:57:00,615 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2024-03-15 18:57:00,619 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2024-03-15 18:57:00,619 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-15 18:57:00,619 DEBUG [M:0;jenkins-hbase4:35499] zookeeper.ZKUtil(399): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2024-03-15 18:57:00,619 WARN [M:0;jenkins-hbase4:35499] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2024-03-15 18:57:00,619 INFO [M:0;jenkins-hbase4:35499] assignment.AssignmentManager(315): Stopping assignment manager 2024-03-15 18:57:00,619 INFO [M:0;jenkins-hbase4:35499] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2024-03-15 18:57:00,619 DEBUG [M:0;jenkins-hbase4:35499] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-03-15 18:57:00,620 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-03-15 18:57:00,620 INFO [M:0;jenkins-hbase4:35499] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-15 18:57:00,620 DEBUG [M:0;jenkins-hbase4:35499] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-15 18:57:00,620 DEBUG [M:0;jenkins-hbase4:35499] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-03-15 18:57:00,620 DEBUG [M:0;jenkins-hbase4:35499] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-15 18:57:00,620 INFO [M:0;jenkins-hbase4:35499] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=153.03 KB heapSize=184.82 KB 2024-03-15 18:57:00,636 INFO [M:0;jenkins-hbase4:35499] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=153.03 KB at sequenceid=376 (bloomFilter=true), to=hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/091abc0812314c2d95766972b095642d 2024-03-15 18:57:00,643 INFO [M:0;jenkins-hbase4:35499] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 091abc0812314c2d95766972b095642d 2024-03-15 18:57:00,644 DEBUG [M:0;jenkins-hbase4:35499] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/091abc0812314c2d95766972b095642d as hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/091abc0812314c2d95766972b095642d 2024-03-15 18:57:00,654 INFO [M:0;jenkins-hbase4:35499] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 091abc0812314c2d95766972b095642d 2024-03-15 18:57:00,654 INFO [M:0;jenkins-hbase4:35499] regionserver.HStore(1080): Added hdfs://localhost:33087/user/jenkins/test-data/7dc63c7b-af50-855c-2b38-5c2a6846aae6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/091abc0812314c2d95766972b095642d, entries=45, sequenceid=376, filesize=12.0 K 2024-03-15 18:57:00,655 INFO [M:0;jenkins-hbase4:35499] regionserver.HRegion(2948): Finished flush of dataSize ~153.03 KB/156707, heapSize ~184.80 KB/189240, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 35ms, sequenceid=376, compaction requested=false 2024-03-15 18:57:00,659 INFO [M:0;jenkins-hbase4:35499] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-15 18:57:00,659 DEBUG [M:0;jenkins-hbase4:35499] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-03-15 18:57:00,664 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-03-15 18:57:00,664 INFO [M:0;jenkins-hbase4:35499] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2024-03-15 18:57:00,664 INFO [M:0;jenkins-hbase4:35499] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35499 2024-03-15 18:57:00,666 DEBUG [M:0;jenkins-hbase4:35499] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35499,1710528949842 already deleted, retry=false 2024-03-15 18:57:00,711 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): regionserver:39929-0x10068d932620001, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-15 18:57:00,711 INFO [RS:0;jenkins-hbase4:39929] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,39929,1710528951051; zookeeper connection closed. 2024-03-15 18:57:00,711 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): regionserver:39929-0x10068d932620001, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-15 18:57:00,712 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4163d36] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4163d36 2024-03-15 18:57:00,712 INFO [Listener at localhost/33103] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2024-03-15 18:57:00,768 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-15 18:57:00,768 DEBUG [Listener at localhost/33103-EventThread] zookeeper.ZKWatcher(600): master:35499-0x10068d932620000, quorum=127.0.0.1:63302, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-15 18:57:00,768 INFO [M:0;jenkins-hbase4:35499] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,35499,1710528949842; zookeeper connection closed. 2024-03-15 18:57:00,769 WARN [Listener at localhost/33103] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-03-15 18:57:00,773 INFO [Listener at localhost/33103] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-03-15 18:57:00,878 WARN [BP-615942518-172.31.14.131-1710528946734 heartbeating to localhost/127.0.0.1:33087] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-03-15 18:57:00,878 WARN [BP-615942518-172.31.14.131-1710528946734 heartbeating to localhost/127.0.0.1:33087] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-615942518-172.31.14.131-1710528946734 (Datanode Uuid 809f1f01-efaf-4c41-b57a-4be300f0c8dc) service to localhost/127.0.0.1:33087 2024-03-15 18:57:00,879 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/cluster_06008907-b92e-1bc0-e4db-cb8d5189be26/dfs/data/data3/current/BP-615942518-172.31.14.131-1710528946734] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-03-15 18:57:00,880 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/cluster_06008907-b92e-1bc0-e4db-cb8d5189be26/dfs/data/data4/current/BP-615942518-172.31.14.131-1710528946734] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-03-15 18:57:00,881 WARN [Listener at localhost/33103] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-03-15 18:57:00,883 INFO [Listener at localhost/33103] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-03-15 18:57:00,988 WARN [BP-615942518-172.31.14.131-1710528946734 heartbeating to localhost/127.0.0.1:33087] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-03-15 18:57:00,988 WARN [BP-615942518-172.31.14.131-1710528946734 heartbeating to localhost/127.0.0.1:33087] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-615942518-172.31.14.131-1710528946734 (Datanode Uuid 7d0299ed-be4c-46e6-be55-d2b6048cf92d) service to localhost/127.0.0.1:33087 2024-03-15 18:57:00,988 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/cluster_06008907-b92e-1bc0-e4db-cb8d5189be26/dfs/data/data1/current/BP-615942518-172.31.14.131-1710528946734] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-03-15 18:57:00,989 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/bdcf101b-9343-530f-0450-888dd0d8859d/cluster_06008907-b92e-1bc0-e4db-cb8d5189be26/dfs/data/data2/current/BP-615942518-172.31.14.131-1710528946734] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-03-15 18:57:01,030 INFO [Listener at localhost/33103] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-03-15 18:57:01,147 INFO [Listener at localhost/33103] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2024-03-15 18:57:01,196 INFO [Listener at localhost/33103] hbase.HBaseTestingUtility(1293): Minicluster is down