2024-03-24 13:55:47,114 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle timeout: 13 mins 2024-03-24 13:55:47,330 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac 2024-03-24 13:55:47,345 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2024-03-24 13:55:47,346 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/cluster_cbf4f67b-ef7d-0272-4d6f-be55fc03f1ae, deleteOnExit=true 2024-03-24 13:55:47,346 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2024-03-24 13:55:47,347 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/test.cache.data in system properties and HBase conf 2024-03-24 13:55:47,348 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/hadoop.tmp.dir in system properties and HBase conf 2024-03-24 13:55:47,348 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/hadoop.log.dir in system properties and HBase conf 2024-03-24 13:55:47,349 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/mapreduce.cluster.local.dir in system properties and HBase conf 2024-03-24 13:55:47,350 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/mapreduce.cluster.temp.dir in system properties and HBase conf 2024-03-24 13:55:47,350 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2024-03-24 13:55:47,471 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2024-03-24 13:55:47,854 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-03-24 13:55:47,858 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2024-03-24 13:55:47,859 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2024-03-24 13:55:47,859 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/yarn.nodemanager.log-dirs in system properties and HBase conf 2024-03-24 13:55:47,859 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-03-24 13:55:47,860 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2024-03-24 13:55:47,860 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2024-03-24 13:55:47,860 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-03-24 13:55:47,860 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/dfs.journalnode.edits.dir in system properties and HBase conf 2024-03-24 13:55:47,861 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2024-03-24 13:55:47,862 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/nfs.dump.dir in system properties and HBase conf 2024-03-24 13:55:47,862 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/java.io.tmpdir in system properties and HBase conf 2024-03-24 13:55:47,862 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/dfs.journalnode.edits.dir in system properties and HBase conf 2024-03-24 13:55:47,863 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2024-03-24 13:55:47,863 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2024-03-24 13:55:48,411 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-03-24 13:55:48,416 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-03-24 13:55:48,706 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2024-03-24 13:55:48,873 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2024-03-24 13:55:48,887 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-03-24 13:55:48,921 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2024-03-24 13:55:48,953 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/java.io.tmpdir/Jetty_localhost_35823_hdfs____aa5j0h/webapp 2024-03-24 13:55:49,082 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:35823 2024-03-24 13:55:49,092 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-03-24 13:55:49,092 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-03-24 13:55:49,555 WARN [Listener at localhost/43333] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-03-24 13:55:49,622 WARN [Listener at localhost/43333] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-03-24 13:55:49,640 WARN [Listener at localhost/43333] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-03-24 13:55:49,648 INFO [Listener at localhost/43333] log.Slf4jLog(67): jetty-6.1.26 2024-03-24 13:55:49,652 INFO [Listener at localhost/43333] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/java.io.tmpdir/Jetty_localhost_43185_datanode____.7dkpl6/webapp 2024-03-24 13:55:49,750 INFO [Listener at localhost/43333] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:43185 2024-03-24 13:55:50,054 WARN [Listener at localhost/40291] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-03-24 13:55:50,068 WARN [Listener at localhost/40291] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-03-24 13:55:50,072 WARN [Listener at localhost/40291] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-03-24 13:55:50,073 INFO [Listener at localhost/40291] log.Slf4jLog(67): jetty-6.1.26 2024-03-24 13:55:50,081 INFO [Listener at localhost/40291] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/java.io.tmpdir/Jetty_localhost_42001_datanode____.8lkq7a/webapp 2024-03-24 13:55:50,179 INFO [Listener at localhost/40291] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42001 2024-03-24 13:55:50,189 WARN [Listener at localhost/40227] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-03-24 13:55:50,501 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x96295c84aa9ecee4: Processing first storage report for DS-168479ca-c43f-4c19-b726-baf37b738502 from datanode 44e451fb-3df3-4c97-ab4e-ce1ae7a10f50 2024-03-24 13:55:50,503 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x96295c84aa9ecee4: from storage DS-168479ca-c43f-4c19-b726-baf37b738502 node DatanodeRegistration(127.0.0.1:36879, datanodeUuid=44e451fb-3df3-4c97-ab4e-ce1ae7a10f50, infoPort=44035, infoSecurePort=0, ipcPort=40227, storageInfo=lv=-57;cid=testClusterID;nsid=311485832;c=1711288548495), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2024-03-24 13:55:50,503 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa48d461f023bd967: Processing first storage report for DS-c57b1ff7-4a98-4632-aac0-49c7dcfc9ac9 from datanode a74d1121-462a-40b7-9f3b-ea15619bcb3b 2024-03-24 13:55:50,503 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa48d461f023bd967: from storage DS-c57b1ff7-4a98-4632-aac0-49c7dcfc9ac9 node DatanodeRegistration(127.0.0.1:39971, datanodeUuid=a74d1121-462a-40b7-9f3b-ea15619bcb3b, infoPort=35367, infoSecurePort=0, ipcPort=40291, storageInfo=lv=-57;cid=testClusterID;nsid=311485832;c=1711288548495), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2024-03-24 13:55:50,503 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x96295c84aa9ecee4: Processing first storage report for DS-fd347403-d5b2-49c5-9fc7-1d13219e24ce from datanode 44e451fb-3df3-4c97-ab4e-ce1ae7a10f50 2024-03-24 13:55:50,503 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x96295c84aa9ecee4: from storage DS-fd347403-d5b2-49c5-9fc7-1d13219e24ce node DatanodeRegistration(127.0.0.1:36879, datanodeUuid=44e451fb-3df3-4c97-ab4e-ce1ae7a10f50, infoPort=44035, infoSecurePort=0, ipcPort=40227, storageInfo=lv=-57;cid=testClusterID;nsid=311485832;c=1711288548495), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2024-03-24 13:55:50,503 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xa48d461f023bd967: Processing first storage report for DS-31e296b0-a7ec-4365-bbed-fc7a4fa00386 from datanode a74d1121-462a-40b7-9f3b-ea15619bcb3b 2024-03-24 13:55:50,504 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xa48d461f023bd967: from storage DS-31e296b0-a7ec-4365-bbed-fc7a4fa00386 node DatanodeRegistration(127.0.0.1:39971, datanodeUuid=a74d1121-462a-40b7-9f3b-ea15619bcb3b, infoPort=35367, infoSecurePort=0, ipcPort=40291, storageInfo=lv=-57;cid=testClusterID;nsid=311485832;c=1711288548495), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-03-24 13:55:50,588 DEBUG [Listener at localhost/40227] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac 2024-03-24 13:55:50,704 INFO [Listener at localhost/40227] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/cluster_cbf4f67b-ef7d-0272-4d6f-be55fc03f1ae/zookeeper_0, clientPort=62836, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/cluster_cbf4f67b-ef7d-0272-4d6f-be55fc03f1ae/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/cluster_cbf4f67b-ef7d-0272-4d6f-be55fc03f1ae/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2024-03-24 13:55:50,735 INFO [Listener at localhost/40227] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=62836 2024-03-24 13:55:50,743 INFO [Listener at localhost/40227] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-24 13:55:50,745 INFO [Listener at localhost/40227] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-24 13:55:51,410 INFO [Listener at localhost/40227] util.FSUtils(471): Created version file at hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6 with version=8 2024-03-24 13:55:51,410 INFO [Listener at localhost/40227] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/hbase-staging 2024-03-24 13:55:51,741 INFO [Listener at localhost/40227] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2024-03-24 13:55:52,223 INFO [Listener at localhost/40227] client.ConnectionUtils(126): master/jenkins-hbase4:0 server-side Connection retries=45 2024-03-24 13:55:52,257 INFO [Listener at localhost/40227] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-24 13:55:52,258 INFO [Listener at localhost/40227] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-03-24 13:55:52,258 INFO [Listener at localhost/40227] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-03-24 13:55:52,258 INFO [Listener at localhost/40227] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-24 13:55:52,258 INFO [Listener at localhost/40227] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-03-24 13:55:52,408 INFO [Listener at localhost/40227] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2024-03-24 13:55:52,487 DEBUG [Listener at localhost/40227] util.ClassSize(228): Using Unsafe to estimate memory layout 2024-03-24 13:55:52,586 INFO [Listener at localhost/40227] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43509 2024-03-24 13:55:52,596 INFO [Listener at localhost/40227] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-24 13:55:52,598 INFO [Listener at localhost/40227] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-24 13:55:52,620 INFO [Listener at localhost/40227] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43509 connecting to ZooKeeper ensemble=127.0.0.1:62836 2024-03-24 13:55:52,664 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:435090x0, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-03-24 13:55:52,666 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:43509-0x100961fcc9b0000 connected 2024-03-24 13:55:52,697 DEBUG [Listener at localhost/40227] zookeeper.ZKUtil(165): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-03-24 13:55:52,698 DEBUG [Listener at localhost/40227] zookeeper.ZKUtil(165): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-24 13:55:52,702 DEBUG [Listener at localhost/40227] zookeeper.ZKUtil(165): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-03-24 13:55:52,710 DEBUG [Listener at localhost/40227] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43509 2024-03-24 13:55:52,710 DEBUG [Listener at localhost/40227] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43509 2024-03-24 13:55:52,711 DEBUG [Listener at localhost/40227] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43509 2024-03-24 13:55:52,711 DEBUG [Listener at localhost/40227] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43509 2024-03-24 13:55:52,711 DEBUG [Listener at localhost/40227] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43509 2024-03-24 13:55:52,717 INFO [Listener at localhost/40227] master.HMaster(445): hbase.rootdir=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6, hbase.cluster.distributed=false 2024-03-24 13:55:52,789 INFO [Listener at localhost/40227] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-03-24 13:55:52,790 INFO [Listener at localhost/40227] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-24 13:55:52,790 INFO [Listener at localhost/40227] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-03-24 13:55:52,790 INFO [Listener at localhost/40227] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-03-24 13:55:52,790 INFO [Listener at localhost/40227] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-24 13:55:52,790 INFO [Listener at localhost/40227] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-03-24 13:55:52,795 INFO [Listener at localhost/40227] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-03-24 13:55:52,798 INFO [Listener at localhost/40227] ipc.NettyRpcServer(120): Bind to /172.31.14.131:37469 2024-03-24 13:55:52,801 INFO [Listener at localhost/40227] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-03-24 13:55:52,807 DEBUG [Listener at localhost/40227] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-03-24 13:55:52,808 INFO [Listener at localhost/40227] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-24 13:55:52,810 INFO [Listener at localhost/40227] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-24 13:55:52,812 INFO [Listener at localhost/40227] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:37469 connecting to ZooKeeper ensemble=127.0.0.1:62836 2024-03-24 13:55:52,816 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): regionserver:374690x0, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-03-24 13:55:52,817 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:37469-0x100961fcc9b0001 connected 2024-03-24 13:55:52,817 DEBUG [Listener at localhost/40227] zookeeper.ZKUtil(165): regionserver:37469-0x100961fcc9b0001, quorum=127.0.0.1:62836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-03-24 13:55:52,818 DEBUG [Listener at localhost/40227] zookeeper.ZKUtil(165): regionserver:37469-0x100961fcc9b0001, quorum=127.0.0.1:62836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-24 13:55:52,819 DEBUG [Listener at localhost/40227] zookeeper.ZKUtil(165): regionserver:37469-0x100961fcc9b0001, quorum=127.0.0.1:62836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-03-24 13:55:52,820 DEBUG [Listener at localhost/40227] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=37469 2024-03-24 13:55:52,820 DEBUG [Listener at localhost/40227] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=37469 2024-03-24 13:55:52,821 DEBUG [Listener at localhost/40227] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=37469 2024-03-24 13:55:52,821 DEBUG [Listener at localhost/40227] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=37469 2024-03-24 13:55:52,822 DEBUG [Listener at localhost/40227] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=37469 2024-03-24 13:55:52,834 INFO [Listener at localhost/40227] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-03-24 13:55:52,835 INFO [Listener at localhost/40227] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-24 13:55:52,835 INFO [Listener at localhost/40227] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-03-24 13:55:52,835 INFO [Listener at localhost/40227] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-03-24 13:55:52,835 INFO [Listener at localhost/40227] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-03-24 13:55:52,835 INFO [Listener at localhost/40227] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-03-24 13:55:52,836 INFO [Listener at localhost/40227] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-03-24 13:55:52,837 INFO [Listener at localhost/40227] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40925 2024-03-24 13:55:52,837 INFO [Listener at localhost/40227] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-03-24 13:55:52,839 DEBUG [Listener at localhost/40227] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-03-24 13:55:52,840 INFO [Listener at localhost/40227] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-24 13:55:52,842 INFO [Listener at localhost/40227] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-24 13:55:52,845 INFO [Listener at localhost/40227] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40925 connecting to ZooKeeper ensemble=127.0.0.1:62836 2024-03-24 13:55:52,850 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): regionserver:409250x0, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-03-24 13:55:52,851 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40925-0x100961fcc9b0002 connected 2024-03-24 13:55:52,851 DEBUG [Listener at localhost/40227] zookeeper.ZKUtil(165): regionserver:40925-0x100961fcc9b0002, quorum=127.0.0.1:62836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-03-24 13:55:52,852 DEBUG [Listener at localhost/40227] zookeeper.ZKUtil(165): regionserver:40925-0x100961fcc9b0002, quorum=127.0.0.1:62836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-24 13:55:52,853 DEBUG [Listener at localhost/40227] zookeeper.ZKUtil(165): regionserver:40925-0x100961fcc9b0002, quorum=127.0.0.1:62836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-03-24 13:55:52,854 DEBUG [Listener at localhost/40227] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40925 2024-03-24 13:55:52,854 DEBUG [Listener at localhost/40227] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40925 2024-03-24 13:55:52,855 DEBUG [Listener at localhost/40227] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40925 2024-03-24 13:55:52,855 DEBUG [Listener at localhost/40227] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40925 2024-03-24 13:55:52,855 DEBUG [Listener at localhost/40227] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40925 2024-03-24 13:55:52,857 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2174): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,43509,1711288551562 2024-03-24 13:55:52,866 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-03-24 13:55:52,868 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,43509,1711288551562 2024-03-24 13:55:52,887 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): regionserver:37469-0x100961fcc9b0001, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-03-24 13:55:52,887 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): regionserver:40925-0x100961fcc9b0002, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-03-24 13:55:52,887 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-03-24 13:55:52,888 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-24 13:55:52,889 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-03-24 13:55:52,890 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,43509,1711288551562 from backup master directory 2024-03-24 13:55:52,891 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(163): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-03-24 13:55:52,894 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,43509,1711288551562 2024-03-24 13:55:52,894 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-03-24 13:55:52,895 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-03-24 13:55:52,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,43509,1711288551562 2024-03-24 13:55:52,897 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2024-03-24 13:55:52,899 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2024-03-24 13:55:52,989 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/hbase.id with ID: 41399252-64c7-406e-8867-fe08e45aaa5c 2024-03-24 13:55:53,033 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-03-24 13:55:53,049 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-24 13:55:53,094 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x5e53ed1e to 127.0.0.1:62836 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-03-24 13:55:53,128 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7870b7d1, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-03-24 13:55:53,154 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-24 13:55:53,156 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2024-03-24 13:55:53,174 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2024-03-24 13:55:53,174 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2024-03-24 13:55:53,176 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-03-24 13:55:53,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-03-24 13:55:53,181 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-03-24 13:55:53,214 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/MasterData/data/master/store-tmp 2024-03-24 13:55:53,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-24 13:55:53,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-03-24 13:55:53,249 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-24 13:55:53,250 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-24 13:55:53,250 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-03-24 13:55:53,250 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-24 13:55:53,250 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-24 13:55:53,250 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-03-24 13:55:53,252 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/MasterData/WALs/jenkins-hbase4.apache.org,43509,1711288551562 2024-03-24 13:55:53,274 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43509%2C1711288551562, suffix=, logDir=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/MasterData/WALs/jenkins-hbase4.apache.org,43509,1711288551562, archiveDir=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/MasterData/oldWALs, maxLogs=10 2024-03-24 13:55:53,336 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39971,DS-c57b1ff7-4a98-4632-aac0-49c7dcfc9ac9,DISK] 2024-03-24 13:55:53,336 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36879,DS-168479ca-c43f-4c19-b726-baf37b738502,DISK] 2024-03-24 13:55:53,344 DEBUG [RS-EventLoopGroup-4-3] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2024-03-24 13:55:53,412 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/MasterData/WALs/jenkins-hbase4.apache.org,43509,1711288551562/jenkins-hbase4.apache.org%2C43509%2C1711288551562.1711288553286 2024-03-24 13:55:53,412 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39971,DS-c57b1ff7-4a98-4632-aac0-49c7dcfc9ac9,DISK], DatanodeInfoWithStorage[127.0.0.1:36879,DS-168479ca-c43f-4c19-b726-baf37b738502,DISK]] 2024-03-24 13:55:53,413 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2024-03-24 13:55:53,413 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-24 13:55:53,416 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2024-03-24 13:55:53,418 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2024-03-24 13:55:53,476 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2024-03-24 13:55:53,483 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2024-03-24 13:55:53,507 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2024-03-24 13:55:53,518 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-24 13:55:53,523 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-03-24 13:55:53,525 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-03-24 13:55:53,540 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2024-03-24 13:55:53,545 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-24 13:55:53,546 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69351411, jitterRate=0.03341655433177948}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-24 13:55:53,546 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2024-03-24 13:55:53,548 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2024-03-24 13:55:53,566 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2024-03-24 13:55:53,566 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(608): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2024-03-24 13:55:53,568 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2024-03-24 13:55:53,570 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(628): Recovered RegionProcedureStore lease in 1 msec 2024-03-24 13:55:53,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(642): Loaded RegionProcedureStore in 33 msec 2024-03-24 13:55:53,604 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2024-03-24 13:55:53,629 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2024-03-24 13:55:53,634 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2024-03-24 13:55:53,658 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2024-03-24 13:55:53,662 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2024-03-24 13:55:53,664 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2024-03-24 13:55:53,669 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2024-03-24 13:55:53,673 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2024-03-24 13:55:53,677 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-24 13:55:53,679 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2024-03-24 13:55:53,680 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2024-03-24 13:55:53,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2024-03-24 13:55:53,698 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): regionserver:40925-0x100961fcc9b0002, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-03-24 13:55:53,698 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-03-24 13:55:53,698 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): regionserver:37469-0x100961fcc9b0001, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-03-24 13:55:53,698 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-24 13:55:53,700 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(745): Active/primary master=jenkins-hbase4.apache.org,43509,1711288551562, sessionid=0x100961fcc9b0000, setting cluster-up flag (Was=false) 2024-03-24 13:55:53,716 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-24 13:55:53,724 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2024-03-24 13:55:53,725 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43509,1711288551562 2024-03-24 13:55:53,732 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-24 13:55:53,739 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2024-03-24 13:55:53,740 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43509,1711288551562 2024-03-24 13:55:53,743 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.hbase-snapshot/.tmp 2024-03-24 13:55:53,759 INFO [RS:1;jenkins-hbase4:40925] regionserver.HRegionServer(954): ClusterId : 41399252-64c7-406e-8867-fe08e45aaa5c 2024-03-24 13:55:53,759 INFO [RS:0;jenkins-hbase4:37469] regionserver.HRegionServer(954): ClusterId : 41399252-64c7-406e-8867-fe08e45aaa5c 2024-03-24 13:55:53,764 DEBUG [RS:0;jenkins-hbase4:37469] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-03-24 13:55:53,764 DEBUG [RS:1;jenkins-hbase4:40925] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-03-24 13:55:53,771 DEBUG [RS:1;jenkins-hbase4:40925] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-03-24 13:55:53,771 DEBUG [RS:1;jenkins-hbase4:40925] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-03-24 13:55:53,771 DEBUG [RS:0;jenkins-hbase4:37469] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-03-24 13:55:53,771 DEBUG [RS:0;jenkins-hbase4:37469] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-03-24 13:55:53,775 DEBUG [RS:1;jenkins-hbase4:40925] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-03-24 13:55:53,775 DEBUG [RS:0;jenkins-hbase4:37469] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-03-24 13:55:53,778 DEBUG [RS:1;jenkins-hbase4:40925] zookeeper.ReadOnlyZKClient(139): Connect 0x36a2ff63 to 127.0.0.1:62836 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-03-24 13:55:53,778 DEBUG [RS:0;jenkins-hbase4:37469] zookeeper.ReadOnlyZKClient(139): Connect 0x60b57162 to 127.0.0.1:62836 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-03-24 13:55:53,786 DEBUG [RS:1;jenkins-hbase4:40925] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@386517c7, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-03-24 13:55:53,787 DEBUG [RS:1;jenkins-hbase4:40925] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3c5a9413, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-03-24 13:55:53,787 DEBUG [RS:0;jenkins-hbase4:37469] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6e728304, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-03-24 13:55:53,787 DEBUG [RS:0;jenkins-hbase4:37469] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6a4d1a12, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-03-24 13:55:53,810 DEBUG [RS:1;jenkins-hbase4:40925] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:40925 2024-03-24 13:55:53,810 DEBUG [RS:0;jenkins-hbase4:37469] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:37469 2024-03-24 13:55:53,811 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver loaded, priority=536870911. 2024-03-24 13:55:53,814 INFO [RS:1;jenkins-hbase4:40925] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-03-24 13:55:53,815 INFO [RS:1;jenkins-hbase4:40925] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-03-24 13:55:53,814 INFO [RS:0;jenkins-hbase4:37469] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-03-24 13:55:53,815 INFO [RS:0;jenkins-hbase4:37469] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-03-24 13:55:53,815 DEBUG [RS:1;jenkins-hbase4:40925] regionserver.HRegionServer(1025): About to register with Master. 2024-03-24 13:55:53,815 DEBUG [RS:0;jenkins-hbase4:37469] regionserver.HRegionServer(1025): About to register with Master. 2024-03-24 13:55:53,818 INFO [RS:1;jenkins-hbase4:40925] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase4.apache.org,43509,1711288551562 with isa=jenkins-hbase4.apache.org/172.31.14.131:40925, startcode=1711288552834 2024-03-24 13:55:53,818 INFO [RS:0;jenkins-hbase4:37469] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase4.apache.org,43509,1711288551562 with isa=jenkins-hbase4.apache.org/172.31.14.131:37469, startcode=1711288552789 2024-03-24 13:55:53,835 DEBUG [RS:1;jenkins-hbase4:40925] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-03-24 13:55:53,835 DEBUG [RS:0;jenkins-hbase4:37469] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-03-24 13:55:53,891 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52891, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2024-03-24 13:55:53,891 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49957, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2024-03-24 13:55:53,896 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2024-03-24 13:55:53,899 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43509] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2838) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15910) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2024-03-24 13:55:53,904 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-03-24 13:55:53,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-03-24 13:55:53,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-03-24 13:55:53,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-03-24 13:55:53,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2024-03-24 13:55:53,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-24 13:55:53,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-03-24 13:55:53,905 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-24 13:55:53,907 DEBUG [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43509] ipc.MetricsHBaseServer(134): Unknown exception type org.apache.hadoop.hbase.ipc.ServerNotRunningYetException: Server is not running yet at org.apache.hadoop.hbase.master.HMaster.checkServiceStarted(HMaster.java:2838) at org.apache.hadoop.hbase.master.MasterRpcServices.regionServerStartup(MasterRpcServices.java:579) at org.apache.hadoop.hbase.shaded.protobuf.generated.RegionServerStatusProtos$RegionServerStatusService$2.callBlockingMethod(RegionServerStatusProtos.java:15910) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) 2024-03-24 13:55:53,909 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1711288583909 2024-03-24 13:55:53,911 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2024-03-24 13:55:53,914 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2024-03-24 13:55:53,915 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2024-03-24 13:55:53,921 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-03-24 13:55:53,923 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2024-03-24 13:55:53,932 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2024-03-24 13:55:53,932 DEBUG [RS:0;jenkins-hbase4:37469] regionserver.HRegionServer(2832): Master is not running yet 2024-03-24 13:55:53,932 DEBUG [RS:1;jenkins-hbase4:40925] regionserver.HRegionServer(2832): Master is not running yet 2024-03-24 13:55:53,932 WARN [RS:0;jenkins-hbase4:37469] regionserver.HRegionServer(1033): reportForDuty failed; sleeping 100 ms and then retrying. 2024-03-24 13:55:53,932 WARN [RS:1;jenkins-hbase4:40925] regionserver.HRegionServer(1033): reportForDuty failed; sleeping 100 ms and then retrying. 2024-03-24 13:55:53,932 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2024-03-24 13:55:53,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2024-03-24 13:55:53,933 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2024-03-24 13:55:53,934 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:53,935 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2024-03-24 13:55:53,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2024-03-24 13:55:53,937 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2024-03-24 13:55:53,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2024-03-24 13:55:53,940 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2024-03-24 13:55:53,942 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1711288553942,5,FailOnTimeoutGroup] 2024-03-24 13:55:53,942 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1711288553942,5,FailOnTimeoutGroup] 2024-03-24 13:55:53,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:53,942 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1466): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2024-03-24 13:55:53,943 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:53,944 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:53,960 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-03-24 13:55:53,961 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-03-24 13:55:53,962 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6 2024-03-24 13:55:53,981 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-24 13:55:53,983 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-03-24 13:55:53,986 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/meta/1588230740/info 2024-03-24 13:55:53,987 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-03-24 13:55:53,988 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-24 13:55:53,988 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-03-24 13:55:53,991 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/meta/1588230740/rep_barrier 2024-03-24 13:55:53,991 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-03-24 13:55:53,992 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-24 13:55:53,993 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-03-24 13:55:53,995 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/meta/1588230740/table 2024-03-24 13:55:53,995 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-03-24 13:55:53,996 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-24 13:55:53,998 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/meta/1588230740 2024-03-24 13:55:53,999 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/meta/1588230740 2024-03-24 13:55:54,003 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-03-24 13:55:54,005 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2024-03-24 13:55:54,009 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-24 13:55:54,010 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74309635, jitterRate=0.10729984939098358}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-03-24 13:55:54,010 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2024-03-24 13:55:54,010 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-03-24 13:55:54,010 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-03-24 13:55:54,011 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-03-24 13:55:54,011 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-03-24 13:55:54,011 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-03-24 13:55:54,011 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-03-24 13:55:54,012 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-03-24 13:55:54,017 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2024-03-24 13:55:54,017 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2024-03-24 13:55:54,025 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2024-03-24 13:55:54,033 INFO [RS:1;jenkins-hbase4:40925] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase4.apache.org,43509,1711288551562 with isa=jenkins-hbase4.apache.org/172.31.14.131:40925, startcode=1711288552834 2024-03-24 13:55:54,033 INFO [RS:0;jenkins-hbase4:37469] regionserver.HRegionServer(2813): reportForDuty to master=jenkins-hbase4.apache.org,43509,1711288551562 with isa=jenkins-hbase4.apache.org/172.31.14.131:37469, startcode=1711288552789 2024-03-24 13:55:54,036 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2024-03-24 13:55:54,038 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2024-03-24 13:55:54,039 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43509] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,37469,1711288552789 2024-03-24 13:55:54,045 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43509] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,40925,1711288552834 2024-03-24 13:55:54,045 DEBUG [RS:0;jenkins-hbase4:37469] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6 2024-03-24 13:55:54,045 DEBUG [RS:0;jenkins-hbase4:37469] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:43333 2024-03-24 13:55:54,045 DEBUG [RS:0;jenkins-hbase4:37469] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-03-24 13:55:54,046 DEBUG [RS:1;jenkins-hbase4:40925] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6 2024-03-24 13:55:54,046 DEBUG [RS:1;jenkins-hbase4:40925] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:43333 2024-03-24 13:55:54,046 DEBUG [RS:1;jenkins-hbase4:40925] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2024-03-24 13:55:54,053 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-03-24 13:55:54,054 DEBUG [RS:1;jenkins-hbase4:40925] zookeeper.ZKUtil(163): regionserver:40925-0x100961fcc9b0002, quorum=127.0.0.1:62836, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40925,1711288552834 2024-03-24 13:55:54,054 DEBUG [RS:0;jenkins-hbase4:37469] zookeeper.ZKUtil(163): regionserver:37469-0x100961fcc9b0001, quorum=127.0.0.1:62836, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37469,1711288552789 2024-03-24 13:55:54,054 WARN [RS:1;jenkins-hbase4:40925] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-03-24 13:55:54,055 WARN [RS:0;jenkins-hbase4:37469] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-03-24 13:55:54,055 INFO [RS:1;jenkins-hbase4:40925] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-03-24 13:55:54,055 INFO [RS:0;jenkins-hbase4:37469] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-03-24 13:55:54,056 DEBUG [RS:1;jenkins-hbase4:40925] regionserver.HRegionServer(1950): logDir=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/WALs/jenkins-hbase4.apache.org,40925,1711288552834 2024-03-24 13:55:54,056 DEBUG [RS:0;jenkins-hbase4:37469] regionserver.HRegionServer(1950): logDir=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/WALs/jenkins-hbase4.apache.org,37469,1711288552789 2024-03-24 13:55:54,056 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,37469,1711288552789] 2024-03-24 13:55:54,056 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40925,1711288552834] 2024-03-24 13:55:54,067 DEBUG [RS:1;jenkins-hbase4:40925] zookeeper.ZKUtil(163): regionserver:40925-0x100961fcc9b0002, quorum=127.0.0.1:62836, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37469,1711288552789 2024-03-24 13:55:54,067 DEBUG [RS:0;jenkins-hbase4:37469] zookeeper.ZKUtil(163): regionserver:37469-0x100961fcc9b0001, quorum=127.0.0.1:62836, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,37469,1711288552789 2024-03-24 13:55:54,067 DEBUG [RS:1;jenkins-hbase4:40925] zookeeper.ZKUtil(163): regionserver:40925-0x100961fcc9b0002, quorum=127.0.0.1:62836, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40925,1711288552834 2024-03-24 13:55:54,068 DEBUG [RS:0;jenkins-hbase4:37469] zookeeper.ZKUtil(163): regionserver:37469-0x100961fcc9b0001, quorum=127.0.0.1:62836, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40925,1711288552834 2024-03-24 13:55:54,078 DEBUG [RS:1;jenkins-hbase4:40925] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-03-24 13:55:54,078 DEBUG [RS:0;jenkins-hbase4:37469] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-03-24 13:55:54,087 INFO [RS:0;jenkins-hbase4:37469] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-03-24 13:55:54,087 INFO [RS:1;jenkins-hbase4:40925] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-03-24 13:55:54,106 INFO [RS:1;jenkins-hbase4:40925] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-03-24 13:55:54,106 INFO [RS:0;jenkins-hbase4:37469] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-03-24 13:55:54,110 INFO [RS:0;jenkins-hbase4:37469] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-03-24 13:55:54,110 INFO [RS:1;jenkins-hbase4:40925] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-03-24 13:55:54,111 INFO [RS:0;jenkins-hbase4:37469] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:54,111 INFO [RS:1;jenkins-hbase4:40925] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:54,112 INFO [RS:0;jenkins-hbase4:37469] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-03-24 13:55:54,112 INFO [RS:1;jenkins-hbase4:40925] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2024-03-24 13:55:54,119 INFO [RS:0;jenkins-hbase4:37469] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:54,119 INFO [RS:1;jenkins-hbase4:40925] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:54,119 DEBUG [RS:0;jenkins-hbase4:37469] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-24 13:55:54,119 DEBUG [RS:1;jenkins-hbase4:40925] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-24 13:55:54,120 DEBUG [RS:0;jenkins-hbase4:37469] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-24 13:55:54,120 DEBUG [RS:1;jenkins-hbase4:40925] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-24 13:55:54,120 DEBUG [RS:0;jenkins-hbase4:37469] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-24 13:55:54,120 DEBUG [RS:1;jenkins-hbase4:40925] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-24 13:55:54,120 DEBUG [RS:0;jenkins-hbase4:37469] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-24 13:55:54,120 DEBUG [RS:1;jenkins-hbase4:40925] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-24 13:55:54,120 DEBUG [RS:0;jenkins-hbase4:37469] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-24 13:55:54,120 DEBUG [RS:1;jenkins-hbase4:40925] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-24 13:55:54,120 DEBUG [RS:0;jenkins-hbase4:37469] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-03-24 13:55:54,120 DEBUG [RS:1;jenkins-hbase4:40925] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-03-24 13:55:54,120 DEBUG [RS:0;jenkins-hbase4:37469] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-24 13:55:54,120 DEBUG [RS:1;jenkins-hbase4:40925] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-24 13:55:54,121 DEBUG [RS:0;jenkins-hbase4:37469] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-24 13:55:54,121 DEBUG [RS:1;jenkins-hbase4:40925] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-24 13:55:54,121 DEBUG [RS:0;jenkins-hbase4:37469] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-24 13:55:54,121 DEBUG [RS:1;jenkins-hbase4:40925] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-24 13:55:54,121 DEBUG [RS:0;jenkins-hbase4:37469] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-24 13:55:54,121 DEBUG [RS:1;jenkins-hbase4:40925] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-03-24 13:55:54,122 INFO [RS:0;jenkins-hbase4:37469] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:54,122 INFO [RS:1;jenkins-hbase4:40925] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:54,122 INFO [RS:0;jenkins-hbase4:37469] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:54,122 INFO [RS:1;jenkins-hbase4:40925] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:54,122 INFO [RS:0;jenkins-hbase4:37469] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:54,122 INFO [RS:1;jenkins-hbase4:40925] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:54,122 INFO [RS:0;jenkins-hbase4:37469] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:54,123 INFO [RS:1;jenkins-hbase4:40925] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:54,145 INFO [RS:1;jenkins-hbase4:40925] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-03-24 13:55:54,145 INFO [RS:0;jenkins-hbase4:37469] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-03-24 13:55:54,149 INFO [RS:1;jenkins-hbase4:40925] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40925,1711288552834-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:54,149 INFO [RS:0;jenkins-hbase4:37469] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,37469,1711288552789-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:54,168 INFO [RS:1;jenkins-hbase4:40925] regionserver.Replication(203): jenkins-hbase4.apache.org,40925,1711288552834 started 2024-03-24 13:55:54,168 INFO [RS:0;jenkins-hbase4:37469] regionserver.Replication(203): jenkins-hbase4.apache.org,37469,1711288552789 started 2024-03-24 13:55:54,168 INFO [RS:1;jenkins-hbase4:40925] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,40925,1711288552834, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40925, sessionid=0x100961fcc9b0002 2024-03-24 13:55:54,168 INFO [RS:0;jenkins-hbase4:37469] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,37469,1711288552789, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:37469, sessionid=0x100961fcc9b0001 2024-03-24 13:55:54,168 DEBUG [RS:0;jenkins-hbase4:37469] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-03-24 13:55:54,168 DEBUG [RS:1;jenkins-hbase4:40925] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-03-24 13:55:54,168 DEBUG [RS:0;jenkins-hbase4:37469] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,37469,1711288552789 2024-03-24 13:55:54,168 DEBUG [RS:1;jenkins-hbase4:40925] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40925,1711288552834 2024-03-24 13:55:54,169 DEBUG [RS:0;jenkins-hbase4:37469] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37469,1711288552789' 2024-03-24 13:55:54,169 DEBUG [RS:1;jenkins-hbase4:40925] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40925,1711288552834' 2024-03-24 13:55:54,170 DEBUG [RS:0;jenkins-hbase4:37469] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-03-24 13:55:54,170 DEBUG [RS:1;jenkins-hbase4:40925] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-03-24 13:55:54,170 DEBUG [RS:1;jenkins-hbase4:40925] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-03-24 13:55:54,171 DEBUG [RS:0;jenkins-hbase4:37469] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-03-24 13:55:54,171 DEBUG [RS:1;jenkins-hbase4:40925] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-03-24 13:55:54,171 DEBUG [RS:1;jenkins-hbase4:40925] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-03-24 13:55:54,171 DEBUG [RS:0;jenkins-hbase4:37469] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-03-24 13:55:54,171 DEBUG [RS:1;jenkins-hbase4:40925] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40925,1711288552834 2024-03-24 13:55:54,172 DEBUG [RS:1;jenkins-hbase4:40925] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40925,1711288552834' 2024-03-24 13:55:54,172 DEBUG [RS:1;jenkins-hbase4:40925] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-03-24 13:55:54,172 DEBUG [RS:0;jenkins-hbase4:37469] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-03-24 13:55:54,172 DEBUG [RS:0;jenkins-hbase4:37469] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,37469,1711288552789 2024-03-24 13:55:54,172 DEBUG [RS:0;jenkins-hbase4:37469] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,37469,1711288552789' 2024-03-24 13:55:54,172 DEBUG [RS:0;jenkins-hbase4:37469] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-03-24 13:55:54,173 DEBUG [RS:1;jenkins-hbase4:40925] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-03-24 13:55:54,173 DEBUG [RS:0;jenkins-hbase4:37469] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-03-24 13:55:54,174 DEBUG [RS:1;jenkins-hbase4:40925] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-03-24 13:55:54,174 INFO [RS:1;jenkins-hbase4:40925] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-03-24 13:55:54,174 DEBUG [RS:0;jenkins-hbase4:37469] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-03-24 13:55:54,174 INFO [RS:0;jenkins-hbase4:37469] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-03-24 13:55:54,176 INFO [RS:1;jenkins-hbase4:40925] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:54,176 INFO [RS:0;jenkins-hbase4:37469] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:54,177 DEBUG [RS:1;jenkins-hbase4:40925] zookeeper.ZKUtil(399): regionserver:40925-0x100961fcc9b0002, quorum=127.0.0.1:62836, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-03-24 13:55:54,177 DEBUG [RS:0;jenkins-hbase4:37469] zookeeper.ZKUtil(399): regionserver:37469-0x100961fcc9b0001, quorum=127.0.0.1:62836, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-03-24 13:55:54,177 INFO [RS:1;jenkins-hbase4:40925] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-03-24 13:55:54,177 INFO [RS:0;jenkins-hbase4:37469] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-03-24 13:55:54,177 INFO [RS:0;jenkins-hbase4:37469] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:54,177 INFO [RS:1;jenkins-hbase4:40925] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:54,178 INFO [RS:1;jenkins-hbase4:40925] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:54,178 INFO [RS:0;jenkins-hbase4:37469] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:54,190 DEBUG [jenkins-hbase4:43509] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=2, allServersCount=2 2024-03-24 13:55:54,194 DEBUG [jenkins-hbase4:43509] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-24 13:55:54,200 DEBUG [jenkins-hbase4:43509] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-24 13:55:54,200 DEBUG [jenkins-hbase4:43509] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-24 13:55:54,200 DEBUG [jenkins-hbase4:43509] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-24 13:55:54,202 INFO [PEWorker-2] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37469,1711288552789, state=OPENING 2024-03-24 13:55:54,209 DEBUG [PEWorker-2] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2024-03-24 13:55:54,211 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-24 13:55:54,212 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-03-24 13:55:54,216 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37469,1711288552789}] 2024-03-24 13:55:54,290 INFO [RS:0;jenkins-hbase4:37469] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37469%2C1711288552789, suffix=, logDir=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/WALs/jenkins-hbase4.apache.org,37469,1711288552789, archiveDir=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/oldWALs, maxLogs=32 2024-03-24 13:55:54,290 INFO [RS:1;jenkins-hbase4:40925] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40925%2C1711288552834, suffix=, logDir=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/WALs/jenkins-hbase4.apache.org,40925,1711288552834, archiveDir=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/oldWALs, maxLogs=32 2024-03-24 13:55:54,313 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39971,DS-c57b1ff7-4a98-4632-aac0-49c7dcfc9ac9,DISK] 2024-03-24 13:55:54,313 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36879,DS-168479ca-c43f-4c19-b726-baf37b738502,DISK] 2024-03-24 13:55:54,314 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39971,DS-c57b1ff7-4a98-4632-aac0-49c7dcfc9ac9,DISK] 2024-03-24 13:55:54,314 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36879,DS-168479ca-c43f-4c19-b726-baf37b738502,DISK] 2024-03-24 13:55:54,352 INFO [RS:0;jenkins-hbase4:37469] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/WALs/jenkins-hbase4.apache.org,37469,1711288552789/jenkins-hbase4.apache.org%2C37469%2C1711288552789.1711288554294 2024-03-24 13:55:54,352 INFO [RS:1;jenkins-hbase4:40925] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/WALs/jenkins-hbase4.apache.org,40925,1711288552834/jenkins-hbase4.apache.org%2C40925%2C1711288552834.1711288554294 2024-03-24 13:55:54,352 DEBUG [RS:0;jenkins-hbase4:37469] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39971,DS-c57b1ff7-4a98-4632-aac0-49c7dcfc9ac9,DISK], DatanodeInfoWithStorage[127.0.0.1:36879,DS-168479ca-c43f-4c19-b726-baf37b738502,DISK]] 2024-03-24 13:55:54,352 DEBUG [RS:1;jenkins-hbase4:40925] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39971,DS-c57b1ff7-4a98-4632-aac0-49c7dcfc9ac9,DISK], DatanodeInfoWithStorage[127.0.0.1:36879,DS-168479ca-c43f-4c19-b726-baf37b738502,DISK]] 2024-03-24 13:55:54,398 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37469,1711288552789 2024-03-24 13:55:54,400 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-03-24 13:55:54,403 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35144, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-03-24 13:55:54,415 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2024-03-24 13:55:54,415 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-03-24 13:55:54,418 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C37469%2C1711288552789.meta, suffix=.meta, logDir=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/WALs/jenkins-hbase4.apache.org,37469,1711288552789, archiveDir=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/oldWALs, maxLogs=32 2024-03-24 13:55:54,435 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39971,DS-c57b1ff7-4a98-4632-aac0-49c7dcfc9ac9,DISK] 2024-03-24 13:55:54,436 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:36879,DS-168479ca-c43f-4c19-b726-baf37b738502,DISK] 2024-03-24 13:55:54,443 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/WALs/jenkins-hbase4.apache.org,37469,1711288552789/jenkins-hbase4.apache.org%2C37469%2C1711288552789.meta.1711288554419.meta 2024-03-24 13:55:54,445 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39971,DS-c57b1ff7-4a98-4632-aac0-49c7dcfc9ac9,DISK], DatanodeInfoWithStorage[127.0.0.1:36879,DS-168479ca-c43f-4c19-b726-baf37b738502,DISK]] 2024-03-24 13:55:54,445 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2024-03-24 13:55:54,447 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2024-03-24 13:55:54,463 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2024-03-24 13:55:54,467 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2024-03-24 13:55:54,472 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2024-03-24 13:55:54,472 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-24 13:55:54,472 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2024-03-24 13:55:54,473 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2024-03-24 13:55:54,477 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-03-24 13:55:54,479 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/meta/1588230740/info 2024-03-24 13:55:54,479 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/meta/1588230740/info 2024-03-24 13:55:54,480 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-03-24 13:55:54,481 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-24 13:55:54,481 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-03-24 13:55:54,483 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/meta/1588230740/rep_barrier 2024-03-24 13:55:54,483 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/meta/1588230740/rep_barrier 2024-03-24 13:55:54,484 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-03-24 13:55:54,485 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-24 13:55:54,485 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-03-24 13:55:54,487 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/meta/1588230740/table 2024-03-24 13:55:54,487 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/meta/1588230740/table 2024-03-24 13:55:54,487 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-03-24 13:55:54,488 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-24 13:55:54,489 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/meta/1588230740 2024-03-24 13:55:54,492 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/meta/1588230740 2024-03-24 13:55:54,496 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-03-24 13:55:54,499 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2024-03-24 13:55:54,500 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67554901, jitterRate=0.006646469235420227}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-03-24 13:55:54,500 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2024-03-24 13:55:54,510 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1711288554391 2024-03-24 13:55:54,527 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:meta,,1.1588230740 2024-03-24 13:55:54,528 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2024-03-24 13:55:54,528 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,37469,1711288552789, state=OPEN 2024-03-24 13:55:54,532 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2024-03-24 13:55:54,532 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-03-24 13:55:54,536 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=3, resume processing ppid=2 2024-03-24 13:55:54,537 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,37469,1711288552789 in 316 msec 2024-03-24 13:55:54,542 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=2, resume processing ppid=1 2024-03-24 13:55:54,542 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 512 msec 2024-03-24 13:55:54,547 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 727 msec 2024-03-24 13:55:54,547 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(954): Wait for region servers to report in: status=null, state=RUNNING, startTime=1711288554547, completionTime=-1 2024-03-24 13:55:54,547 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2024-03-24 13:55:54,548 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2024-03-24 13:55:54,613 DEBUG [hconnection-0x1f6ebcaa-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-24 13:55:54,616 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35148, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-03-24 13:55:54,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=2 2024-03-24 13:55:54,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1711288614632 2024-03-24 13:55:54,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1711288674632 2024-03-24 13:55:54,632 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 84 msec 2024-03-24 13:55:54,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43509,1711288551562-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:54,654 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43509,1711288551562-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:54,655 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43509,1711288551562-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:54,656 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:43509, period=300000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:54,656 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:54,662 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2024-03-24 13:55:54,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2024-03-24 13:55:54,672 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-03-24 13:55:54,682 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2024-03-24 13:55:54,685 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2024-03-24 13:55:54,687 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-24 13:55:54,709 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/hbase/namespace/633bd601803a48a576b2418df2ba8b72 2024-03-24 13:55:54,711 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/hbase/namespace/633bd601803a48a576b2418df2ba8b72 empty. 2024-03-24 13:55:54,712 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/hbase/namespace/633bd601803a48a576b2418df2ba8b72 2024-03-24 13:55:54,712 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2024-03-24 13:55:54,740 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2024-03-24 13:55:54,742 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 633bd601803a48a576b2418df2ba8b72, NAME => 'hbase:namespace,,1711288554672.633bd601803a48a576b2418df2ba8b72.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp 2024-03-24 13:55:54,758 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1711288554672.633bd601803a48a576b2418df2ba8b72.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-24 13:55:54,758 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 633bd601803a48a576b2418df2ba8b72, disabling compactions & flushes 2024-03-24 13:55:54,758 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1711288554672.633bd601803a48a576b2418df2ba8b72. 2024-03-24 13:55:54,758 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1711288554672.633bd601803a48a576b2418df2ba8b72. 2024-03-24 13:55:54,758 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1711288554672.633bd601803a48a576b2418df2ba8b72. after waiting 0 ms 2024-03-24 13:55:54,758 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1711288554672.633bd601803a48a576b2418df2ba8b72. 2024-03-24 13:55:54,759 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1711288554672.633bd601803a48a576b2418df2ba8b72. 2024-03-24 13:55:54,759 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 633bd601803a48a576b2418df2ba8b72: 2024-03-24 13:55:54,763 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2024-03-24 13:55:54,778 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1711288554672.633bd601803a48a576b2418df2ba8b72.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1711288554766"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1711288554766"}]},"ts":"1711288554766"} 2024-03-24 13:55:54,809 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-24 13:55:54,811 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-24 13:55:54,815 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711288554811"}]},"ts":"1711288554811"} 2024-03-24 13:55:54,820 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2024-03-24 13:55:54,825 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-24 13:55:54,827 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-24 13:55:54,827 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-24 13:55:54,827 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-24 13:55:54,830 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=633bd601803a48a576b2418df2ba8b72, ASSIGN}] 2024-03-24 13:55:54,832 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=633bd601803a48a576b2418df2ba8b72, ASSIGN 2024-03-24 13:55:54,834 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=633bd601803a48a576b2418df2ba8b72, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37469,1711288552789; forceNewPlan=false, retain=false 2024-03-24 13:55:54,986 INFO [jenkins-hbase4:43509] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-24 13:55:54,988 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=633bd601803a48a576b2418df2ba8b72, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37469,1711288552789 2024-03-24 13:55:54,988 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1711288554672.633bd601803a48a576b2418df2ba8b72.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1711288554987"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1711288554987"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1711288554987"}]},"ts":"1711288554987"} 2024-03-24 13:55:54,994 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 633bd601803a48a576b2418df2ba8b72, server=jenkins-hbase4.apache.org,37469,1711288552789}] 2024-03-24 13:55:55,148 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37469,1711288552789 2024-03-24 13:55:55,155 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1711288554672.633bd601803a48a576b2418df2ba8b72. 2024-03-24 13:55:55,157 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 633bd601803a48a576b2418df2ba8b72, NAME => 'hbase:namespace,,1711288554672.633bd601803a48a576b2418df2ba8b72.', STARTKEY => '', ENDKEY => ''} 2024-03-24 13:55:55,157 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 633bd601803a48a576b2418df2ba8b72 2024-03-24 13:55:55,158 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1711288554672.633bd601803a48a576b2418df2ba8b72.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-24 13:55:55,158 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 633bd601803a48a576b2418df2ba8b72 2024-03-24 13:55:55,158 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 633bd601803a48a576b2418df2ba8b72 2024-03-24 13:55:55,160 INFO [StoreOpener-633bd601803a48a576b2418df2ba8b72-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 633bd601803a48a576b2418df2ba8b72 2024-03-24 13:55:55,163 DEBUG [StoreOpener-633bd601803a48a576b2418df2ba8b72-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/namespace/633bd601803a48a576b2418df2ba8b72/info 2024-03-24 13:55:55,163 DEBUG [StoreOpener-633bd601803a48a576b2418df2ba8b72-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/namespace/633bd601803a48a576b2418df2ba8b72/info 2024-03-24 13:55:55,163 INFO [StoreOpener-633bd601803a48a576b2418df2ba8b72-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 633bd601803a48a576b2418df2ba8b72 columnFamilyName info 2024-03-24 13:55:55,164 INFO [StoreOpener-633bd601803a48a576b2418df2ba8b72-1] regionserver.HStore(310): Store=633bd601803a48a576b2418df2ba8b72/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-24 13:55:55,166 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/namespace/633bd601803a48a576b2418df2ba8b72 2024-03-24 13:55:55,167 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/namespace/633bd601803a48a576b2418df2ba8b72 2024-03-24 13:55:55,172 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 633bd601803a48a576b2418df2ba8b72 2024-03-24 13:55:55,175 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/namespace/633bd601803a48a576b2418df2ba8b72/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-24 13:55:55,176 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 633bd601803a48a576b2418df2ba8b72; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59323460, jitterRate=-0.11601155996322632}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-24 13:55:55,176 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 633bd601803a48a576b2418df2ba8b72: 2024-03-24 13:55:55,178 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:namespace,,1711288554672.633bd601803a48a576b2418df2ba8b72., pid=6, masterSystemTime=1711288555148 2024-03-24 13:55:55,182 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:namespace,,1711288554672.633bd601803a48a576b2418df2ba8b72. 2024-03-24 13:55:55,182 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1711288554672.633bd601803a48a576b2418df2ba8b72. 2024-03-24 13:55:55,183 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=633bd601803a48a576b2418df2ba8b72, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37469,1711288552789 2024-03-24 13:55:55,184 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1711288554672.633bd601803a48a576b2418df2ba8b72.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1711288555183"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1711288555183"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1711288555183"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1711288555183"}]},"ts":"1711288555183"} 2024-03-24 13:55:55,192 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=6, resume processing ppid=5 2024-03-24 13:55:55,194 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 633bd601803a48a576b2418df2ba8b72, server=jenkins-hbase4.apache.org,37469,1711288552789 in 194 msec 2024-03-24 13:55:55,196 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=5, resume processing ppid=4 2024-03-24 13:55:55,197 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=633bd601803a48a576b2418df2ba8b72, ASSIGN in 363 msec 2024-03-24 13:55:55,198 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-24 13:55:55,198 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711288555198"}]},"ts":"1711288555198"} 2024-03-24 13:55:55,201 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2024-03-24 13:55:55,205 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2024-03-24 13:55:55,208 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 532 msec 2024-03-24 13:55:55,285 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2024-03-24 13:55:55,287 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2024-03-24 13:55:55,287 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-24 13:55:55,327 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2024-03-24 13:55:55,344 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-03-24 13:55:55,351 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 35 msec 2024-03-24 13:55:55,361 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2024-03-24 13:55:55,373 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-03-24 13:55:55,379 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 18 msec 2024-03-24 13:55:55,387 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2024-03-24 13:55:55,389 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2024-03-24 13:55:55,390 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1084): Master has completed initialization 2.494sec 2024-03-24 13:55:55,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(103): Quota table not found. Creating... 2024-03-24 13:55:55,392 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-24 13:55:55,394 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:quota 2024-03-24 13:55:55,394 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(107): Initializing quota support 2024-03-24 13:55:55,396 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_PRE_OPERATION 2024-03-24 13:55:55,396 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(59): Namespace State Manager started. 2024-03-24 13:55:55,398 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-24 13:55:55,401 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/hbase/quota/3b1e4487bef0d3b970e68f23067786d7 2024-03-24 13:55:55,402 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/hbase/quota/3b1e4487bef0d3b970e68f23067786d7 empty. 2024-03-24 13:55:55,404 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/hbase/quota/3b1e4487bef0d3b970e68f23067786d7 2024-03-24 13:55:55,404 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:quota regions 2024-03-24 13:55:55,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(222): Finished updating state of 2 namespaces. 2024-03-24 13:55:55,404 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceAuditor(50): NamespaceAuditor started. 2024-03-24 13:55:55,406 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:55,407 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:55,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2024-03-24 13:55:55,408 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2024-03-24 13:55:55,409 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43509,1711288551562-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2024-03-24 13:55:55,410 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43509,1711288551562-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2024-03-24 13:55:55,423 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1176): Balancer post startup initialization complete, took 0 seconds 2024-03-24 13:55:55,424 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43509,1711288551562-OldWALsDirSizeChore, period=300000, unit=MILLISECONDS is enabled. 2024-03-24 13:55:55,426 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/hbase/quota/.tabledesc/.tableinfo.0000000001 2024-03-24 13:55:55,427 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(7675): creating {ENCODED => 3b1e4487bef0d3b970e68f23067786d7, NAME => 'hbase:quota,,1711288555392.3b1e4487bef0d3b970e68f23067786d7.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp 2024-03-24 13:55:55,446 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(866): Instantiated hbase:quota,,1711288555392.3b1e4487bef0d3b970e68f23067786d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-24 13:55:55,446 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1604): Closing 3b1e4487bef0d3b970e68f23067786d7, disabling compactions & flushes 2024-03-24 13:55:55,446 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1626): Closing region hbase:quota,,1711288555392.3b1e4487bef0d3b970e68f23067786d7. 2024-03-24 13:55:55,447 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1711288555392.3b1e4487bef0d3b970e68f23067786d7. 2024-03-24 13:55:55,447 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1711288555392.3b1e4487bef0d3b970e68f23067786d7. after waiting 0 ms 2024-03-24 13:55:55,447 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1711288555392.3b1e4487bef0d3b970e68f23067786d7. 2024-03-24 13:55:55,447 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1838): Closed hbase:quota,,1711288555392.3b1e4487bef0d3b970e68f23067786d7. 2024-03-24 13:55:55,447 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1558): Region close journal for 3b1e4487bef0d3b970e68f23067786d7: 2024-03-24 13:55:55,451 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ADD_TO_META 2024-03-24 13:55:55,453 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:quota,,1711288555392.3b1e4487bef0d3b970e68f23067786d7.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1711288555453"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1711288555453"}]},"ts":"1711288555453"} 2024-03-24 13:55:55,456 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-24 13:55:55,458 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-24 13:55:55,458 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711288555458"}]},"ts":"1711288555458"} 2024-03-24 13:55:55,461 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLING in hbase:meta 2024-03-24 13:55:55,466 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-24 13:55:55,467 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-24 13:55:55,467 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-24 13:55:55,468 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-24 13:55:55,468 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=3b1e4487bef0d3b970e68f23067786d7, ASSIGN}] 2024-03-24 13:55:55,469 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=3b1e4487bef0d3b970e68f23067786d7, ASSIGN 2024-03-24 13:55:55,471 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:quota, region=3b1e4487bef0d3b970e68f23067786d7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40925,1711288552834; forceNewPlan=false, retain=false 2024-03-24 13:55:55,473 DEBUG [Listener at localhost/40227] zookeeper.ReadOnlyZKClient(139): Connect 0x29ac09dc to 127.0.0.1:62836 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-03-24 13:55:55,477 DEBUG [Listener at localhost/40227] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1fb53799, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-03-24 13:55:55,491 DEBUG [hconnection-0x3a10af53-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-24 13:55:55,502 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56920, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-03-24 13:55:55,511 INFO [Listener at localhost/40227] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,43509,1711288551562 2024-03-24 13:55:55,513 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:55:55,516 DEBUG [Listener at localhost/40227] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-03-24 13:55:55,618 DEBUG [Listener at localhost/40227] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-03-24 13:55:55,621 INFO [jenkins-hbase4:43509] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-24 13:55:55,622 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=3b1e4487bef0d3b970e68f23067786d7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40925,1711288552834 2024-03-24 13:55:55,622 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:quota,,1711288555392.3b1e4487bef0d3b970e68f23067786d7.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1711288555622"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1711288555622"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1711288555622"}]},"ts":"1711288555622"} 2024-03-24 13:55:55,625 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 3b1e4487bef0d3b970e68f23067786d7, server=jenkins-hbase4.apache.org,40925,1711288552834}] 2024-03-24 13:55:55,720 DEBUG [Listener at localhost/40227] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-03-24 13:55:55,779 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40925,1711288552834 2024-03-24 13:55:55,779 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-03-24 13:55:55,782 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33652, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-03-24 13:55:55,788 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:quota,,1711288555392.3b1e4487bef0d3b970e68f23067786d7. 2024-03-24 13:55:55,788 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3b1e4487bef0d3b970e68f23067786d7, NAME => 'hbase:quota,,1711288555392.3b1e4487bef0d3b970e68f23067786d7.', STARTKEY => '', ENDKEY => ''} 2024-03-24 13:55:55,789 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table quota 3b1e4487bef0d3b970e68f23067786d7 2024-03-24 13:55:55,789 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:quota,,1711288555392.3b1e4487bef0d3b970e68f23067786d7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-24 13:55:55,789 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3b1e4487bef0d3b970e68f23067786d7 2024-03-24 13:55:55,789 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3b1e4487bef0d3b970e68f23067786d7 2024-03-24 13:55:55,791 INFO [StoreOpener-3b1e4487bef0d3b970e68f23067786d7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family q of region 3b1e4487bef0d3b970e68f23067786d7 2024-03-24 13:55:55,793 DEBUG [StoreOpener-3b1e4487bef0d3b970e68f23067786d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/quota/3b1e4487bef0d3b970e68f23067786d7/q 2024-03-24 13:55:55,793 DEBUG [StoreOpener-3b1e4487bef0d3b970e68f23067786d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/quota/3b1e4487bef0d3b970e68f23067786d7/q 2024-03-24 13:55:55,793 INFO [StoreOpener-3b1e4487bef0d3b970e68f23067786d7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b1e4487bef0d3b970e68f23067786d7 columnFamilyName q 2024-03-24 13:55:55,794 INFO [StoreOpener-3b1e4487bef0d3b970e68f23067786d7-1] regionserver.HStore(310): Store=3b1e4487bef0d3b970e68f23067786d7/q, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-24 13:55:55,794 INFO [StoreOpener-3b1e4487bef0d3b970e68f23067786d7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family u of region 3b1e4487bef0d3b970e68f23067786d7 2024-03-24 13:55:55,796 DEBUG [StoreOpener-3b1e4487bef0d3b970e68f23067786d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/quota/3b1e4487bef0d3b970e68f23067786d7/u 2024-03-24 13:55:55,796 DEBUG [StoreOpener-3b1e4487bef0d3b970e68f23067786d7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/quota/3b1e4487bef0d3b970e68f23067786d7/u 2024-03-24 13:55:55,797 INFO [StoreOpener-3b1e4487bef0d3b970e68f23067786d7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3b1e4487bef0d3b970e68f23067786d7 columnFamilyName u 2024-03-24 13:55:55,798 INFO [StoreOpener-3b1e4487bef0d3b970e68f23067786d7-1] regionserver.HStore(310): Store=3b1e4487bef0d3b970e68f23067786d7/u, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-24 13:55:55,799 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/quota/3b1e4487bef0d3b970e68f23067786d7 2024-03-24 13:55:55,800 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/quota/3b1e4487bef0d3b970e68f23067786d7 2024-03-24 13:55:55,803 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:quota descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2024-03-24 13:55:55,805 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3b1e4487bef0d3b970e68f23067786d7 2024-03-24 13:55:55,809 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/quota/3b1e4487bef0d3b970e68f23067786d7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-24 13:55:55,809 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3b1e4487bef0d3b970e68f23067786d7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68371047, jitterRate=0.018807992339134216}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2024-03-24 13:55:55,809 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3b1e4487bef0d3b970e68f23067786d7: 2024-03-24 13:55:55,811 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for hbase:quota,,1711288555392.3b1e4487bef0d3b970e68f23067786d7., pid=11, masterSystemTime=1711288555779 2024-03-24 13:55:55,814 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for hbase:quota,,1711288555392.3b1e4487bef0d3b970e68f23067786d7. 2024-03-24 13:55:55,815 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:quota,,1711288555392.3b1e4487bef0d3b970e68f23067786d7. 2024-03-24 13:55:55,815 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=3b1e4487bef0d3b970e68f23067786d7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40925,1711288552834 2024-03-24 13:55:55,815 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:quota,,1711288555392.3b1e4487bef0d3b970e68f23067786d7.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1711288555815"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1711288555815"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1711288555815"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1711288555815"}]},"ts":"1711288555815"} 2024-03-24 13:55:55,821 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=11, resume processing ppid=10 2024-03-24 13:55:55,821 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 3b1e4487bef0d3b970e68f23067786d7, server=jenkins-hbase4.apache.org,40925,1711288552834 in 193 msec 2024-03-24 13:55:55,822 DEBUG [Listener at localhost/40227] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-03-24 13:55:55,825 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=10, resume processing ppid=9 2024-03-24 13:55:55,825 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:quota, region=3b1e4487bef0d3b970e68f23067786d7, ASSIGN in 353 msec 2024-03-24 13:55:55,826 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-24 13:55:55,826 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711288555826"}]},"ts":"1711288555826"} 2024-03-24 13:55:55,828 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLED in hbase:meta 2024-03-24 13:55:55,832 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_POST_OPERATION 2024-03-24 13:55:55,834 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:quota in 440 msec 2024-03-24 13:55:55,936 DEBUG [Listener at localhost/40227] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-03-24 13:55:55,938 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54218, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2024-03-24 13:55:55,953 DEBUG [hconnection-0x3a10af53-shared-pool-3] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-24 13:55:55,956 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33656, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-03-24 13:55:55,969 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-24 13:55:55,971 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] procedure2.ProcedureExecutor(1075): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin0 2024-03-24 13:55:55,973 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_PRE_OPERATION 2024-03-24 13:55:55,974 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-24 13:55:55,978 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/default/TestQuotaAdmin0/03a04f79647c5a68a3316b37bac8c236 2024-03-24 13:55:55,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin0" procId is: 12 2024-03-24 13:55:55,978 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/default/TestQuotaAdmin0/03a04f79647c5a68a3316b37bac8c236 empty. 2024-03-24 13:55:55,979 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/default/TestQuotaAdmin0/03a04f79647c5a68a3316b37bac8c236 2024-03-24 13:55:55,979 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-03-24 13:55:55,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-03-24 13:55:55,998 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/default/TestQuotaAdmin0/.tabledesc/.tableinfo.0000000001 2024-03-24 13:55:56,000 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(7675): creating {ENCODED => 03a04f79647c5a68a3316b37bac8c236, NAME => 'TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp 2024-03-24 13:55:56,016 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-24 13:55:56,016 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1604): Closing 03a04f79647c5a68a3316b37bac8c236, disabling compactions & flushes 2024-03-24 13:55:56,016 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236. 2024-03-24 13:55:56,016 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236. 2024-03-24 13:55:56,016 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236. after waiting 0 ms 2024-03-24 13:55:56,016 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236. 2024-03-24 13:55:56,016 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236. 2024-03-24 13:55:56,016 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1558): Region close journal for 03a04f79647c5a68a3316b37bac8c236: 2024-03-24 13:55:56,020 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ADD_TO_META 2024-03-24 13:55:56,022 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711288556022"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1711288556022"}]},"ts":"1711288556022"} 2024-03-24 13:55:56,025 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-24 13:55:56,026 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-24 13:55:56,027 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711288556026"}]},"ts":"1711288556026"} 2024-03-24 13:55:56,029 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLING in hbase:meta 2024-03-24 13:55:56,034 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-24 13:55:56,035 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-24 13:55:56,035 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-24 13:55:56,035 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-24 13:55:56,035 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=03a04f79647c5a68a3316b37bac8c236, ASSIGN}] 2024-03-24 13:55:56,037 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=03a04f79647c5a68a3316b37bac8c236, ASSIGN 2024-03-24 13:55:56,038 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin0, region=03a04f79647c5a68a3316b37bac8c236, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37469,1711288552789; forceNewPlan=false, retain=false 2024-03-24 13:55:56,188 INFO [jenkins-hbase4:43509] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-24 13:55:56,189 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=03a04f79647c5a68a3316b37bac8c236, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37469,1711288552789 2024-03-24 13:55:56,189 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711288556189"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1711288556189"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1711288556189"}]},"ts":"1711288556189"} 2024-03-24 13:55:56,193 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; OpenRegionProcedure 03a04f79647c5a68a3316b37bac8c236, server=jenkins-hbase4.apache.org,37469,1711288552789}] 2024-03-24 13:55:56,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-03-24 13:55:56,345 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37469,1711288552789 2024-03-24 13:55:56,352 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236. 2024-03-24 13:55:56,352 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 03a04f79647c5a68a3316b37bac8c236, NAME => 'TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236.', STARTKEY => '', ENDKEY => ''} 2024-03-24 13:55:56,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin0 03a04f79647c5a68a3316b37bac8c236 2024-03-24 13:55:56,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-24 13:55:56,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 03a04f79647c5a68a3316b37bac8c236 2024-03-24 13:55:56,353 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 03a04f79647c5a68a3316b37bac8c236 2024-03-24 13:55:56,355 INFO [StoreOpener-03a04f79647c5a68a3316b37bac8c236-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 03a04f79647c5a68a3316b37bac8c236 2024-03-24 13:55:56,357 DEBUG [StoreOpener-03a04f79647c5a68a3316b37bac8c236-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/default/TestQuotaAdmin0/03a04f79647c5a68a3316b37bac8c236/cf 2024-03-24 13:55:56,357 DEBUG [StoreOpener-03a04f79647c5a68a3316b37bac8c236-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/default/TestQuotaAdmin0/03a04f79647c5a68a3316b37bac8c236/cf 2024-03-24 13:55:56,357 INFO [StoreOpener-03a04f79647c5a68a3316b37bac8c236-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 03a04f79647c5a68a3316b37bac8c236 columnFamilyName cf 2024-03-24 13:55:56,358 INFO [StoreOpener-03a04f79647c5a68a3316b37bac8c236-1] regionserver.HStore(310): Store=03a04f79647c5a68a3316b37bac8c236/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-24 13:55:56,361 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/default/TestQuotaAdmin0/03a04f79647c5a68a3316b37bac8c236 2024-03-24 13:55:56,362 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/default/TestQuotaAdmin0/03a04f79647c5a68a3316b37bac8c236 2024-03-24 13:55:56,367 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 03a04f79647c5a68a3316b37bac8c236 2024-03-24 13:55:56,370 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/default/TestQuotaAdmin0/03a04f79647c5a68a3316b37bac8c236/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-24 13:55:56,371 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 03a04f79647c5a68a3316b37bac8c236; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72720188, jitterRate=0.083615243434906}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-24 13:55:56,371 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 03a04f79647c5a68a3316b37bac8c236: 2024-03-24 13:55:56,373 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236., pid=14, masterSystemTime=1711288556345 2024-03-24 13:55:56,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236. 2024-03-24 13:55:56,375 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236. 2024-03-24 13:55:56,376 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=03a04f79647c5a68a3316b37bac8c236, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37469,1711288552789 2024-03-24 13:55:56,376 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711288556376"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1711288556376"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1711288556376"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1711288556376"}]},"ts":"1711288556376"} 2024-03-24 13:55:56,382 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=14, resume processing ppid=13 2024-03-24 13:55:56,383 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=14, ppid=13, state=SUCCESS; OpenRegionProcedure 03a04f79647c5a68a3316b37bac8c236, server=jenkins-hbase4.apache.org,37469,1711288552789 in 187 msec 2024-03-24 13:55:56,386 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=13, resume processing ppid=12 2024-03-24 13:55:56,387 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=03a04f79647c5a68a3316b37bac8c236, ASSIGN in 348 msec 2024-03-24 13:55:56,388 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-24 13:55:56,388 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711288556388"}]},"ts":"1711288556388"} 2024-03-24 13:55:56,390 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLED in hbase:meta 2024-03-24 13:55:56,394 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_POST_OPERATION 2024-03-24 13:55:56,396 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=12, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin0 in 425 msec 2024-03-24 13:55:56,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-03-24 13:55:56,743 INFO [Listener at localhost/40227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin0, procId: 12 completed 2024-03-24 13:55:56,743 DEBUG [Listener at localhost/40227] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin0 get assigned. Timeout = 60000ms 2024-03-24 13:55:56,744 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:55:56,748 INFO [Listener at localhost/40227] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin0 assigned to meta. Checking AM states. 2024-03-24 13:55:56,749 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:55:56,749 INFO [Listener at localhost/40227] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin0 assigned. 2024-03-24 13:55:56,749 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:55:56,762 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-03-24 13:55:56,765 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54222, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService 2024-03-24 13:55:56,766 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43509] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-24 13:55:56,768 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43509] procedure2.ProcedureExecutor(1075): Stored pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin1 2024-03-24 13:55:56,770 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_PRE_OPERATION 2024-03-24 13:55:56,771 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43509] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin1" procId is: 15 2024-03-24 13:55:56,772 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-24 13:55:56,773 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-03-24 13:55:56,775 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/default/TestQuotaAdmin1/9fc643d2444abca3fa1637d13306e4d0 2024-03-24 13:55:56,776 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/default/TestQuotaAdmin1/9fc643d2444abca3fa1637d13306e4d0 empty. 2024-03-24 13:55:56,777 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/default/TestQuotaAdmin1/9fc643d2444abca3fa1637d13306e4d0 2024-03-24 13:55:56,777 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-03-24 13:55:56,802 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/default/TestQuotaAdmin1/.tabledesc/.tableinfo.0000000001 2024-03-24 13:55:56,804 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9fc643d2444abca3fa1637d13306e4d0, NAME => 'TestQuotaAdmin1,,1711288556765.9fc643d2444abca3fa1637d13306e4d0.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp 2024-03-24 13:55:56,820 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-24 13:55:56,820 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1711288556765.9fc643d2444abca3fa1637d13306e4d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-24 13:55:56,821 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1604): Closing 9fc643d2444abca3fa1637d13306e4d0, disabling compactions & flushes 2024-03-24 13:55:56,821 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1711288556765.9fc643d2444abca3fa1637d13306e4d0. 2024-03-24 13:55:56,821 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1711288556765.9fc643d2444abca3fa1637d13306e4d0. 2024-03-24 13:55:56,821 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1711288556765.9fc643d2444abca3fa1637d13306e4d0. after waiting 0 ms 2024-03-24 13:55:56,821 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1711288556765.9fc643d2444abca3fa1637d13306e4d0. 2024-03-24 13:55:56,821 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1711288556765.9fc643d2444abca3fa1637d13306e4d0. 2024-03-24 13:55:56,821 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1558): Region close journal for 9fc643d2444abca3fa1637d13306e4d0: 2024-03-24 13:55:56,823 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33664, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2024-03-24 13:55:56,826 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ADD_TO_META 2024-03-24 13:55:56,829 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1711288556765.9fc643d2444abca3fa1637d13306e4d0.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711288556828"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1711288556828"}]},"ts":"1711288556828"} 2024-03-24 13:55:56,831 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-24 13:55:56,833 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-24 13:55:56,833 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711288556833"}]},"ts":"1711288556833"} 2024-03-24 13:55:56,835 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLING in hbase:meta 2024-03-24 13:55:56,840 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-24 13:55:56,841 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-24 13:55:56,841 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-24 13:55:56,841 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-24 13:55:56,841 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=9fc643d2444abca3fa1637d13306e4d0, ASSIGN}] 2024-03-24 13:55:56,843 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=9fc643d2444abca3fa1637d13306e4d0, ASSIGN 2024-03-24 13:55:56,844 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin1, region=9fc643d2444abca3fa1637d13306e4d0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40925,1711288552834; forceNewPlan=false, retain=false 2024-03-24 13:55:56,994 INFO [jenkins-hbase4:43509] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-24 13:55:56,995 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=9fc643d2444abca3fa1637d13306e4d0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40925,1711288552834 2024-03-24 13:55:56,995 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1711288556765.9fc643d2444abca3fa1637d13306e4d0.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711288556995"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1711288556995"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1711288556995"}]},"ts":"1711288556995"} 2024-03-24 13:55:56,998 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure 9fc643d2444abca3fa1637d13306e4d0, server=jenkins-hbase4.apache.org,40925,1711288552834}] 2024-03-24 13:55:57,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-03-24 13:55:57,151 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40925,1711288552834 2024-03-24 13:55:57,157 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin1,,1711288556765.9fc643d2444abca3fa1637d13306e4d0. 2024-03-24 13:55:57,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9fc643d2444abca3fa1637d13306e4d0, NAME => 'TestQuotaAdmin1,,1711288556765.9fc643d2444abca3fa1637d13306e4d0.', STARTKEY => '', ENDKEY => ''} 2024-03-24 13:55:57,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin1 9fc643d2444abca3fa1637d13306e4d0 2024-03-24 13:55:57,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1711288556765.9fc643d2444abca3fa1637d13306e4d0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-24 13:55:57,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9fc643d2444abca3fa1637d13306e4d0 2024-03-24 13:55:57,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9fc643d2444abca3fa1637d13306e4d0 2024-03-24 13:55:57,159 INFO [StoreOpener-9fc643d2444abca3fa1637d13306e4d0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9fc643d2444abca3fa1637d13306e4d0 2024-03-24 13:55:57,162 DEBUG [StoreOpener-9fc643d2444abca3fa1637d13306e4d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/default/TestQuotaAdmin1/9fc643d2444abca3fa1637d13306e4d0/cf 2024-03-24 13:55:57,162 DEBUG [StoreOpener-9fc643d2444abca3fa1637d13306e4d0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/default/TestQuotaAdmin1/9fc643d2444abca3fa1637d13306e4d0/cf 2024-03-24 13:55:57,162 INFO [StoreOpener-9fc643d2444abca3fa1637d13306e4d0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9fc643d2444abca3fa1637d13306e4d0 columnFamilyName cf 2024-03-24 13:55:57,163 INFO [StoreOpener-9fc643d2444abca3fa1637d13306e4d0-1] regionserver.HStore(310): Store=9fc643d2444abca3fa1637d13306e4d0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-24 13:55:57,165 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/default/TestQuotaAdmin1/9fc643d2444abca3fa1637d13306e4d0 2024-03-24 13:55:57,166 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/default/TestQuotaAdmin1/9fc643d2444abca3fa1637d13306e4d0 2024-03-24 13:55:57,171 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9fc643d2444abca3fa1637d13306e4d0 2024-03-24 13:55:57,176 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/default/TestQuotaAdmin1/9fc643d2444abca3fa1637d13306e4d0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-24 13:55:57,177 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9fc643d2444abca3fa1637d13306e4d0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69693156, jitterRate=0.03850895166397095}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-24 13:55:57,177 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9fc643d2444abca3fa1637d13306e4d0: 2024-03-24 13:55:57,178 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin1,,1711288556765.9fc643d2444abca3fa1637d13306e4d0., pid=17, masterSystemTime=1711288557151 2024-03-24 13:55:57,180 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin1,,1711288556765.9fc643d2444abca3fa1637d13306e4d0. 2024-03-24 13:55:57,180 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin1,,1711288556765.9fc643d2444abca3fa1637d13306e4d0. 2024-03-24 13:55:57,181 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=9fc643d2444abca3fa1637d13306e4d0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40925,1711288552834 2024-03-24 13:55:57,181 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin1,,1711288556765.9fc643d2444abca3fa1637d13306e4d0.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711288557181"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1711288557181"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1711288557181"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1711288557181"}]},"ts":"1711288557181"} 2024-03-24 13:55:57,187 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=17, resume processing ppid=16 2024-03-24 13:55:57,187 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure 9fc643d2444abca3fa1637d13306e4d0, server=jenkins-hbase4.apache.org,40925,1711288552834 in 186 msec 2024-03-24 13:55:57,191 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=16, resume processing ppid=15 2024-03-24 13:55:57,192 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=9fc643d2444abca3fa1637d13306e4d0, ASSIGN in 346 msec 2024-03-24 13:55:57,193 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-24 13:55:57,194 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711288557194"}]},"ts":"1711288557194"} 2024-03-24 13:55:57,196 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLED in hbase:meta 2024-03-24 13:55:57,199 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=15, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_POST_OPERATION 2024-03-24 13:55:57,202 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=15, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin1 in 433 msec 2024-03-24 13:55:57,527 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-03-24 13:55:57,527 INFO [Listener at localhost/40227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin1, procId: 15 completed 2024-03-24 13:55:57,527 DEBUG [Listener at localhost/40227] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin1 get assigned. Timeout = 60000ms 2024-03-24 13:55:57,527 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:55:57,531 INFO [Listener at localhost/40227] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin1 assigned to meta. Checking AM states. 2024-03-24 13:55:57,531 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:55:57,531 INFO [Listener at localhost/40227] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin1 assigned. 2024-03-24 13:55:57,531 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:55:57,541 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-03-24 13:55:57,545 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:54232, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=MasterService 2024-03-24 13:55:57,546 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-24 13:55:57,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] procedure2.ProcedureExecutor(1075): Stored pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin2 2024-03-24 13:55:57,550 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_PRE_OPERATION 2024-03-24 13:55:57,550 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin2" procId is: 18 2024-03-24 13:55:57,552 DEBUG [hconnection-0x4c66f0a5-metaLookup-shared--pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-24 13:55:57,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-03-24 13:55:57,553 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-24 13:55:57,554 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56922, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=ClientService 2024-03-24 13:55:57,556 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/default/TestQuotaAdmin2/9184ea00d554227e9de8e52f4c2de283 2024-03-24 13:55:57,557 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/default/TestQuotaAdmin2/9184ea00d554227e9de8e52f4c2de283 empty. 2024-03-24 13:55:57,558 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/default/TestQuotaAdmin2/9184ea00d554227e9de8e52f4c2de283 2024-03-24 13:55:57,559 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-03-24 13:55:57,577 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/default/TestQuotaAdmin2/.tabledesc/.tableinfo.0000000001 2024-03-24 13:55:57,579 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(7675): creating {ENCODED => 9184ea00d554227e9de8e52f4c2de283, NAME => 'TestQuotaAdmin2,,1711288557546.9184ea00d554227e9de8e52f4c2de283.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp 2024-03-24 13:55:57,592 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1711288557546.9184ea00d554227e9de8e52f4c2de283.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-24 13:55:57,592 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1604): Closing 9184ea00d554227e9de8e52f4c2de283, disabling compactions & flushes 2024-03-24 13:55:57,592 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1711288557546.9184ea00d554227e9de8e52f4c2de283. 2024-03-24 13:55:57,593 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1711288557546.9184ea00d554227e9de8e52f4c2de283. 2024-03-24 13:55:57,593 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1711288557546.9184ea00d554227e9de8e52f4c2de283. after waiting 0 ms 2024-03-24 13:55:57,593 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1711288557546.9184ea00d554227e9de8e52f4c2de283. 2024-03-24 13:55:57,593 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1711288557546.9184ea00d554227e9de8e52f4c2de283. 2024-03-24 13:55:57,593 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1558): Region close journal for 9184ea00d554227e9de8e52f4c2de283: 2024-03-24 13:55:57,597 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ADD_TO_META 2024-03-24 13:55:57,599 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1711288557546.9184ea00d554227e9de8e52f4c2de283.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711288557599"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1711288557599"}]},"ts":"1711288557599"} 2024-03-24 13:55:57,601 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-03-24 13:55:57,602 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-24 13:55:57,603 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711288557603"}]},"ts":"1711288557603"} 2024-03-24 13:55:57,605 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLING in hbase:meta 2024-03-24 13:55:57,609 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-24 13:55:57,610 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-24 13:55:57,610 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-24 13:55:57,610 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-24 13:55:57,611 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=9184ea00d554227e9de8e52f4c2de283, ASSIGN}] 2024-03-24 13:55:57,612 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=9184ea00d554227e9de8e52f4c2de283, ASSIGN 2024-03-24 13:55:57,613 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin2, region=9184ea00d554227e9de8e52f4c2de283, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40925,1711288552834; forceNewPlan=false, retain=false 2024-03-24 13:55:57,763 INFO [jenkins-hbase4:43509] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-03-24 13:55:57,764 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=9184ea00d554227e9de8e52f4c2de283, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40925,1711288552834 2024-03-24 13:55:57,765 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1711288557546.9184ea00d554227e9de8e52f4c2de283.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711288557764"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1711288557764"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1711288557764"}]},"ts":"1711288557764"} 2024-03-24 13:55:57,767 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE; OpenRegionProcedure 9184ea00d554227e9de8e52f4c2de283, server=jenkins-hbase4.apache.org,40925,1711288552834}] 2024-03-24 13:55:57,804 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-03-24 13:55:57,920 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40925,1711288552834 2024-03-24 13:55:57,925 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin2,,1711288557546.9184ea00d554227e9de8e52f4c2de283. 2024-03-24 13:55:57,925 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 9184ea00d554227e9de8e52f4c2de283, NAME => 'TestQuotaAdmin2,,1711288557546.9184ea00d554227e9de8e52f4c2de283.', STARTKEY => '', ENDKEY => ''} 2024-03-24 13:55:57,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin2 9184ea00d554227e9de8e52f4c2de283 2024-03-24 13:55:57,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1711288557546.9184ea00d554227e9de8e52f4c2de283.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-24 13:55:57,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 9184ea00d554227e9de8e52f4c2de283 2024-03-24 13:55:57,926 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 9184ea00d554227e9de8e52f4c2de283 2024-03-24 13:55:57,928 INFO [StoreOpener-9184ea00d554227e9de8e52f4c2de283-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 9184ea00d554227e9de8e52f4c2de283 2024-03-24 13:55:57,930 DEBUG [StoreOpener-9184ea00d554227e9de8e52f4c2de283-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/default/TestQuotaAdmin2/9184ea00d554227e9de8e52f4c2de283/cf 2024-03-24 13:55:57,930 DEBUG [StoreOpener-9184ea00d554227e9de8e52f4c2de283-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/default/TestQuotaAdmin2/9184ea00d554227e9de8e52f4c2de283/cf 2024-03-24 13:55:57,930 INFO [StoreOpener-9184ea00d554227e9de8e52f4c2de283-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 9184ea00d554227e9de8e52f4c2de283 columnFamilyName cf 2024-03-24 13:55:57,931 INFO [StoreOpener-9184ea00d554227e9de8e52f4c2de283-1] regionserver.HStore(310): Store=9184ea00d554227e9de8e52f4c2de283/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-24 13:55:57,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/default/TestQuotaAdmin2/9184ea00d554227e9de8e52f4c2de283 2024-03-24 13:55:57,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/default/TestQuotaAdmin2/9184ea00d554227e9de8e52f4c2de283 2024-03-24 13:55:57,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 9184ea00d554227e9de8e52f4c2de283 2024-03-24 13:55:57,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/default/TestQuotaAdmin2/9184ea00d554227e9de8e52f4c2de283/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-24 13:55:57,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 9184ea00d554227e9de8e52f4c2de283; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66481649, jitterRate=-0.009346231818199158}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-24 13:55:57,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 9184ea00d554227e9de8e52f4c2de283: 2024-03-24 13:55:57,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestQuotaAdmin2,,1711288557546.9184ea00d554227e9de8e52f4c2de283., pid=20, masterSystemTime=1711288557920 2024-03-24 13:55:57,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestQuotaAdmin2,,1711288557546.9184ea00d554227e9de8e52f4c2de283. 2024-03-24 13:55:57,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin2,,1711288557546.9184ea00d554227e9de8e52f4c2de283. 2024-03-24 13:55:57,946 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=9184ea00d554227e9de8e52f4c2de283, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40925,1711288552834 2024-03-24 13:55:57,947 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin2,,1711288557546.9184ea00d554227e9de8e52f4c2de283.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711288557946"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1711288557946"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1711288557946"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1711288557946"}]},"ts":"1711288557946"} 2024-03-24 13:55:57,952 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=20, resume processing ppid=19 2024-03-24 13:55:57,952 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=20, ppid=19, state=SUCCESS; OpenRegionProcedure 9184ea00d554227e9de8e52f4c2de283, server=jenkins-hbase4.apache.org,40925,1711288552834 in 182 msec 2024-03-24 13:55:57,955 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=19, resume processing ppid=18 2024-03-24 13:55:57,956 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=19, ppid=18, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=9184ea00d554227e9de8e52f4c2de283, ASSIGN in 341 msec 2024-03-24 13:55:57,957 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-24 13:55:57,957 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711288557957"}]},"ts":"1711288557957"} 2024-03-24 13:55:57,959 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLED in hbase:meta 2024-03-24 13:55:57,963 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=18, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_POST_OPERATION 2024-03-24 13:55:57,965 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=18, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin2 in 417 msec 2024-03-24 13:55:58,306 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-03-24 13:55:58,306 INFO [Listener at localhost/40227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin2, procId: 18 completed 2024-03-24 13:55:58,306 DEBUG [Listener at localhost/40227] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin2 get assigned. Timeout = 60000ms 2024-03-24 13:55:58,307 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:55:58,311 INFO [Listener at localhost/40227] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin2 assigned to meta. Checking AM states. 2024-03-24 13:55:58,311 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:55:58,311 INFO [Listener at localhost/40227] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin2 assigned. 2024-03-24 13:55:58,311 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:55:58,326 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.HMaster$15(3020): Client=jenkins//172.31.14.131 creating {NAME => 'TestNs'} 2024-03-24 13:55:58,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] procedure2.ProcedureExecutor(1075): Stored pid=21, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=TestNs 2024-03-24 13:55:58,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-03-24 13:55:58,342 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-03-24 13:55:58,349 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=21, state=SUCCESS; CreateNamespaceProcedure, namespace=TestNs in 21 msec 2024-03-24 13:55:58,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-03-24 13:55:58,589 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-03-24 13:55:58,591 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] procedure2.ProcedureExecutor(1075): Stored pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestNs:TestTable 2024-03-24 13:55:58,593 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_PRE_OPERATION 2024-03-24 13:55:58,593 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "TestNs" qualifier: "TestTable" procId is: 22 2024-03-24 13:55:58,594 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-03-24 13:55:58,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-03-24 13:55:58,598 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/TestNs/TestTable/b43be9749aa878274456e84b0f6330f0 2024-03-24 13:55:58,598 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/TestNs/TestTable/90551395faf793aa1bfdf13f276d118b 2024-03-24 13:55:58,599 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/TestNs/TestTable/b43be9749aa878274456e84b0f6330f0 empty. 2024-03-24 13:55:58,599 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/TestNs/TestTable/90551395faf793aa1bfdf13f276d118b empty. 2024-03-24 13:55:58,599 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/TestNs/TestTable/b43be9749aa878274456e84b0f6330f0 2024-03-24 13:55:58,599 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/TestNs/TestTable/90551395faf793aa1bfdf13f276d118b 2024-03-24 13:55:58,599 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-03-24 13:55:58,616 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/TestNs/TestTable/.tabledesc/.tableinfo.0000000001 2024-03-24 13:55:58,618 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(7675): creating {ENCODED => b43be9749aa878274456e84b0f6330f0, NAME => 'TestNs:TestTable,,1711288558589.b43be9749aa878274456e84b0f6330f0.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp 2024-03-24 13:55:58,618 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(7675): creating {ENCODED => 90551395faf793aa1bfdf13f276d118b, NAME => 'TestNs:TestTable,1,1711288558589.90551395faf793aa1bfdf13f276d118b.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp 2024-03-24 13:55:58,638 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1711288558589.b43be9749aa878274456e84b0f6330f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-24 13:55:58,638 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1604): Closing b43be9749aa878274456e84b0f6330f0, disabling compactions & flushes 2024-03-24 13:55:58,639 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1711288558589.b43be9749aa878274456e84b0f6330f0. 2024-03-24 13:55:58,639 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1711288558589.b43be9749aa878274456e84b0f6330f0. 2024-03-24 13:55:58,639 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1711288558589.b43be9749aa878274456e84b0f6330f0. after waiting 0 ms 2024-03-24 13:55:58,639 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1711288558589.b43be9749aa878274456e84b0f6330f0. 2024-03-24 13:55:58,639 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1711288558589.b43be9749aa878274456e84b0f6330f0. 2024-03-24 13:55:58,639 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1558): Region close journal for b43be9749aa878274456e84b0f6330f0: 2024-03-24 13:55:58,640 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1711288558589.90551395faf793aa1bfdf13f276d118b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-24 13:55:58,640 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1604): Closing 90551395faf793aa1bfdf13f276d118b, disabling compactions & flushes 2024-03-24 13:55:58,640 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1711288558589.90551395faf793aa1bfdf13f276d118b. 2024-03-24 13:55:58,640 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1711288558589.90551395faf793aa1bfdf13f276d118b. 2024-03-24 13:55:58,640 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1711288558589.90551395faf793aa1bfdf13f276d118b. after waiting 0 ms 2024-03-24 13:55:58,640 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1711288558589.90551395faf793aa1bfdf13f276d118b. 2024-03-24 13:55:58,640 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1711288558589.90551395faf793aa1bfdf13f276d118b. 2024-03-24 13:55:58,640 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1558): Region close journal for 90551395faf793aa1bfdf13f276d118b: 2024-03-24 13:55:58,644 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ADD_TO_META 2024-03-24 13:55:58,646 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,,1711288558589.b43be9749aa878274456e84b0f6330f0.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1711288558646"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1711288558646"}]},"ts":"1711288558646"} 2024-03-24 13:55:58,646 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1711288558589.90551395faf793aa1bfdf13f276d118b.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1711288558646"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1711288558646"}]},"ts":"1711288558646"} 2024-03-24 13:55:58,652 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2024-03-24 13:55:58,653 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-03-24 13:55:58,654 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711288558653"}]},"ts":"1711288558653"} 2024-03-24 13:55:58,656 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLING in hbase:meta 2024-03-24 13:55:58,660 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-03-24 13:55:58,662 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-03-24 13:55:58,662 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-03-24 13:55:58,662 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-03-24 13:55:58,662 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=b43be9749aa878274456e84b0f6330f0, ASSIGN}, {pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=90551395faf793aa1bfdf13f276d118b, ASSIGN}] 2024-03-24 13:55:58,664 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=90551395faf793aa1bfdf13f276d118b, ASSIGN 2024-03-24 13:55:58,664 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=b43be9749aa878274456e84b0f6330f0, ASSIGN 2024-03-24 13:55:58,665 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=b43be9749aa878274456e84b0f6330f0, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,37469,1711288552789; forceNewPlan=false, retain=false 2024-03-24 13:55:58,665 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=90551395faf793aa1bfdf13f276d118b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40925,1711288552834; forceNewPlan=false, retain=false 2024-03-24 13:55:58,815 INFO [jenkins-hbase4:43509] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2024-03-24 13:55:58,817 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=b43be9749aa878274456e84b0f6330f0, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,37469,1711288552789 2024-03-24 13:55:58,817 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=90551395faf793aa1bfdf13f276d118b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40925,1711288552834 2024-03-24 13:55:58,817 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1711288558589.b43be9749aa878274456e84b0f6330f0.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1711288558817"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1711288558817"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1711288558817"}]},"ts":"1711288558817"} 2024-03-24 13:55:58,817 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1711288558589.90551395faf793aa1bfdf13f276d118b.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1711288558817"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1711288558817"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1711288558817"}]},"ts":"1711288558817"} 2024-03-24 13:55:58,820 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; OpenRegionProcedure b43be9749aa878274456e84b0f6330f0, server=jenkins-hbase4.apache.org,37469,1711288552789}] 2024-03-24 13:55:58,821 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=26, ppid=24, state=RUNNABLE; OpenRegionProcedure 90551395faf793aa1bfdf13f276d118b, server=jenkins-hbase4.apache.org,40925,1711288552834}] 2024-03-24 13:55:58,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-03-24 13:55:58,972 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37469,1711288552789 2024-03-24 13:55:58,975 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40925,1711288552834 2024-03-24 13:55:58,978 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,,1711288558589.b43be9749aa878274456e84b0f6330f0. 2024-03-24 13:55:58,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => b43be9749aa878274456e84b0f6330f0, NAME => 'TestNs:TestTable,,1711288558589.b43be9749aa878274456e84b0f6330f0.', STARTKEY => '', ENDKEY => '1'} 2024-03-24 13:55:58,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable b43be9749aa878274456e84b0f6330f0 2024-03-24 13:55:58,978 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1711288558589.b43be9749aa878274456e84b0f6330f0.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-24 13:55:58,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for b43be9749aa878274456e84b0f6330f0 2024-03-24 13:55:58,979 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for b43be9749aa878274456e84b0f6330f0 2024-03-24 13:55:58,979 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,1,1711288558589.90551395faf793aa1bfdf13f276d118b. 2024-03-24 13:55:58,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 90551395faf793aa1bfdf13f276d118b, NAME => 'TestNs:TestTable,1,1711288558589.90551395faf793aa1bfdf13f276d118b.', STARTKEY => '1', ENDKEY => ''} 2024-03-24 13:55:58,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable 90551395faf793aa1bfdf13f276d118b 2024-03-24 13:55:58,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1711288558589.90551395faf793aa1bfdf13f276d118b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-03-24 13:55:58,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 90551395faf793aa1bfdf13f276d118b 2024-03-24 13:55:58,980 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 90551395faf793aa1bfdf13f276d118b 2024-03-24 13:55:58,980 INFO [StoreOpener-b43be9749aa878274456e84b0f6330f0-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region b43be9749aa878274456e84b0f6330f0 2024-03-24 13:55:58,982 INFO [StoreOpener-90551395faf793aa1bfdf13f276d118b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 90551395faf793aa1bfdf13f276d118b 2024-03-24 13:55:58,983 DEBUG [StoreOpener-b43be9749aa878274456e84b0f6330f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/TestNs/TestTable/b43be9749aa878274456e84b0f6330f0/cf 2024-03-24 13:55:58,983 DEBUG [StoreOpener-b43be9749aa878274456e84b0f6330f0-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/TestNs/TestTable/b43be9749aa878274456e84b0f6330f0/cf 2024-03-24 13:55:58,983 INFO [StoreOpener-b43be9749aa878274456e84b0f6330f0-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region b43be9749aa878274456e84b0f6330f0 columnFamilyName cf 2024-03-24 13:55:58,984 DEBUG [StoreOpener-90551395faf793aa1bfdf13f276d118b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/TestNs/TestTable/90551395faf793aa1bfdf13f276d118b/cf 2024-03-24 13:55:58,984 DEBUG [StoreOpener-90551395faf793aa1bfdf13f276d118b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/TestNs/TestTable/90551395faf793aa1bfdf13f276d118b/cf 2024-03-24 13:55:58,984 INFO [StoreOpener-b43be9749aa878274456e84b0f6330f0-1] regionserver.HStore(310): Store=b43be9749aa878274456e84b0f6330f0/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-24 13:55:58,985 INFO [StoreOpener-90551395faf793aa1bfdf13f276d118b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 90551395faf793aa1bfdf13f276d118b columnFamilyName cf 2024-03-24 13:55:58,986 INFO [StoreOpener-90551395faf793aa1bfdf13f276d118b-1] regionserver.HStore(310): Store=90551395faf793aa1bfdf13f276d118b/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-03-24 13:55:58,986 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/TestNs/TestTable/b43be9749aa878274456e84b0f6330f0 2024-03-24 13:55:58,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/TestNs/TestTable/b43be9749aa878274456e84b0f6330f0 2024-03-24 13:55:58,988 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/TestNs/TestTable/90551395faf793aa1bfdf13f276d118b 2024-03-24 13:55:58,989 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/TestNs/TestTable/90551395faf793aa1bfdf13f276d118b 2024-03-24 13:55:58,992 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for b43be9749aa878274456e84b0f6330f0 2024-03-24 13:55:58,993 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 90551395faf793aa1bfdf13f276d118b 2024-03-24 13:55:58,995 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/TestNs/TestTable/b43be9749aa878274456e84b0f6330f0/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-24 13:55:58,996 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/TestNs/TestTable/90551395faf793aa1bfdf13f276d118b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-03-24 13:55:58,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened b43be9749aa878274456e84b0f6330f0; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73093858, jitterRate=0.08918336033821106}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-24 13:55:58,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for b43be9749aa878274456e84b0f6330f0: 2024-03-24 13:55:58,997 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 90551395faf793aa1bfdf13f276d118b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=60519395, jitterRate=-0.09819073975086212}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-03-24 13:55:58,997 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 90551395faf793aa1bfdf13f276d118b: 2024-03-24 13:55:58,998 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestNs:TestTable,,1711288558589.b43be9749aa878274456e84b0f6330f0., pid=25, masterSystemTime=1711288558972 2024-03-24 13:55:58,998 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2338): Post open deploy tasks for TestNs:TestTable,1,1711288558589.90551395faf793aa1bfdf13f276d118b., pid=26, masterSystemTime=1711288558975 2024-03-24 13:55:59,036 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestNs:TestTable,,1711288558589.b43be9749aa878274456e84b0f6330f0. 2024-03-24 13:55:59,036 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,,1711288558589.b43be9749aa878274456e84b0f6330f0. 2024-03-24 13:55:59,037 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=b43be9749aa878274456e84b0f6330f0, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,37469,1711288552789 2024-03-24 13:55:59,037 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2365): Finished post open deploy task for TestNs:TestTable,1,1711288558589.90551395faf793aa1bfdf13f276d118b. 2024-03-24 13:55:59,037 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,,1711288558589.b43be9749aa878274456e84b0f6330f0.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1711288559037"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1711288559037"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1711288559037"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1711288559037"}]},"ts":"1711288559037"} 2024-03-24 13:55:59,038 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,1,1711288558589.90551395faf793aa1bfdf13f276d118b. 2024-03-24 13:55:59,038 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=90551395faf793aa1bfdf13f276d118b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40925,1711288552834 2024-03-24 13:55:59,039 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,1,1711288558589.90551395faf793aa1bfdf13f276d118b.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1711288559038"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1711288559038"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1711288559038"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1711288559038"}]},"ts":"1711288559038"} 2024-03-24 13:55:59,043 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=25, resume processing ppid=23 2024-03-24 13:55:59,043 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=25, ppid=23, state=SUCCESS; OpenRegionProcedure b43be9749aa878274456e84b0f6330f0, server=jenkins-hbase4.apache.org,37469,1711288552789 in 220 msec 2024-03-24 13:55:59,045 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=26, resume processing ppid=24 2024-03-24 13:55:59,045 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=26, ppid=24, state=SUCCESS; OpenRegionProcedure 90551395faf793aa1bfdf13f276d118b, server=jenkins-hbase4.apache.org,40925,1711288552834 in 221 msec 2024-03-24 13:55:59,046 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=23, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=b43be9749aa878274456e84b0f6330f0, ASSIGN in 381 msec 2024-03-24 13:55:59,048 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=24, resume processing ppid=22 2024-03-24 13:55:59,048 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=24, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=90551395faf793aa1bfdf13f276d118b, ASSIGN in 383 msec 2024-03-24 13:55:59,049 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-03-24 13:55:59,049 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711288559049"}]},"ts":"1711288559049"} 2024-03-24 13:55:59,051 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLED in hbase:meta 2024-03-24 13:55:59,055 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=22, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_POST_OPERATION 2024-03-24 13:55:59,057 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=22, state=SUCCESS; CreateTableProcedure table=TestNs:TestTable in 466 msec 2024-03-24 13:55:59,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-03-24 13:55:59,349 INFO [Listener at localhost/40227] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: TestNs:TestTable, procId: 22 completed 2024-03-24 13:55:59,349 DEBUG [Listener at localhost/40227] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestNs:TestTable get assigned. Timeout = 60000ms 2024-03-24 13:55:59,349 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:55:59,353 INFO [Listener at localhost/40227] hbase.HBaseTestingUtility(3484): All regions for table TestNs:TestTable assigned to meta. Checking AM states. 2024-03-24 13:55:59,354 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:55:59,354 INFO [Listener at localhost/40227] hbase.HBaseTestingUtility(3504): All regions for table TestNs:TestTable assigned. 2024-03-24 13:55:59,354 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:55:59,399 INFO [Listener at localhost/40227] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=305, OpenFileDescriptor=626, MaxFileDescriptor=60000, SystemLoadAverage=200, ProcessCount=168, AvailableMemoryMB=12481 2024-03-24 13:55:59,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-03-24 13:55:59,423 INFO [RS-EventLoopGroup-4-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:33668, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-03-24 13:55:59,692 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:55:59,692 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-24 13:55:59,692 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711292159440 bypass), TestNs=QuotaState(ts=1711292159440 bypass)} 2024-03-24 13:55:59,692 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1711292159440 bypass), TestNs:TestTable=QuotaState(ts=1711292159440 bypass)} 2024-03-24 13:55:59,692 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1711292159440 [ TestNs:TestTable ])} 2024-03-24 13:55:59,692 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711292159440 bypass)} 2024-03-24 13:55:59,943 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:55:59,943 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-24 13:55:59,943 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711292159440 bypass), TestNs=QuotaState(ts=1711292159440 bypass)} 2024-03-24 13:55:59,943 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1711292159440 bypass), TestQuotaAdmin2=QuotaState(ts=1711292159440 bypass), TestQuotaAdmin1=QuotaState(ts=1711292159440 bypass)} 2024-03-24 13:55:59,943 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1711292159440 [ TestNs:TestTable ])} 2024-03-24 13:55:59,943 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711292159440 bypass)} 2024-03-24 13:55:59,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:55:59,961 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] ipc.CallRunner(144): callId: 90 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:33656 deadline: 1711288569960, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:55:59,992 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2024-03-24 13:56:00,084 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestNs:TestTable' 2024-03-24 13:56:00,085 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin2' 2024-03-24 13:56:00,086 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:quota' 2024-03-24 13:56:00,086 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin1' 2024-03-24 13:56:00,087 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin0' 2024-03-24 13:56:00,087 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2024-03-24 13:56:00,088 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2024-03-24 13:56:00,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:00,217 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] ipc.CallRunner(144): callId: 92 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:33656 deadline: 1711288569961, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:00,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:00,722 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] ipc.CallRunner(144): callId: 94 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:33656 deadline: 1711288569961, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:01,481 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:01,482 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] ipc.CallRunner(144): callId: 96 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:33656 deadline: 1711288569960, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:01,736 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-03-24 13:56:01,737 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver Metrics about HBase MasterObservers 2024-03-24 13:56:01,737 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-03-24 13:56:01,738 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2024-03-24 13:56:02,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:02,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] ipc.CallRunner(144): callId: 98 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:33656 deadline: 1711288569961, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:05,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:05,263 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] ipc.CallRunner(144): callId: 100 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:33656 deadline: 1711288569961, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:05,264 ERROR [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10332: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1711288558589.90551395faf793aa1bfdf13f276d118b., hostname=jenkins-hbase4.apache.org,40925,1711288552834, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-24 13:56:05,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:05,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] ipc.CallRunner(144): callId: 101 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:33656 deadline: 1711288575267, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:05,522 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:05,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] ipc.CallRunner(144): callId: 103 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:33656 deadline: 1711288575266, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:06,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:06,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] ipc.CallRunner(144): callId: 105 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:33656 deadline: 1711288575267, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:06,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:06,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] ipc.CallRunner(144): callId: 107 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:33656 deadline: 1711288575266, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:08,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:08,046 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] ipc.CallRunner(144): callId: 109 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:33656 deadline: 1711288575267, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:10,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:10,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] ipc.CallRunner(144): callId: 111 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:33656 deadline: 1711288575267, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:10,559 ERROR [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10302: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1711288558589.90551395faf793aa1bfdf13f276d118b., hostname=jenkins-hbase4.apache.org,40925,1711288552834, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-24 13:56:10,819 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:56:10,820 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-24 13:56:10,820 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711295759440 bypass), TestNs=QuotaState(ts=1711295759440 bypass)} 2024-03-24 13:56:10,820 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1711295759440 bypass), TestNs:TestTable=QuotaState(ts=1711295759440 bypass)} 2024-03-24 13:56:10,820 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1711295759440 bypass)} 2024-03-24 13:56:10,820 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711295759440 bypass)} 2024-03-24 13:56:11,070 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:56:11,070 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-24 13:56:11,070 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711295759440 bypass), TestNs=QuotaState(ts=1711295759440 bypass)} 2024-03-24 13:56:11,071 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1711295759440 bypass), TestQuotaAdmin2=QuotaState(ts=1711295759440 bypass), TestQuotaAdmin1=QuotaState(ts=1711295759440 bypass)} 2024-03-24 13:56:11,071 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1711295759440 bypass)} 2024-03-24 13:56:11,071 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711295759440 bypass)} 2024-03-24 13:56:11,087 INFO [Listener at localhost/40227] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=290 (was 305), OpenFileDescriptor=603 (was 626), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=170 (was 200), ProcessCount=168 (was 168), AvailableMemoryMB=12470 (was 12481) 2024-03-24 13:56:11,102 INFO [Listener at localhost/40227] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=290, OpenFileDescriptor=603, MaxFileDescriptor=60000, SystemLoadAverage=170, ProcessCount=168, AvailableMemoryMB=12469 2024-03-24 13:56:11,366 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:56:11,366 INFO [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-03-24 13:56:11,616 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-24 13:56:11,617 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711299359540 bypass), TestNs=QuotaState(ts=1711299359540 bypass)} 2024-03-24 13:56:11,618 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1711299359540 bypass), TestNs:TestTable=QuotaState(ts=1711299359540 bypass)} 2024-03-24 13:56:11,618 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1711299359540 [ default ])} 2024-03-24 13:56:11,618 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711299359540 bypass)} 2024-03-24 13:56:11,869 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:56:11,869 INFO [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-03-24 13:56:12,119 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-24 13:56:12,120 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711299359640 bypass), TestNs=QuotaState(ts=1711299359640 bypass)} 2024-03-24 13:56:12,122 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1711299359640 bypass), TestQuotaAdmin2=QuotaState(ts=1711299359640 bypass), TestQuotaAdmin1=QuotaState(ts=1711299359640 bypass)} 2024-03-24 13:56:12,122 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1711299359640 [ default ])} 2024-03-24 13:56:12,122 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711299359640 bypass)} 2024-03-24 13:56:12,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-24 13:56:12,131 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 123 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:56920 deadline: 1711288582131, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-24 13:56:12,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-24 13:56:12,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 125 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:56920 deadline: 1711288582131, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-24 13:56:12,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-24 13:56:12,890 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 127 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:56920 deadline: 1711288582130, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-24 13:56:13,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-24 13:56:13,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 129 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:56920 deadline: 1711288582131, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-24 13:56:14,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-24 13:56:14,905 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 131 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:56920 deadline: 1711288582130, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-24 13:56:17,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-03-24 13:56:17,419 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 133 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:56920 deadline: 1711288582131, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-03-24 13:56:17,422 ERROR [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10337: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236., hostname=jenkins-hbase4.apache.org,37469,1711288552789, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:199) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-24 13:56:17,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:17,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 140 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:56920 deadline: 1711288587445, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:17,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:17,700 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 142 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:56920 deadline: 1711288587446, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:18,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:18,209 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 144 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:56920 deadline: 1711288587445, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:18,966 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:18,967 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 146 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:56920 deadline: 1711288587446, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:20,227 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:20,228 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 148 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:56920 deadline: 1711288587446, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:22,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:22,747 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 150 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:56920 deadline: 1711288587446, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:22,748 ERROR [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10312: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236., hostname=jenkins-hbase4.apache.org,37469,1711288552789, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:200) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-24 13:56:23,005 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:56:23,005 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-24 13:56:23,005 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711302959640 bypass), TestNs=QuotaState(ts=1711302959640 bypass)} 2024-03-24 13:56:23,005 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1711302959640 bypass), TestNs:TestTable=QuotaState(ts=1711302959640 bypass)} 2024-03-24 13:56:23,005 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1711302959640 bypass)} 2024-03-24 13:56:23,005 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711302959640 bypass)} 2024-03-24 13:56:23,256 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:56:23,256 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-24 13:56:23,256 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711302959640 bypass), TestNs=QuotaState(ts=1711302959640 bypass)} 2024-03-24 13:56:23,256 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1711302959640 bypass), TestQuotaAdmin2=QuotaState(ts=1711302959640 bypass), TestQuotaAdmin1=QuotaState(ts=1711302959640 bypass)} 2024-03-24 13:56:23,256 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1711302959640 bypass)} 2024-03-24 13:56:23,256 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711302959640 bypass)} 2024-03-24 13:56:23,270 INFO [Listener at localhost/40227] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=290 (was 290), OpenFileDescriptor=599 (was 603), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=147 (was 170), ProcessCount=168 (was 168), AvailableMemoryMB=12381 (was 12469) 2024-03-24 13:56:23,283 INFO [Listener at localhost/40227] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=290, OpenFileDescriptor=599, MaxFileDescriptor=60000, SystemLoadAverage=147, ProcessCount=168, AvailableMemoryMB=12381 2024-03-24 13:56:23,547 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:56:23,547 INFO [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-03-24 13:56:23,798 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-24 13:56:23,799 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711306559740 bypass), TestNs=QuotaState(ts=1711306559740 bypass)} 2024-03-24 13:56:23,800 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1711306559740 bypass), TestNs:TestTable=QuotaState(ts=1711306559740 bypass)} 2024-03-24 13:56:23,800 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1711306559740 global-limiter)} 2024-03-24 13:56:23,800 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711306559740 bypass)} 2024-03-24 13:56:24,050 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:56:24,051 INFO [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-03-24 13:56:24,301 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-24 13:56:24,302 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711306559840 bypass), TestNs=QuotaState(ts=1711306559840 bypass)} 2024-03-24 13:56:24,303 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1711306559840 bypass), TestQuotaAdmin2=QuotaState(ts=1711306559840 bypass), TestQuotaAdmin1=QuotaState(ts=1711306559840 bypass)} 2024-03-24 13:56:24,303 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1711306559840 global-limiter)} 2024-03-24 13:56:24,303 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711306559840 bypass)} 2024-03-24 13:56:24,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:24,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 163 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:56920 deadline: 1711288594319, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:24,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:24,575 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 165 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:56920 deadline: 1711288594320, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:25,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:25,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 167 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:56920 deadline: 1711288594320, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:25,838 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:25,839 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 169 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:56920 deadline: 1711288594319, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:27,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:27,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 171 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:56920 deadline: 1711288594319, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:29,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:29,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 173 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:56920 deadline: 1711288594319, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:29,617 ERROR [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10311: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236., hostname=jenkins-hbase4.apache.org,37469,1711288552789, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:178) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-24 13:56:29,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-24 13:56:29,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 177 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:56920 deadline: 1711288599625, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-24 13:56:29,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-24 13:56:29,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 179 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:56920 deadline: 1711288599624, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-24 13:56:30,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-24 13:56:30,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 181 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:56920 deadline: 1711288599625, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-24 13:56:31,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-24 13:56:31,147 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 183 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:56920 deadline: 1711288599624, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-24 13:56:32,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-24 13:56:32,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 185 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:56920 deadline: 1711288599624, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-24 13:56:34,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-03-24 13:56:34,929 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 187 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:56920 deadline: 1711288599624, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-03-24 13:56:34,930 ERROR [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=3 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10310: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-3' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236., hostname=jenkins-hbase4.apache.org,37469,1711288552789, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-24 13:56:35,187 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:56:35,187 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-24 13:56:35,187 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711310159840 bypass), TestNs=QuotaState(ts=1711310159840 bypass)} 2024-03-24 13:56:35,187 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1711310159840 bypass), TestNs:TestTable=QuotaState(ts=1711310159840 bypass)} 2024-03-24 13:56:35,187 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1711310159840 bypass)} 2024-03-24 13:56:35,188 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711310159840 bypass)} 2024-03-24 13:56:35,438 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:56:35,438 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-24 13:56:35,438 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711310159840 bypass), TestNs=QuotaState(ts=1711310159840 bypass)} 2024-03-24 13:56:35,439 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1711310159840 bypass), TestQuotaAdmin2=QuotaState(ts=1711310159840 bypass), TestQuotaAdmin1=QuotaState(ts=1711310159840 bypass)} 2024-03-24 13:56:35,439 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1711310159840 bypass)} 2024-03-24 13:56:35,439 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711310159840 bypass)} 2024-03-24 13:56:35,455 INFO [Listener at localhost/40227] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=281 (was 290), OpenFileDescriptor=597 (was 599), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=165 (was 147) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=12356 (was 12381) 2024-03-24 13:56:35,471 INFO [Listener at localhost/40227] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=281, OpenFileDescriptor=597, MaxFileDescriptor=60000, SystemLoadAverage=165, ProcessCount=168, AvailableMemoryMB=12355 2024-03-24 13:56:35,728 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:56:35,729 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-24 13:56:35,730 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711313759840 bypass), TestNs=QuotaState(ts=1711313759840 bypass)} 2024-03-24 13:56:35,732 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1711313759840 bypass), TestNs:TestTable=QuotaState(ts=1711313759840 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000)))} 2024-03-24 13:56:35,732 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-24 13:56:35,732 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711313759840 bypass)} 2024-03-24 13:56:35,983 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:56:35,985 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-24 13:56:35,985 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711313759840 bypass), TestNs=QuotaState(ts=1711313759840 bypass)} 2024-03-24 13:56:35,985 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1711313759840 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin2=QuotaState(ts=1711313759840 bypass), TestQuotaAdmin1=QuotaState(ts=1711313759840 bypass)} 2024-03-24 13:56:35,985 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-24 13:56:35,985 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711313759840 bypass)} 2024-03-24 13:56:36,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:36,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] ipc.CallRunner(144): callId: 202 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:33656 deadline: 1711288606003, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:36,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:36,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] ipc.CallRunner(144): callId: 204 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:33656 deadline: 1711288606003, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:36,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:36,766 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] ipc.CallRunner(144): callId: 206 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:33656 deadline: 1711288606003, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:37,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:37,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] ipc.CallRunner(144): callId: 208 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:33656 deadline: 1711288606003, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:38,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:38,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] ipc.CallRunner(144): callId: 210 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:33656 deadline: 1711288606003, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:41,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:41,305 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] ipc.CallRunner(144): callId: 212 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:33656 deadline: 1711288606002, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:41,305 ERROR [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10316: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1711288558589.90551395faf793aa1bfdf13f276d118b., hostname=jenkins-hbase4.apache.org,40925,1711288552834, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-24 13:56:41,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:41,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] ipc.CallRunner(144): callId: 213 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:33656 deadline: 1711288611307, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:41,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:41,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] ipc.CallRunner(144): callId: 215 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:33656 deadline: 1711288611306, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:42,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:42,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] ipc.CallRunner(144): callId: 217 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:33656 deadline: 1711288611306, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:42,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:42,828 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] ipc.CallRunner(144): callId: 219 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:33656 deadline: 1711288611306, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:44,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:44,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] ipc.CallRunner(144): callId: 221 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:33656 deadline: 1711288611306, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:46,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:46,599 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40925] ipc.CallRunner(144): callId: 223 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:33656 deadline: 1711288611306, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-03-24 13:56:46,600 ERROR [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10329: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1711288558589.90551395faf793aa1bfdf13f276d118b., hostname=jenkins-hbase4.apache.org,40925,1711288552834, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-24 13:56:46,857 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:56:46,858 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-24 13:56:46,858 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711317359840 bypass), TestNs=QuotaState(ts=1711317359840 bypass)} 2024-03-24 13:56:46,858 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1711317359840 bypass), TestNs:TestTable=QuotaState(ts=1711317359840 bypass)} 2024-03-24 13:56:46,858 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-24 13:56:46,858 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711317359840 bypass)} 2024-03-24 13:56:47,108 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:56:47,108 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-24 13:56:47,108 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711317359840 bypass), TestNs=QuotaState(ts=1711317359840 bypass)} 2024-03-24 13:56:47,108 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1711317359840 bypass), TestQuotaAdmin2=QuotaState(ts=1711317359840 bypass), TestQuotaAdmin1=QuotaState(ts=1711317359840 bypass)} 2024-03-24 13:56:47,108 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1711317359840 bypass)} 2024-03-24 13:56:47,108 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711317359840 bypass)} 2024-03-24 13:56:47,122 INFO [Listener at localhost/40227] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=281 (was 281), OpenFileDescriptor=597 (was 597), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=202 (was 165) - SystemLoadAverage LEAK? -, ProcessCount=168 (was 168), AvailableMemoryMB=12352 (was 12355) 2024-03-24 13:56:47,137 INFO [Listener at localhost/40227] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=281, OpenFileDescriptor=597, MaxFileDescriptor=60000, SystemLoadAverage=202, ProcessCount=168, AvailableMemoryMB=12352 2024-03-24 13:56:47,399 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:56:47,399 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-24 13:56:47,400 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711320959840 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1711320959840 bypass)} 2024-03-24 13:56:47,400 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1711320959840 bypass), TestNs:TestTable=QuotaState(ts=1711320959840 bypass)} 2024-03-24 13:56:47,400 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-24 13:56:47,400 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711320959840 bypass)} 2024-03-24 13:56:47,651 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:56:47,651 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-24 13:56:47,652 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711320959840 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1711320959840 bypass)} 2024-03-24 13:56:47,652 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1711320959840 bypass), TestQuotaAdmin2=QuotaState(ts=1711320959840 bypass), TestQuotaAdmin1=QuotaState(ts=1711320959840 bypass)} 2024-03-24 13:56:47,652 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-24 13:56:47,652 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711320959840 bypass)} 2024-03-24 13:56:47,671 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-24 13:56:47,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 235 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:56920 deadline: 1711288617671, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-24 13:56:47,927 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-24 13:56:47,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 237 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:56920 deadline: 1711288617671, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-24 13:56:48,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-24 13:56:48,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 239 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:56920 deadline: 1711288617671, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-24 13:56:49,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-24 13:56:49,190 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 241 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:56920 deadline: 1711288617672, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-24 13:56:50,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-24 13:56:50,456 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 243 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:56920 deadline: 1711288617672, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-24 13:56:52,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-03-24 13:56:52,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 245 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:56920 deadline: 1711288617672, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-03-24 13:56:52,970 ERROR [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10312: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236., hostname=jenkins-hbase4.apache.org,37469,1711288552789, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:128) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-24 13:56:52,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:52,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 252 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:56920 deadline: 1711288622979, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:53,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:53,233 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 254 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:56920 deadline: 1711288622980, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:53,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:53,741 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 256 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:56920 deadline: 1711288622980, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:54,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:54,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 258 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:56920 deadline: 1711288622979, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:55,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:55,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 260 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:56920 deadline: 1711288622979, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:58,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:58,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=37469] ipc.CallRunner(144): callId: 262 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:56920 deadline: 1711288622979, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-03-24 13:56:58,289 ERROR [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10347: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236., hostname=jenkins-hbase4.apache.org,37469,1711288552789, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-03-24 13:56:58,548 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:56:58,548 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-24 13:56:58,548 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711324559840 bypass), TestNs=QuotaState(ts=1711324559840 bypass)} 2024-03-24 13:56:58,548 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1711324559840 bypass), TestNs:TestTable=QuotaState(ts=1711324559840 bypass)} 2024-03-24 13:56:58,548 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1711324559840 bypass)} 2024-03-24 13:56:58,548 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711324559840 bypass)} 2024-03-24 13:56:58,799 INFO [Listener at localhost/40227] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-03-24 13:56:58,799 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-03-24 13:56:58,799 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1711324559840 bypass), TestNs=QuotaState(ts=1711324559840 bypass)} 2024-03-24 13:56:58,799 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1711324559840 bypass), TestQuotaAdmin2=QuotaState(ts=1711324559840 bypass), TestQuotaAdmin1=QuotaState(ts=1711324559840 bypass)} 2024-03-24 13:56:58,799 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(218): {} 2024-03-24 13:56:58,799 DEBUG [Listener at localhost/40227] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1711324559840 bypass)} 2024-03-24 13:56:58,816 INFO [Listener at localhost/40227] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=266 (was 281), OpenFileDescriptor=585 (was 597), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=185 (was 202), ProcessCount=168 (was 168), AvailableMemoryMB=12293 (was 12352) 2024-03-24 13:56:58,820 INFO [Listener at localhost/40227] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin0 2024-03-24 13:56:58,827 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin0 2024-03-24 13:56:58,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] procedure2.ProcedureExecutor(1075): Stored pid=27, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin0 2024-03-24 13:56:58,839 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711288618839"}]},"ts":"1711288618839"} 2024-03-24 13:56:58,840 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-03-24 13:56:58,841 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLING in hbase:meta 2024-03-24 13:56:58,844 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set TestQuotaAdmin0 to state=DISABLING 2024-03-24 13:56:58,845 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=03a04f79647c5a68a3316b37bac8c236, UNASSIGN}] 2024-03-24 13:56:58,846 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=03a04f79647c5a68a3316b37bac8c236, UNASSIGN 2024-03-24 13:56:58,847 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=03a04f79647c5a68a3316b37bac8c236, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37469,1711288552789 2024-03-24 13:56:58,847 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711288618847"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1711288618847"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1711288618847"}]},"ts":"1711288618847"} 2024-03-24 13:56:58,850 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure 03a04f79647c5a68a3316b37bac8c236, server=jenkins-hbase4.apache.org,37469,1711288552789}] 2024-03-24 13:56:58,975 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase4.apache.org,37469,1711288552789, timeout=1711288619006, delay=31, operations=[pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure 03a04f79647c5a68a3316b37bac8c236, server=jenkins-hbase4.apache.org,37469,1711288552789]] 2024-03-24 13:56:59,008 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37469,1711288552789 2024-03-24 13:56:59,010 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 03a04f79647c5a68a3316b37bac8c236 2024-03-24 13:56:59,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 03a04f79647c5a68a3316b37bac8c236, disabling compactions & flushes 2024-03-24 13:56:59,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236. 2024-03-24 13:56:59,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236. 2024-03-24 13:56:59,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236. after waiting 0 ms 2024-03-24 13:56:59,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236. 2024-03-24 13:56:59,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 03a04f79647c5a68a3316b37bac8c236 1/1 column families, dataSize=578 B heapSize=2.11 KB 2024-03-24 13:56:59,086 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=578 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/default/TestQuotaAdmin0/03a04f79647c5a68a3316b37bac8c236/.tmp/cf/f00b1e69428949dc82881c62468fc223 2024-03-24 13:56:59,091 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-03-24 13:56:59,131 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/default/TestQuotaAdmin0/03a04f79647c5a68a3316b37bac8c236/.tmp/cf/f00b1e69428949dc82881c62468fc223 as hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/default/TestQuotaAdmin0/03a04f79647c5a68a3316b37bac8c236/cf/f00b1e69428949dc82881c62468fc223 2024-03-24 13:56:59,142 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/default/TestQuotaAdmin0/03a04f79647c5a68a3316b37bac8c236/cf/f00b1e69428949dc82881c62468fc223, entries=6, sequenceid=21, filesize=4.7 K 2024-03-24 13:56:59,144 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~578 B/578, heapSize ~2.09 KB/2144, currentSize=0 B/0 for 03a04f79647c5a68a3316b37bac8c236 in 132ms, sequenceid=21, compaction requested=false 2024-03-24 13:56:59,152 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/default/TestQuotaAdmin0/03a04f79647c5a68a3316b37bac8c236/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2024-03-24 13:56:59,154 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236. 2024-03-24 13:56:59,154 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 03a04f79647c5a68a3316b37bac8c236: 2024-03-24 13:56:59,156 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 03a04f79647c5a68a3316b37bac8c236 2024-03-24 13:56:59,156 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=03a04f79647c5a68a3316b37bac8c236, regionState=CLOSED 2024-03-24 13:56:59,156 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711288619156"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1711288619156"}]},"ts":"1711288619156"} 2024-03-24 13:56:59,160 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=29, resume processing ppid=28 2024-03-24 13:56:59,160 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=29, ppid=28, state=SUCCESS; CloseRegionProcedure 03a04f79647c5a68a3316b37bac8c236, server=jenkins-hbase4.apache.org,37469,1711288552789 in 308 msec 2024-03-24 13:56:59,162 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=28, resume processing ppid=27 2024-03-24 13:56:59,162 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=03a04f79647c5a68a3316b37bac8c236, UNASSIGN in 315 msec 2024-03-24 13:56:59,163 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711288619163"}]},"ts":"1711288619163"} 2024-03-24 13:56:59,164 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLED in hbase:meta 2024-03-24 13:56:59,167 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set TestQuotaAdmin0 to state=DISABLED 2024-03-24 13:56:59,169 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=27, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin0 in 339 msec 2024-03-24 13:56:59,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-03-24 13:56:59,593 INFO [Listener at localhost/40227] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin0, procId: 27 completed 2024-03-24 13:56:59,598 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin0 2024-03-24 13:56:59,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] procedure2.ProcedureExecutor(1075): Stored pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-24 13:56:59,607 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-24 13:56:59,609 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=30, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-24 13:56:59,613 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-03-24 13:56:59,615 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/default/TestQuotaAdmin0/03a04f79647c5a68a3316b37bac8c236 2024-03-24 13:56:59,620 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/default/TestQuotaAdmin0/03a04f79647c5a68a3316b37bac8c236/cf, FileablePath, hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/default/TestQuotaAdmin0/03a04f79647c5a68a3316b37bac8c236/recovered.edits] 2024-03-24 13:56:59,631 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/default/TestQuotaAdmin0/03a04f79647c5a68a3316b37bac8c236/cf/f00b1e69428949dc82881c62468fc223 to hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/archive/data/default/TestQuotaAdmin0/03a04f79647c5a68a3316b37bac8c236/cf/f00b1e69428949dc82881c62468fc223 2024-03-24 13:56:59,637 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/default/TestQuotaAdmin0/03a04f79647c5a68a3316b37bac8c236/recovered.edits/24.seqid to hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/archive/data/default/TestQuotaAdmin0/03a04f79647c5a68a3316b37bac8c236/recovered.edits/24.seqid 2024-03-24 13:56:59,638 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/default/TestQuotaAdmin0/03a04f79647c5a68a3316b37bac8c236 2024-03-24 13:56:59,638 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-03-24 13:56:59,642 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=30, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-24 13:56:59,665 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin0 from hbase:meta 2024-03-24 13:56:59,668 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin0' descriptor. 2024-03-24 13:56:59,671 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=30, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-24 13:56:59,671 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin0' from region states. 2024-03-24 13:56:59,671 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1711288619671"}]},"ts":"9223372036854775807"} 2024-03-24 13:56:59,674 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-03-24 13:56:59,674 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 03a04f79647c5a68a3316b37bac8c236, NAME => 'TestQuotaAdmin0,,1711288555964.03a04f79647c5a68a3316b37bac8c236.', STARTKEY => '', ENDKEY => ''}] 2024-03-24 13:56:59,674 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin0' as deleted. 2024-03-24 13:56:59,674 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1711288619674"}]},"ts":"9223372036854775807"} 2024-03-24 13:56:59,677 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin0 state from META 2024-03-24 13:56:59,680 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=30, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-03-24 13:56:59,682 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=30, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin0 in 81 msec 2024-03-24 13:56:59,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-03-24 13:56:59,864 INFO [Listener at localhost/40227] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin0, procId: 30 completed 2024-03-24 13:56:59,865 INFO [Listener at localhost/40227] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin1 2024-03-24 13:56:59,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin1 2024-03-24 13:56:59,867 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] procedure2.ProcedureExecutor(1075): Stored pid=31, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin1 2024-03-24 13:56:59,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-03-24 13:56:59,870 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711288619870"}]},"ts":"1711288619870"} 2024-03-24 13:56:59,872 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLING in hbase:meta 2024-03-24 13:56:59,874 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set TestQuotaAdmin1 to state=DISABLING 2024-03-24 13:56:59,875 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=9fc643d2444abca3fa1637d13306e4d0, UNASSIGN}] 2024-03-24 13:56:59,876 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=9fc643d2444abca3fa1637d13306e4d0, UNASSIGN 2024-03-24 13:56:59,877 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=9fc643d2444abca3fa1637d13306e4d0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40925,1711288552834 2024-03-24 13:56:59,878 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1711288556765.9fc643d2444abca3fa1637d13306e4d0.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711288619877"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1711288619877"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1711288619877"}]},"ts":"1711288619877"} 2024-03-24 13:56:59,879 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=33, ppid=32, state=RUNNABLE; CloseRegionProcedure 9fc643d2444abca3fa1637d13306e4d0, server=jenkins-hbase4.apache.org,40925,1711288552834}] 2024-03-24 13:57:00,032 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40925,1711288552834 2024-03-24 13:57:00,033 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9fc643d2444abca3fa1637d13306e4d0 2024-03-24 13:57:00,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9fc643d2444abca3fa1637d13306e4d0, disabling compactions & flushes 2024-03-24 13:57:00,034 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1711288556765.9fc643d2444abca3fa1637d13306e4d0. 2024-03-24 13:57:00,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1711288556765.9fc643d2444abca3fa1637d13306e4d0. 2024-03-24 13:57:00,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1711288556765.9fc643d2444abca3fa1637d13306e4d0. after waiting 0 ms 2024-03-24 13:57:00,034 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1711288556765.9fc643d2444abca3fa1637d13306e4d0. 2024-03-24 13:57:00,050 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/default/TestQuotaAdmin1/9fc643d2444abca3fa1637d13306e4d0/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-03-24 13:57:00,052 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1711288556765.9fc643d2444abca3fa1637d13306e4d0. 2024-03-24 13:57:00,052 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9fc643d2444abca3fa1637d13306e4d0: 2024-03-24 13:57:00,058 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9fc643d2444abca3fa1637d13306e4d0 2024-03-24 13:57:00,059 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=9fc643d2444abca3fa1637d13306e4d0, regionState=CLOSED 2024-03-24 13:57:00,059 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1711288556765.9fc643d2444abca3fa1637d13306e4d0.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711288620059"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1711288620059"}]},"ts":"1711288620059"} 2024-03-24 13:57:00,063 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=33, resume processing ppid=32 2024-03-24 13:57:00,063 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=33, ppid=32, state=SUCCESS; CloseRegionProcedure 9fc643d2444abca3fa1637d13306e4d0, server=jenkins-hbase4.apache.org,40925,1711288552834 in 182 msec 2024-03-24 13:57:00,066 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=32, resume processing ppid=31 2024-03-24 13:57:00,066 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=32, ppid=31, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=9fc643d2444abca3fa1637d13306e4d0, UNASSIGN in 188 msec 2024-03-24 13:57:00,067 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711288620066"}]},"ts":"1711288620066"} 2024-03-24 13:57:00,068 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLED in hbase:meta 2024-03-24 13:57:00,071 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set TestQuotaAdmin1 to state=DISABLED 2024-03-24 13:57:00,073 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=31, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin1 in 206 msec 2024-03-24 13:57:00,121 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-03-24 13:57:00,121 INFO [Listener at localhost/40227] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin1, procId: 31 completed 2024-03-24 13:57:00,122 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin1 2024-03-24 13:57:00,123 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] procedure2.ProcedureExecutor(1075): Stored pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-24 13:57:00,125 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-24 13:57:00,126 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=34, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-24 13:57:00,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-03-24 13:57:00,131 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/default/TestQuotaAdmin1/9fc643d2444abca3fa1637d13306e4d0 2024-03-24 13:57:00,134 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/default/TestQuotaAdmin1/9fc643d2444abca3fa1637d13306e4d0/cf, FileablePath, hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/default/TestQuotaAdmin1/9fc643d2444abca3fa1637d13306e4d0/recovered.edits] 2024-03-24 13:57:00,143 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/default/TestQuotaAdmin1/9fc643d2444abca3fa1637d13306e4d0/recovered.edits/4.seqid to hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/archive/data/default/TestQuotaAdmin1/9fc643d2444abca3fa1637d13306e4d0/recovered.edits/4.seqid 2024-03-24 13:57:00,144 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/default/TestQuotaAdmin1/9fc643d2444abca3fa1637d13306e4d0 2024-03-24 13:57:00,144 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-03-24 13:57:00,147 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=34, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-24 13:57:00,150 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin1 from hbase:meta 2024-03-24 13:57:00,152 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin1' descriptor. 2024-03-24 13:57:00,153 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=34, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-24 13:57:00,153 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin1' from region states. 2024-03-24 13:57:00,153 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1,,1711288556765.9fc643d2444abca3fa1637d13306e4d0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1711288620153"}]},"ts":"9223372036854775807"} 2024-03-24 13:57:00,155 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-03-24 13:57:00,155 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9fc643d2444abca3fa1637d13306e4d0, NAME => 'TestQuotaAdmin1,,1711288556765.9fc643d2444abca3fa1637d13306e4d0.', STARTKEY => '', ENDKEY => ''}] 2024-03-24 13:57:00,155 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin1' as deleted. 2024-03-24 13:57:00,155 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1711288620155"}]},"ts":"9223372036854775807"} 2024-03-24 13:57:00,157 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin1 state from META 2024-03-24 13:57:00,160 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=34, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-03-24 13:57:00,161 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=34, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin1 in 38 msec 2024-03-24 13:57:00,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-03-24 13:57:00,380 INFO [Listener at localhost/40227] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin1, procId: 34 completed 2024-03-24 13:57:00,380 INFO [Listener at localhost/40227] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin2 2024-03-24 13:57:00,381 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin2 2024-03-24 13:57:00,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] procedure2.ProcedureExecutor(1075): Stored pid=35, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin2 2024-03-24 13:57:00,385 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-03-24 13:57:00,386 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711288620385"}]},"ts":"1711288620385"} 2024-03-24 13:57:00,387 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLING in hbase:meta 2024-03-24 13:57:00,390 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set TestQuotaAdmin2 to state=DISABLING 2024-03-24 13:57:00,391 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=9184ea00d554227e9de8e52f4c2de283, UNASSIGN}] 2024-03-24 13:57:00,392 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=9184ea00d554227e9de8e52f4c2de283, UNASSIGN 2024-03-24 13:57:00,393 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=9184ea00d554227e9de8e52f4c2de283, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40925,1711288552834 2024-03-24 13:57:00,393 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1711288557546.9184ea00d554227e9de8e52f4c2de283.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711288620393"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1711288620393"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1711288620393"}]},"ts":"1711288620393"} 2024-03-24 13:57:00,394 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; CloseRegionProcedure 9184ea00d554227e9de8e52f4c2de283, server=jenkins-hbase4.apache.org,40925,1711288552834}] 2024-03-24 13:57:00,546 DEBUG [RSProcedureDispatcher-pool-5] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40925,1711288552834 2024-03-24 13:57:00,547 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 9184ea00d554227e9de8e52f4c2de283 2024-03-24 13:57:00,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 9184ea00d554227e9de8e52f4c2de283, disabling compactions & flushes 2024-03-24 13:57:00,548 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1711288557546.9184ea00d554227e9de8e52f4c2de283. 2024-03-24 13:57:00,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1711288557546.9184ea00d554227e9de8e52f4c2de283. 2024-03-24 13:57:00,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1711288557546.9184ea00d554227e9de8e52f4c2de283. after waiting 0 ms 2024-03-24 13:57:00,548 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1711288557546.9184ea00d554227e9de8e52f4c2de283. 2024-03-24 13:57:00,553 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/default/TestQuotaAdmin2/9184ea00d554227e9de8e52f4c2de283/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-03-24 13:57:00,554 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1711288557546.9184ea00d554227e9de8e52f4c2de283. 2024-03-24 13:57:00,554 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 9184ea00d554227e9de8e52f4c2de283: 2024-03-24 13:57:00,556 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 9184ea00d554227e9de8e52f4c2de283 2024-03-24 13:57:00,557 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=9184ea00d554227e9de8e52f4c2de283, regionState=CLOSED 2024-03-24 13:57:00,557 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1711288557546.9184ea00d554227e9de8e52f4c2de283.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1711288620557"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1711288620557"}]},"ts":"1711288620557"} 2024-03-24 13:57:00,561 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=37, resume processing ppid=36 2024-03-24 13:57:00,561 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=37, ppid=36, state=SUCCESS; CloseRegionProcedure 9184ea00d554227e9de8e52f4c2de283, server=jenkins-hbase4.apache.org,40925,1711288552834 in 165 msec 2024-03-24 13:57:00,563 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=36, resume processing ppid=35 2024-03-24 13:57:00,563 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=9184ea00d554227e9de8e52f4c2de283, UNASSIGN in 170 msec 2024-03-24 13:57:00,564 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711288620564"}]},"ts":"1711288620564"} 2024-03-24 13:57:00,565 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLED in hbase:meta 2024-03-24 13:57:00,568 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set TestQuotaAdmin2 to state=DISABLED 2024-03-24 13:57:00,570 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=35, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin2 in 187 msec 2024-03-24 13:57:00,636 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-03-24 13:57:00,636 INFO [Listener at localhost/40227] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin2, procId: 35 completed 2024-03-24 13:57:00,637 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin2 2024-03-24 13:57:00,638 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] procedure2.ProcedureExecutor(1075): Stored pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-24 13:57:00,640 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-24 13:57:00,641 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=38, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-24 13:57:00,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-03-24 13:57:00,646 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/default/TestQuotaAdmin2/9184ea00d554227e9de8e52f4c2de283 2024-03-24 13:57:00,649 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/default/TestQuotaAdmin2/9184ea00d554227e9de8e52f4c2de283/cf, FileablePath, hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/default/TestQuotaAdmin2/9184ea00d554227e9de8e52f4c2de283/recovered.edits] 2024-03-24 13:57:00,657 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/default/TestQuotaAdmin2/9184ea00d554227e9de8e52f4c2de283/recovered.edits/4.seqid to hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/archive/data/default/TestQuotaAdmin2/9184ea00d554227e9de8e52f4c2de283/recovered.edits/4.seqid 2024-03-24 13:57:00,658 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/default/TestQuotaAdmin2/9184ea00d554227e9de8e52f4c2de283 2024-03-24 13:57:00,658 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-03-24 13:57:00,662 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=38, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-24 13:57:00,663 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin2 from hbase:meta 2024-03-24 13:57:00,665 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin2' descriptor. 2024-03-24 13:57:00,666 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=38, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-24 13:57:00,666 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin2' from region states. 2024-03-24 13:57:00,666 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2,,1711288557546.9184ea00d554227e9de8e52f4c2de283.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1711288620666"}]},"ts":"9223372036854775807"} 2024-03-24 13:57:00,668 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-03-24 13:57:00,668 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 9184ea00d554227e9de8e52f4c2de283, NAME => 'TestQuotaAdmin2,,1711288557546.9184ea00d554227e9de8e52f4c2de283.', STARTKEY => '', ENDKEY => ''}] 2024-03-24 13:57:00,668 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin2' as deleted. 2024-03-24 13:57:00,668 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1711288620668"}]},"ts":"9223372036854775807"} 2024-03-24 13:57:00,670 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin2 state from META 2024-03-24 13:57:00,672 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=38, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-03-24 13:57:00,674 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=38, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin2 in 35 msec 2024-03-24 13:57:00,895 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-03-24 13:57:00,895 INFO [Listener at localhost/40227] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin2, procId: 38 completed 2024-03-24 13:57:00,895 INFO [Listener at localhost/40227] client.HBaseAdmin$15(890): Started disable of TestNs:TestTable 2024-03-24 13:57:00,896 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestNs:TestTable 2024-03-24 13:57:00,897 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] procedure2.ProcedureExecutor(1075): Stored pid=39, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestNs:TestTable 2024-03-24 13:57:00,900 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-03-24 13:57:00,900 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711288620900"}]},"ts":"1711288620900"} 2024-03-24 13:57:00,902 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLING in hbase:meta 2024-03-24 13:57:00,904 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set TestNs:TestTable to state=DISABLING 2024-03-24 13:57:00,905 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=b43be9749aa878274456e84b0f6330f0, UNASSIGN}, {pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=90551395faf793aa1bfdf13f276d118b, UNASSIGN}] 2024-03-24 13:57:00,906 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=b43be9749aa878274456e84b0f6330f0, UNASSIGN 2024-03-24 13:57:00,906 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=90551395faf793aa1bfdf13f276d118b, UNASSIGN 2024-03-24 13:57:00,906 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=b43be9749aa878274456e84b0f6330f0, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,37469,1711288552789 2024-03-24 13:57:00,907 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=90551395faf793aa1bfdf13f276d118b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40925,1711288552834 2024-03-24 13:57:00,907 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1711288558589.b43be9749aa878274456e84b0f6330f0.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1711288620906"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1711288620906"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1711288620906"}]},"ts":"1711288620906"} 2024-03-24 13:57:00,907 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1711288558589.90551395faf793aa1bfdf13f276d118b.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1711288620906"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1711288620906"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1711288620906"}]},"ts":"1711288620906"} 2024-03-24 13:57:00,908 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=42, ppid=40, state=RUNNABLE; CloseRegionProcedure b43be9749aa878274456e84b0f6330f0, server=jenkins-hbase4.apache.org,37469,1711288552789}] 2024-03-24 13:57:00,909 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=43, ppid=41, state=RUNNABLE; CloseRegionProcedure 90551395faf793aa1bfdf13f276d118b, server=jenkins-hbase4.apache.org,40925,1711288552834}] 2024-03-24 13:57:01,060 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,37469,1711288552789 2024-03-24 13:57:01,061 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close b43be9749aa878274456e84b0f6330f0 2024-03-24 13:57:01,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing b43be9749aa878274456e84b0f6330f0, disabling compactions & flushes 2024-03-24 13:57:01,062 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1711288558589.b43be9749aa878274456e84b0f6330f0. 2024-03-24 13:57:01,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1711288558589.b43be9749aa878274456e84b0f6330f0. 2024-03-24 13:57:01,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1711288558589.b43be9749aa878274456e84b0f6330f0. after waiting 0 ms 2024-03-24 13:57:01,062 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1711288558589.b43be9749aa878274456e84b0f6330f0. 2024-03-24 13:57:01,062 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40925,1711288552834 2024-03-24 13:57:01,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 90551395faf793aa1bfdf13f276d118b 2024-03-24 13:57:01,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 90551395faf793aa1bfdf13f276d118b, disabling compactions & flushes 2024-03-24 13:57:01,063 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1711288558589.90551395faf793aa1bfdf13f276d118b. 2024-03-24 13:57:01,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1711288558589.90551395faf793aa1bfdf13f276d118b. 2024-03-24 13:57:01,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1711288558589.90551395faf793aa1bfdf13f276d118b. after waiting 0 ms 2024-03-24 13:57:01,063 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1711288558589.90551395faf793aa1bfdf13f276d118b. 2024-03-24 13:57:01,068 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/TestNs/TestTable/b43be9749aa878274456e84b0f6330f0/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-03-24 13:57:01,069 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/TestNs/TestTable/90551395faf793aa1bfdf13f276d118b/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-03-24 13:57:01,070 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1711288558589.b43be9749aa878274456e84b0f6330f0. 2024-03-24 13:57:01,070 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for b43be9749aa878274456e84b0f6330f0: 2024-03-24 13:57:01,072 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed b43be9749aa878274456e84b0f6330f0 2024-03-24 13:57:01,073 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=b43be9749aa878274456e84b0f6330f0, regionState=CLOSED 2024-03-24 13:57:01,073 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,,1711288558589.b43be9749aa878274456e84b0f6330f0.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1711288621073"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1711288621073"}]},"ts":"1711288621073"} 2024-03-24 13:57:01,074 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1711288558589.90551395faf793aa1bfdf13f276d118b. 2024-03-24 13:57:01,074 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 90551395faf793aa1bfdf13f276d118b: 2024-03-24 13:57:01,076 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 90551395faf793aa1bfdf13f276d118b 2024-03-24 13:57:01,076 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=90551395faf793aa1bfdf13f276d118b, regionState=CLOSED 2024-03-24 13:57:01,076 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1711288558589.90551395faf793aa1bfdf13f276d118b.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1711288621076"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1711288621076"}]},"ts":"1711288621076"} 2024-03-24 13:57:01,079 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=42, resume processing ppid=40 2024-03-24 13:57:01,079 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=42, ppid=40, state=SUCCESS; CloseRegionProcedure b43be9749aa878274456e84b0f6330f0, server=jenkins-hbase4.apache.org,37469,1711288552789 in 168 msec 2024-03-24 13:57:01,081 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=43, resume processing ppid=41 2024-03-24 13:57:01,081 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=43, ppid=41, state=SUCCESS; CloseRegionProcedure 90551395faf793aa1bfdf13f276d118b, server=jenkins-hbase4.apache.org,40925,1711288552834 in 169 msec 2024-03-24 13:57:01,081 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=b43be9749aa878274456e84b0f6330f0, UNASSIGN in 174 msec 2024-03-24 13:57:01,083 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=41, resume processing ppid=39 2024-03-24 13:57:01,083 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=41, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=90551395faf793aa1bfdf13f276d118b, UNASSIGN in 176 msec 2024-03-24 13:57:01,084 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1711288621084"}]},"ts":"1711288621084"} 2024-03-24 13:57:01,085 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLED in hbase:meta 2024-03-24 13:57:01,087 INFO [PEWorker-4] procedure.DisableTableProcedure(305): Set TestNs:TestTable to state=DISABLED 2024-03-24 13:57:01,090 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=39, state=SUCCESS; DisableTableProcedure table=TestNs:TestTable in 192 msec 2024-03-24 13:57:01,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-03-24 13:57:01,152 INFO [Listener at localhost/40227] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: TestNs:TestTable, procId: 39 completed 2024-03-24 13:57:01,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestNs:TestTable 2024-03-24 13:57:01,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] procedure2.ProcedureExecutor(1075): Stored pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestNs:TestTable 2024-03-24 13:57:01,156 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-24 13:57:01,157 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=44, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-24 13:57:01,159 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-03-24 13:57:01,164 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/TestNs/TestTable/b43be9749aa878274456e84b0f6330f0 2024-03-24 13:57:01,164 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/TestNs/TestTable/90551395faf793aa1bfdf13f276d118b 2024-03-24 13:57:01,166 DEBUG [HFileArchiver-11] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/TestNs/TestTable/b43be9749aa878274456e84b0f6330f0/cf, FileablePath, hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/TestNs/TestTable/b43be9749aa878274456e84b0f6330f0/recovered.edits] 2024-03-24 13:57:01,167 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/TestNs/TestTable/90551395faf793aa1bfdf13f276d118b/cf, FileablePath, hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/TestNs/TestTable/90551395faf793aa1bfdf13f276d118b/recovered.edits] 2024-03-24 13:57:01,175 DEBUG [HFileArchiver-11] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/TestNs/TestTable/b43be9749aa878274456e84b0f6330f0/recovered.edits/4.seqid to hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/archive/data/TestNs/TestTable/b43be9749aa878274456e84b0f6330f0/recovered.edits/4.seqid 2024-03-24 13:57:01,175 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/TestNs/TestTable/90551395faf793aa1bfdf13f276d118b/recovered.edits/4.seqid to hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/archive/data/TestNs/TestTable/90551395faf793aa1bfdf13f276d118b/recovered.edits/4.seqid 2024-03-24 13:57:01,176 DEBUG [HFileArchiver-11] backup.HFileArchiver(596): Deleted hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/TestNs/TestTable/b43be9749aa878274456e84b0f6330f0 2024-03-24 13:57:01,176 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/.tmp/data/TestNs/TestTable/90551395faf793aa1bfdf13f276d118b 2024-03-24 13:57:01,176 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-03-24 13:57:01,179 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=44, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-24 13:57:01,181 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of TestNs:TestTable from hbase:meta 2024-03-24 13:57:01,183 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'TestNs:TestTable' descriptor. 2024-03-24 13:57:01,185 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=44, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-24 13:57:01,185 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'TestNs:TestTable' from region states. 2024-03-24 13:57:01,185 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,,1711288558589.b43be9749aa878274456e84b0f6330f0.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1711288621185"}]},"ts":"9223372036854775807"} 2024-03-24 13:57:01,185 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,1,1711288558589.90551395faf793aa1bfdf13f276d118b.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1711288621185"}]},"ts":"9223372036854775807"} 2024-03-24 13:57:01,187 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2024-03-24 13:57:01,187 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => b43be9749aa878274456e84b0f6330f0, NAME => 'TestNs:TestTable,,1711288558589.b43be9749aa878274456e84b0f6330f0.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => 90551395faf793aa1bfdf13f276d118b, NAME => 'TestNs:TestTable,1,1711288558589.90551395faf793aa1bfdf13f276d118b.', STARTKEY => '1', ENDKEY => ''}] 2024-03-24 13:57:01,187 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'TestNs:TestTable' as deleted. 2024-03-24 13:57:01,187 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1711288621187"}]},"ts":"9223372036854775807"} 2024-03-24 13:57:01,188 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table TestNs:TestTable state from META 2024-03-24 13:57:01,192 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=44, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-03-24 13:57:01,193 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=44, state=SUCCESS; DeleteTableProcedure table=TestNs:TestTable in 39 msec 2024-03-24 13:57:01,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-03-24 13:57:01,411 INFO [Listener at localhost/40227] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: TestNs:TestTable, procId: 44 completed 2024-03-24 13:57:01,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.HMaster$17(3092): Client=jenkins//172.31.14.131 delete TestNs 2024-03-24 13:57:01,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] procedure2.ProcedureExecutor(1075): Stored pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE; DeleteNamespaceProcedure, namespace=TestNs 2024-03-24 13:57:01,424 INFO [PEWorker-1] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-24 13:57:01,427 INFO [PEWorker-1] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_FROM_NS_TABLE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-24 13:57:01,428 INFO [PEWorker-1] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_FROM_ZK, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-24 13:57:01,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-03-24 13:57:01,430 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace/TestNs 2024-03-24 13:57:01,430 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-03-24 13:57:01,431 INFO [PEWorker-1] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_DIRECTORIES, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-24 13:57:01,434 INFO [PEWorker-1] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_NAMESPACE_QUOTA, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-03-24 13:57:01,435 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=45, state=SUCCESS; DeleteNamespaceProcedure, namespace=TestNs in 18 msec 2024-03-24 13:57:01,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43509] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-03-24 13:57:01,681 INFO [Listener at localhost/40227] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2024-03-24 13:57:01,681 INFO [Listener at localhost/40227] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-03-24 13:57:01,681 DEBUG [Listener at localhost/40227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x29ac09dc to 127.0.0.1:62836 2024-03-24 13:57:01,681 DEBUG [Listener at localhost/40227] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-24 13:57:01,682 DEBUG [Listener at localhost/40227] util.JVMClusterUtil(237): Shutting down HBase Cluster 2024-03-24 13:57:01,682 DEBUG [Listener at localhost/40227] util.JVMClusterUtil(257): Found active master hash=65741404, stopped=false 2024-03-24 13:57:01,682 DEBUG [Listener at localhost/40227] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-03-24 13:57:01,683 INFO [Listener at localhost/40227] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,43509,1711288551562 2024-03-24 13:57:01,686 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-03-24 13:57:01,686 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): regionserver:40925-0x100961fcc9b0002, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-03-24 13:57:01,686 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-24 13:57:01,686 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): regionserver:37469-0x100961fcc9b0001, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-03-24 13:57:01,686 INFO [Listener at localhost/40227] procedure2.ProcedureExecutor(675): Stopping 2024-03-24 13:57:01,687 DEBUG [Listener at localhost/40227] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5e53ed1e to 127.0.0.1:62836 2024-03-24 13:57:01,687 DEBUG [Listener at localhost/40227] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-24 13:57:01,687 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40925-0x100961fcc9b0002, quorum=127.0.0.1:62836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-24 13:57:01,687 INFO [Listener at localhost/40227] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,37469,1711288552789' ***** 2024-03-24 13:57:01,687 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:37469-0x100961fcc9b0001, quorum=127.0.0.1:62836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-24 13:57:01,688 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-03-24 13:57:01,687 INFO [Listener at localhost/40227] regionserver.HRegionServer(2313): STOPPED: Shutdown requested 2024-03-24 13:57:01,688 INFO [Listener at localhost/40227] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,40925,1711288552834' ***** 2024-03-24 13:57:01,688 INFO [Listener at localhost/40227] regionserver.HRegionServer(2313): STOPPED: Shutdown requested 2024-03-24 13:57:01,689 INFO [RS:1;jenkins-hbase4:40925] regionserver.HeapMemoryManager(220): Stopping 2024-03-24 13:57:01,689 INFO [RS:1;jenkins-hbase4:40925] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-03-24 13:57:01,689 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-03-24 13:57:01,689 INFO [RS:1;jenkins-hbase4:40925] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-03-24 13:57:01,689 INFO [RS:1;jenkins-hbase4:40925] regionserver.HRegionServer(3307): Received CLOSE for 3b1e4487bef0d3b970e68f23067786d7 2024-03-24 13:57:01,690 INFO [RS:1;jenkins-hbase4:40925] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,40925,1711288552834 2024-03-24 13:57:01,690 INFO [RS:0;jenkins-hbase4:37469] regionserver.HeapMemoryManager(220): Stopping 2024-03-24 13:57:01,690 INFO [RS:1;jenkins-hbase4:40925] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-03-24 13:57:01,691 INFO [RS:0;jenkins-hbase4:37469] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-03-24 13:57:01,691 DEBUG [RS:1;jenkins-hbase4:40925] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x36a2ff63 to 127.0.0.1:62836 2024-03-24 13:57:01,691 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-03-24 13:57:01,691 DEBUG [RS:1;jenkins-hbase4:40925] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-24 13:57:01,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3b1e4487bef0d3b970e68f23067786d7, disabling compactions & flushes 2024-03-24 13:57:01,691 INFO [RS:1;jenkins-hbase4:40925] regionserver.HRegionServer(1477): Waiting on 1 regions to close 2024-03-24 13:57:01,691 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:quota,,1711288555392.3b1e4487bef0d3b970e68f23067786d7. 2024-03-24 13:57:01,691 DEBUG [RS:1;jenkins-hbase4:40925] regionserver.HRegionServer(1481): Online Regions={3b1e4487bef0d3b970e68f23067786d7=hbase:quota,,1711288555392.3b1e4487bef0d3b970e68f23067786d7.} 2024-03-24 13:57:01,691 INFO [RS:0;jenkins-hbase4:37469] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-03-24 13:57:01,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1711288555392.3b1e4487bef0d3b970e68f23067786d7. 2024-03-24 13:57:01,691 INFO [RS:0;jenkins-hbase4:37469] regionserver.HRegionServer(3307): Received CLOSE for 633bd601803a48a576b2418df2ba8b72 2024-03-24 13:57:01,691 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1711288555392.3b1e4487bef0d3b970e68f23067786d7. after waiting 0 ms 2024-03-24 13:57:01,692 INFO [RS:0;jenkins-hbase4:37469] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,37469,1711288552789 2024-03-24 13:57:01,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 633bd601803a48a576b2418df2ba8b72, disabling compactions & flushes 2024-03-24 13:57:01,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1711288555392.3b1e4487bef0d3b970e68f23067786d7. 2024-03-24 13:57:01,692 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1711288554672.633bd601803a48a576b2418df2ba8b72. 2024-03-24 13:57:01,692 INFO [RS:0;jenkins-hbase4:37469] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-03-24 13:57:01,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1711288554672.633bd601803a48a576b2418df2ba8b72. 2024-03-24 13:57:01,692 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 3b1e4487bef0d3b970e68f23067786d7 2/2 column families, dataSize=726 B heapSize=2.44 KB 2024-03-24 13:57:01,692 DEBUG [RS:0;jenkins-hbase4:37469] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x60b57162 to 127.0.0.1:62836 2024-03-24 13:57:01,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1711288554672.633bd601803a48a576b2418df2ba8b72. after waiting 0 ms 2024-03-24 13:57:01,693 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1711288554672.633bd601803a48a576b2418df2ba8b72. 2024-03-24 13:57:01,693 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 633bd601803a48a576b2418df2ba8b72 1/1 column families, dataSize=147 B heapSize=704 B 2024-03-24 13:57:01,693 DEBUG [RS:0;jenkins-hbase4:37469] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-24 13:57:01,693 INFO [RS:0;jenkins-hbase4:37469] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-03-24 13:57:01,693 INFO [RS:0;jenkins-hbase4:37469] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-03-24 13:57:01,693 INFO [RS:0;jenkins-hbase4:37469] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-03-24 13:57:01,693 INFO [RS:0;jenkins-hbase4:37469] regionserver.HRegionServer(3307): Received CLOSE for 1588230740 2024-03-24 13:57:01,693 INFO [RS:0;jenkins-hbase4:37469] regionserver.HRegionServer(1477): Waiting on 2 regions to close 2024-03-24 13:57:01,693 DEBUG [RS:0;jenkins-hbase4:37469] regionserver.HRegionServer(1481): Online Regions={1588230740=hbase:meta,,1.1588230740, 633bd601803a48a576b2418df2ba8b72=hbase:namespace,,1711288554672.633bd601803a48a576b2418df2ba8b72.} 2024-03-24 13:57:01,693 DEBUG [RS:1;jenkins-hbase4:40925] regionserver.HRegionServer(1507): Waiting on 3b1e4487bef0d3b970e68f23067786d7 2024-03-24 13:57:01,693 DEBUG [RS:0;jenkins-hbase4:37469] regionserver.HRegionServer(1507): Waiting on 1588230740, 633bd601803a48a576b2418df2ba8b72 2024-03-24 13:57:01,694 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-03-24 13:57:01,694 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-03-24 13:57:01,694 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-03-24 13:57:01,694 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-03-24 13:57:01,694 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-03-24 13:57:01,695 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=14.15 KB heapSize=25.10 KB 2024-03-24 13:57:01,736 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-03-24 13:57:01,753 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=12.16 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/meta/1588230740/.tmp/info/3014fe6703c34041886dbf9475fee52b 2024-03-24 13:57:01,759 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=597 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/quota/3b1e4487bef0d3b970e68f23067786d7/.tmp/q/c7f45040d1394526a6a671790288b3f5 2024-03-24 13:57:01,760 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=147 B at sequenceid=8 (bloomFilter=true), to=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/namespace/633bd601803a48a576b2418df2ba8b72/.tmp/info/f0565a0ec1be4d519f81bcaa1a76d2bf 2024-03-24 13:57:01,771 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c7f45040d1394526a6a671790288b3f5 2024-03-24 13:57:01,771 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f0565a0ec1be4d519f81bcaa1a76d2bf 2024-03-24 13:57:01,771 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3014fe6703c34041886dbf9475fee52b 2024-03-24 13:57:01,773 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/namespace/633bd601803a48a576b2418df2ba8b72/.tmp/info/f0565a0ec1be4d519f81bcaa1a76d2bf as hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/namespace/633bd601803a48a576b2418df2ba8b72/info/f0565a0ec1be4d519f81bcaa1a76d2bf 2024-03-24 13:57:01,779 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-03-24 13:57:01,779 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-03-24 13:57:01,785 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f0565a0ec1be4d519f81bcaa1a76d2bf 2024-03-24 13:57:01,785 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/namespace/633bd601803a48a576b2418df2ba8b72/info/f0565a0ec1be4d519f81bcaa1a76d2bf, entries=3, sequenceid=8, filesize=5.0 K 2024-03-24 13:57:01,790 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~147 B/147, heapSize ~688 B/688, currentSize=0 B/0 for 633bd601803a48a576b2418df2ba8b72 in 97ms, sequenceid=8, compaction requested=false 2024-03-24 13:57:01,800 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=478 B at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/meta/1588230740/.tmp/rep_barrier/722417c3558245e6b92a0c5a900d1d0b 2024-03-24 13:57:01,801 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=129 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/quota/3b1e4487bef0d3b970e68f23067786d7/.tmp/u/704dc14de7134343b63aa1fe788b2bb6 2024-03-24 13:57:01,806 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/namespace/633bd601803a48a576b2418df2ba8b72/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=1 2024-03-24 13:57:01,808 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1711288554672.633bd601803a48a576b2418df2ba8b72. 2024-03-24 13:57:01,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 633bd601803a48a576b2418df2ba8b72: 2024-03-24 13:57:01,808 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1711288554672.633bd601803a48a576b2418df2ba8b72. 2024-03-24 13:57:01,811 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 722417c3558245e6b92a0c5a900d1d0b 2024-03-24 13:57:01,812 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 704dc14de7134343b63aa1fe788b2bb6 2024-03-24 13:57:01,814 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/quota/3b1e4487bef0d3b970e68f23067786d7/.tmp/q/c7f45040d1394526a6a671790288b3f5 as hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/quota/3b1e4487bef0d3b970e68f23067786d7/q/c7f45040d1394526a6a671790288b3f5 2024-03-24 13:57:01,826 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c7f45040d1394526a6a671790288b3f5 2024-03-24 13:57:01,827 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/quota/3b1e4487bef0d3b970e68f23067786d7/q/c7f45040d1394526a6a671790288b3f5, entries=5, sequenceid=17, filesize=5.1 K 2024-03-24 13:57:01,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/quota/3b1e4487bef0d3b970e68f23067786d7/.tmp/u/704dc14de7134343b63aa1fe788b2bb6 as hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/quota/3b1e4487bef0d3b970e68f23067786d7/u/704dc14de7134343b63aa1fe788b2bb6 2024-03-24 13:57:01,840 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.53 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/meta/1588230740/.tmp/table/9143b87c4b9b457d9e979d7206ddc87f 2024-03-24 13:57:01,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 704dc14de7134343b63aa1fe788b2bb6 2024-03-24 13:57:01,844 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/quota/3b1e4487bef0d3b970e68f23067786d7/u/704dc14de7134343b63aa1fe788b2bb6, entries=4, sequenceid=17, filesize=5.0 K 2024-03-24 13:57:01,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~726 B/726, heapSize ~2.41 KB/2464, currentSize=0 B/0 for 3b1e4487bef0d3b970e68f23067786d7 in 154ms, sequenceid=17, compaction requested=false 2024-03-24 13:57:01,851 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9143b87c4b9b457d9e979d7206ddc87f 2024-03-24 13:57:01,854 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/meta/1588230740/.tmp/info/3014fe6703c34041886dbf9475fee52b as hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/meta/1588230740/info/3014fe6703c34041886dbf9475fee52b 2024-03-24 13:57:01,859 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/quota/3b1e4487bef0d3b970e68f23067786d7/recovered.edits/20.seqid, newMaxSeqId=20, maxSeqId=1 2024-03-24 13:57:01,861 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:quota,,1711288555392.3b1e4487bef0d3b970e68f23067786d7. 2024-03-24 13:57:01,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3b1e4487bef0d3b970e68f23067786d7: 2024-03-24 13:57:01,861 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:quota,,1711288555392.3b1e4487bef0d3b970e68f23067786d7. 2024-03-24 13:57:01,869 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3014fe6703c34041886dbf9475fee52b 2024-03-24 13:57:01,869 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/meta/1588230740/info/3014fe6703c34041886dbf9475fee52b, entries=30, sequenceid=66, filesize=8.0 K 2024-03-24 13:57:01,871 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/meta/1588230740/.tmp/rep_barrier/722417c3558245e6b92a0c5a900d1d0b as hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/meta/1588230740/rep_barrier/722417c3558245e6b92a0c5a900d1d0b 2024-03-24 13:57:01,880 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 722417c3558245e6b92a0c5a900d1d0b 2024-03-24 13:57:01,881 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/meta/1588230740/rep_barrier/722417c3558245e6b92a0c5a900d1d0b, entries=5, sequenceid=66, filesize=5.3 K 2024-03-24 13:57:01,882 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/meta/1588230740/.tmp/table/9143b87c4b9b457d9e979d7206ddc87f as hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/meta/1588230740/table/9143b87c4b9b457d9e979d7206ddc87f 2024-03-24 13:57:01,892 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9143b87c4b9b457d9e979d7206ddc87f 2024-03-24 13:57:01,892 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/meta/1588230740/table/9143b87c4b9b457d9e979d7206ddc87f, entries=13, sequenceid=66, filesize=5.6 K 2024-03-24 13:57:01,893 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~14.15 KB/14494, heapSize ~25.05 KB/25656, currentSize=0 B/0 for 1588230740 in 199ms, sequenceid=66, compaction requested=false 2024-03-24 13:57:01,894 INFO [RS:1;jenkins-hbase4:40925] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,40925,1711288552834; all regions closed. 2024-03-24 13:57:01,894 DEBUG [RS:0;jenkins-hbase4:37469] regionserver.HRegionServer(1507): Waiting on 1588230740 2024-03-24 13:57:01,894 DEBUG [RS:1;jenkins-hbase4:40925] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-03-24 13:57:01,912 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/data/hbase/meta/1588230740/recovered.edits/69.seqid, newMaxSeqId=69, maxSeqId=1 2024-03-24 13:57:01,913 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-03-24 13:57:01,914 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-03-24 13:57:01,914 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-03-24 13:57:01,914 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2024-03-24 13:57:01,915 DEBUG [RS:1;jenkins-hbase4:40925] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/oldWALs 2024-03-24 13:57:01,915 INFO [RS:1;jenkins-hbase4:40925] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40925%2C1711288552834:(num 1711288554294) 2024-03-24 13:57:01,915 DEBUG [RS:1;jenkins-hbase4:40925] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-24 13:57:01,916 INFO [RS:1;jenkins-hbase4:40925] regionserver.LeaseManager(133): Closed leases 2024-03-24 13:57:01,916 INFO [RS:1;jenkins-hbase4:40925] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2024-03-24 13:57:01,916 INFO [RS:1;jenkins-hbase4:40925] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-03-24 13:57:01,916 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-03-24 13:57:01,916 INFO [RS:1;jenkins-hbase4:40925] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-03-24 13:57:01,917 INFO [RS:1;jenkins-hbase4:40925] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-03-24 13:57:01,918 INFO [RS:1;jenkins-hbase4:40925] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40925 2024-03-24 13:57:01,925 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): regionserver:37469-0x100961fcc9b0001, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40925,1711288552834 2024-03-24 13:57:01,925 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-03-24 13:57:01,925 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): regionserver:40925-0x100961fcc9b0002, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40925,1711288552834 2024-03-24 13:57:01,926 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): regionserver:40925-0x100961fcc9b0002, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-03-24 13:57:01,926 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): regionserver:37469-0x100961fcc9b0001, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-03-24 13:57:01,927 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40925,1711288552834] 2024-03-24 13:57:01,927 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40925,1711288552834; numProcessing=1 2024-03-24 13:57:01,929 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40925,1711288552834 already deleted, retry=false 2024-03-24 13:57:01,929 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,40925,1711288552834 expired; onlineServers=1 2024-03-24 13:57:02,029 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): regionserver:40925-0x100961fcc9b0002, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-24 13:57:02,029 INFO [RS:1;jenkins-hbase4:40925] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,40925,1711288552834; zookeeper connection closed. 2024-03-24 13:57:02,029 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): regionserver:40925-0x100961fcc9b0002, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-24 13:57:02,029 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@4a9f0b0a] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@4a9f0b0a 2024-03-24 13:57:02,094 INFO [RS:0;jenkins-hbase4:37469] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,37469,1711288552789; all regions closed. 2024-03-24 13:57:02,094 DEBUG [RS:0;jenkins-hbase4:37469] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-03-24 13:57:02,101 DEBUG [RS:0;jenkins-hbase4:37469] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/oldWALs 2024-03-24 13:57:02,102 INFO [RS:0;jenkins-hbase4:37469] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37469%2C1711288552789.meta:.meta(num 1711288554419) 2024-03-24 13:57:02,108 DEBUG [RS:0;jenkins-hbase4:37469] wal.AbstractFSWAL(1027): Moved 1 WAL file(s) to /user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/oldWALs 2024-03-24 13:57:02,109 INFO [RS:0;jenkins-hbase4:37469] wal.AbstractFSWAL(1030): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C37469%2C1711288552789:(num 1711288554294) 2024-03-24 13:57:02,109 DEBUG [RS:0;jenkins-hbase4:37469] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-24 13:57:02,109 INFO [RS:0;jenkins-hbase4:37469] regionserver.LeaseManager(133): Closed leases 2024-03-24 13:57:02,109 INFO [RS:0;jenkins-hbase4:37469] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2024-03-24 13:57:02,109 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-03-24 13:57:02,110 INFO [RS:0;jenkins-hbase4:37469] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:37469 2024-03-24 13:57:02,112 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): regionserver:37469-0x100961fcc9b0001, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,37469,1711288552789 2024-03-24 13:57:02,112 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-03-24 13:57:02,115 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,37469,1711288552789] 2024-03-24 13:57:02,115 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,37469,1711288552789; numProcessing=2 2024-03-24 13:57:02,116 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,37469,1711288552789 already deleted, retry=false 2024-03-24 13:57:02,116 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,37469,1711288552789 expired; onlineServers=0 2024-03-24 13:57:02,116 INFO [RegionServerTracker-0] regionserver.HRegionServer(2299): ***** STOPPING region server 'jenkins-hbase4.apache.org,43509,1711288551562' ***** 2024-03-24 13:57:02,116 INFO [RegionServerTracker-0] regionserver.HRegionServer(2313): STOPPED: Cluster shutdown set; onlineServer=0 2024-03-24 13:57:02,117 DEBUG [M:0;jenkins-hbase4:43509] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@297de531, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-03-24 13:57:02,117 INFO [M:0;jenkins-hbase4:43509] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,43509,1711288551562 2024-03-24 13:57:02,117 INFO [M:0;jenkins-hbase4:43509] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,43509,1711288551562; all regions closed. 2024-03-24 13:57:02,117 DEBUG [M:0;jenkins-hbase4:43509] ipc.AbstractRpcClient(489): Stopping rpc client 2024-03-24 13:57:02,117 DEBUG [M:0;jenkins-hbase4:43509] cleaner.LogCleaner(198): Cancelling LogCleaner 2024-03-24 13:57:02,118 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2024-03-24 13:57:02,118 DEBUG [M:0;jenkins-hbase4:43509] cleaner.HFileCleaner(317): Stopping file delete threads 2024-03-24 13:57:02,118 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1711288553942] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1711288553942,5,FailOnTimeoutGroup] 2024-03-24 13:57:02,118 INFO [M:0;jenkins-hbase4:43509] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2024-03-24 13:57:02,118 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1711288553942] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1711288553942,5,FailOnTimeoutGroup] 2024-03-24 13:57:02,118 INFO [M:0;jenkins-hbase4:43509] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2024-03-24 13:57:02,118 INFO [M:0;jenkins-hbase4:43509] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS] on shutdown 2024-03-24 13:57:02,118 DEBUG [M:0;jenkins-hbase4:43509] master.HMaster(1517): Stopping service threads 2024-03-24 13:57:02,118 INFO [M:0;jenkins-hbase4:43509] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2024-03-24 13:57:02,119 ERROR [M:0;jenkins-hbase4:43509] procedure2.ProcedureExecutor(699): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-8,5,PEWorkerGroup] Thread[HFileArchiver-9,5,PEWorkerGroup] Thread[HFileArchiver-10,5,PEWorkerGroup] Thread[HFileArchiver-11,5,PEWorkerGroup] Thread[HFileArchiver-12,5,PEWorkerGroup] 2024-03-24 13:57:02,119 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2024-03-24 13:57:02,119 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-03-24 13:57:02,119 INFO [M:0;jenkins-hbase4:43509] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2024-03-24 13:57:02,119 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2024-03-24 13:57:02,120 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-03-24 13:57:02,120 DEBUG [M:0;jenkins-hbase4:43509] zookeeper.ZKUtil(399): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2024-03-24 13:57:02,120 WARN [M:0;jenkins-hbase4:43509] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2024-03-24 13:57:02,120 INFO [M:0;jenkins-hbase4:43509] assignment.AssignmentManager(315): Stopping assignment manager 2024-03-24 13:57:02,120 INFO [M:0;jenkins-hbase4:43509] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2024-03-24 13:57:02,121 DEBUG [M:0;jenkins-hbase4:43509] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-03-24 13:57:02,121 INFO [M:0;jenkins-hbase4:43509] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-24 13:57:02,121 DEBUG [M:0;jenkins-hbase4:43509] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-24 13:57:02,121 DEBUG [M:0;jenkins-hbase4:43509] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-03-24 13:57:02,121 DEBUG [M:0;jenkins-hbase4:43509] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-24 13:57:02,121 INFO [M:0;jenkins-hbase4:43509] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=152.93 KB heapSize=184.74 KB 2024-03-24 13:57:02,144 INFO [M:0;jenkins-hbase4:43509] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=152.93 KB at sequenceid=376 (bloomFilter=true), to=hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/03937377d0f34e75bf2670bcb59034f6 2024-03-24 13:57:02,152 INFO [M:0;jenkins-hbase4:43509] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 03937377d0f34e75bf2670bcb59034f6 2024-03-24 13:57:02,153 DEBUG [M:0;jenkins-hbase4:43509] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/03937377d0f34e75bf2670bcb59034f6 as hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/03937377d0f34e75bf2670bcb59034f6 2024-03-24 13:57:02,161 INFO [M:0;jenkins-hbase4:43509] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 03937377d0f34e75bf2670bcb59034f6 2024-03-24 13:57:02,161 INFO [M:0;jenkins-hbase4:43509] regionserver.HStore(1080): Added hdfs://localhost:43333/user/jenkins/test-data/e2bf8770-42f4-39b8-23d0-92272aba29d6/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/03937377d0f34e75bf2670bcb59034f6, entries=45, sequenceid=376, filesize=12.0 K 2024-03-24 13:57:02,162 INFO [M:0;jenkins-hbase4:43509] regionserver.HRegion(2948): Finished flush of dataSize ~152.93 KB/156605, heapSize ~184.73 KB/189160, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 41ms, sequenceid=376, compaction requested=false 2024-03-24 13:57:02,163 INFO [M:0;jenkins-hbase4:43509] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-03-24 13:57:02,163 DEBUG [M:0;jenkins-hbase4:43509] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-03-24 13:57:02,168 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-03-24 13:57:02,168 INFO [M:0;jenkins-hbase4:43509] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2024-03-24 13:57:02,168 INFO [M:0;jenkins-hbase4:43509] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43509 2024-03-24 13:57:02,171 DEBUG [M:0;jenkins-hbase4:43509] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,43509,1711288551562 already deleted, retry=false 2024-03-24 13:57:02,215 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): regionserver:37469-0x100961fcc9b0001, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-24 13:57:02,215 INFO [RS:0;jenkins-hbase4:37469] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,37469,1711288552789; zookeeper connection closed. 2024-03-24 13:57:02,215 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): regionserver:37469-0x100961fcc9b0001, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-24 13:57:02,215 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@d10536f] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@d10536f 2024-03-24 13:57:02,216 INFO [Listener at localhost/40227] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2024-03-24 13:57:02,273 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-24 13:57:02,273 INFO [M:0;jenkins-hbase4:43509] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,43509,1711288551562; zookeeper connection closed. 2024-03-24 13:57:02,273 DEBUG [Listener at localhost/40227-EventThread] zookeeper.ZKWatcher(600): master:43509-0x100961fcc9b0000, quorum=127.0.0.1:62836, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-03-24 13:57:02,275 WARN [Listener at localhost/40227] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-03-24 13:57:02,279 INFO [Listener at localhost/40227] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-03-24 13:57:02,384 WARN [BP-2022839429-172.31.14.131-1711288548495 heartbeating to localhost/127.0.0.1:43333] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-03-24 13:57:02,384 WARN [BP-2022839429-172.31.14.131-1711288548495 heartbeating to localhost/127.0.0.1:43333] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2022839429-172.31.14.131-1711288548495 (Datanode Uuid 44e451fb-3df3-4c97-ab4e-ce1ae7a10f50) service to localhost/127.0.0.1:43333 2024-03-24 13:57:02,386 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/cluster_cbf4f67b-ef7d-0272-4d6f-be55fc03f1ae/dfs/data/data3/current/BP-2022839429-172.31.14.131-1711288548495] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-03-24 13:57:02,387 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/cluster_cbf4f67b-ef7d-0272-4d6f-be55fc03f1ae/dfs/data/data4/current/BP-2022839429-172.31.14.131-1711288548495] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-03-24 13:57:02,388 WARN [Listener at localhost/40227] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-03-24 13:57:02,391 INFO [Listener at localhost/40227] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-03-24 13:57:02,448 WARN [BP-2022839429-172.31.14.131-1711288548495 heartbeating to localhost/127.0.0.1:43333] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-2022839429-172.31.14.131-1711288548495 (Datanode Uuid a74d1121-462a-40b7-9f3b-ea15619bcb3b) service to localhost/127.0.0.1:43333 2024-03-24 13:57:02,449 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/cluster_cbf4f67b-ef7d-0272-4d6f-be55fc03f1ae/dfs/data/data1/current/BP-2022839429-172.31.14.131-1711288548495] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-03-24 13:57:02,450 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/45a98661-5d2e-2981-9ca5-90545f92cbac/cluster_cbf4f67b-ef7d-0272-4d6f-be55fc03f1ae/dfs/data/data2/current/BP-2022839429-172.31.14.131-1711288548495] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-03-24 13:57:02,535 INFO [Listener at localhost/40227] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-03-24 13:57:02,652 INFO [Listener at localhost/40227] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2024-03-24 13:57:02,704 INFO [Listener at localhost/40227] hbase.HBaseTestingUtility(1293): Minicluster is down