2024-04-20 02:59:11,430 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle timeout: 13 mins 2024-04-20 02:59:11,659 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c 2024-04-20 02:59:11,671 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=2, rsPorts=, rsClass=null, numDataNodes=2, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2024-04-20 02:59:11,671 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/cluster_b090cd7a-7189-fe5a-cea3-7fbe879c9bbf, deleteOnExit=true 2024-04-20 02:59:11,671 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2024-04-20 02:59:11,672 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/test.cache.data in system properties and HBase conf 2024-04-20 02:59:11,672 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/hadoop.tmp.dir in system properties and HBase conf 2024-04-20 02:59:11,673 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/hadoop.log.dir in system properties and HBase conf 2024-04-20 02:59:11,673 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/mapreduce.cluster.local.dir in system properties and HBase conf 2024-04-20 02:59:11,673 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/mapreduce.cluster.temp.dir in system properties and HBase conf 2024-04-20 02:59:11,674 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2024-04-20 02:59:11,779 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2024-04-20 02:59:12,156 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2024-04-20 02:59:12,161 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2024-04-20 02:59:12,161 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2024-04-20 02:59:12,161 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/yarn.nodemanager.log-dirs in system properties and HBase conf 2024-04-20 02:59:12,162 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-04-20 02:59:12,162 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2024-04-20 02:59:12,162 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2024-04-20 02:59:12,162 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2024-04-20 02:59:12,163 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/dfs.journalnode.edits.dir in system properties and HBase conf 2024-04-20 02:59:12,163 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2024-04-20 02:59:12,163 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/nfs.dump.dir in system properties and HBase conf 2024-04-20 02:59:12,164 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/java.io.tmpdir in system properties and HBase conf 2024-04-20 02:59:12,164 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/dfs.journalnode.edits.dir in system properties and HBase conf 2024-04-20 02:59:12,164 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2024-04-20 02:59:12,164 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2024-04-20 02:59:12,692 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-04-20 02:59:12,696 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-04-20 02:59:12,991 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2024-04-20 02:59:13,139 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2024-04-20 02:59:13,153 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-04-20 02:59:13,188 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2024-04-20 02:59:13,225 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/java.io.tmpdir/Jetty_localhost_42095_hdfs____c6c4hk/webapp 2024-04-20 02:59:13,350 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:42095 2024-04-20 02:59:13,360 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2024-04-20 02:59:13,360 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2024-04-20 02:59:13,816 WARN [Listener at localhost/38043] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-04-20 02:59:13,881 WARN [Listener at localhost/38043] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-04-20 02:59:13,899 WARN [Listener at localhost/38043] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-04-20 02:59:13,906 INFO [Listener at localhost/38043] log.Slf4jLog(67): jetty-6.1.26 2024-04-20 02:59:13,910 INFO [Listener at localhost/38043] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/java.io.tmpdir/Jetty_localhost_40421_datanode____k9grtq/webapp 2024-04-20 02:59:14,010 INFO [Listener at localhost/38043] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:40421 2024-04-20 02:59:14,305 WARN [Listener at localhost/41097] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-04-20 02:59:14,316 WARN [Listener at localhost/41097] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2024-04-20 02:59:14,320 WARN [Listener at localhost/41097] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2024-04-20 02:59:14,321 INFO [Listener at localhost/41097] log.Slf4jLog(67): jetty-6.1.26 2024-04-20 02:59:14,330 INFO [Listener at localhost/41097] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/java.io.tmpdir/Jetty_localhost_38959_datanode____.8wlybl/webapp 2024-04-20 02:59:14,429 INFO [Listener at localhost/41097] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38959 2024-04-20 02:59:14,437 WARN [Listener at localhost/35709] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2024-04-20 02:59:14,731 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc6e102b07cca0da2: Processing first storage report for DS-cce640c4-47dd-40cb-97e8-11c69db6e4c9 from datanode 9fd8b0ce-b99d-4c35-944e-ade1edb86801 2024-04-20 02:59:14,733 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc6e102b07cca0da2: from storage DS-cce640c4-47dd-40cb-97e8-11c69db6e4c9 node DatanodeRegistration(127.0.0.1:41859, datanodeUuid=9fd8b0ce-b99d-4c35-944e-ade1edb86801, infoPort=41465, infoSecurePort=0, ipcPort=41097, storageInfo=lv=-57;cid=testClusterID;nsid=4346428;c=1713581952780), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2024-04-20 02:59:14,733 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x126d52e16a84e314: Processing first storage report for DS-d2abdbee-4573-4054-8416-a8fc5a70dc06 from datanode c84fb22b-f714-45a6-a157-1264496e319d 2024-04-20 02:59:14,734 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x126d52e16a84e314: from storage DS-d2abdbee-4573-4054-8416-a8fc5a70dc06 node DatanodeRegistration(127.0.0.1:39697, datanodeUuid=c84fb22b-f714-45a6-a157-1264496e319d, infoPort=40823, infoSecurePort=0, ipcPort=35709, storageInfo=lv=-57;cid=testClusterID;nsid=4346428;c=1713581952780), blocks: 0, hasStaleStorage: true, processing time: 0 msecs, invalidatedBlocks: 0 2024-04-20 02:59:14,734 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0xc6e102b07cca0da2: Processing first storage report for DS-91b1562a-014b-4a68-81b8-18a1d8699a85 from datanode 9fd8b0ce-b99d-4c35-944e-ade1edb86801 2024-04-20 02:59:14,734 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0xc6e102b07cca0da2: from storage DS-91b1562a-014b-4a68-81b8-18a1d8699a85 node DatanodeRegistration(127.0.0.1:41859, datanodeUuid=9fd8b0ce-b99d-4c35-944e-ade1edb86801, infoPort=41465, infoSecurePort=0, ipcPort=41097, storageInfo=lv=-57;cid=testClusterID;nsid=4346428;c=1713581952780), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2024-04-20 02:59:14,734 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x126d52e16a84e314: Processing first storage report for DS-a5c9a5f5-8494-40e4-9926-668f02ac16a9 from datanode c84fb22b-f714-45a6-a157-1264496e319d 2024-04-20 02:59:14,734 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x126d52e16a84e314: from storage DS-a5c9a5f5-8494-40e4-9926-668f02ac16a9 node DatanodeRegistration(127.0.0.1:39697, datanodeUuid=c84fb22b-f714-45a6-a157-1264496e319d, infoPort=40823, infoSecurePort=0, ipcPort=35709, storageInfo=lv=-57;cid=testClusterID;nsid=4346428;c=1713581952780), blocks: 0, hasStaleStorage: false, processing time: 1 msecs, invalidatedBlocks: 0 2024-04-20 02:59:14,821 DEBUG [Listener at localhost/35709] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c 2024-04-20 02:59:14,929 INFO [Listener at localhost/35709] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/cluster_b090cd7a-7189-fe5a-cea3-7fbe879c9bbf/zookeeper_0, clientPort=50743, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/cluster_b090cd7a-7189-fe5a-cea3-7fbe879c9bbf/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/cluster_b090cd7a-7189-fe5a-cea3-7fbe879c9bbf/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2024-04-20 02:59:14,943 INFO [Listener at localhost/35709] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=50743 2024-04-20 02:59:14,951 INFO [Listener at localhost/35709] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-20 02:59:14,953 INFO [Listener at localhost/35709] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-20 02:59:15,633 INFO [Listener at localhost/35709] util.FSUtils(471): Created version file at hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3 with version=8 2024-04-20 02:59:15,633 INFO [Listener at localhost/35709] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/hbase-staging 2024-04-20 02:59:15,935 INFO [Listener at localhost/35709] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2024-04-20 02:59:16,379 INFO [Listener at localhost/35709] client.ConnectionUtils(126): master/jenkins-hbase4:0 server-side Connection retries=45 2024-04-20 02:59:16,412 INFO [Listener at localhost/35709] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-04-20 02:59:16,412 INFO [Listener at localhost/35709] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-04-20 02:59:16,413 INFO [Listener at localhost/35709] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-04-20 02:59:16,413 INFO [Listener at localhost/35709] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-04-20 02:59:16,413 INFO [Listener at localhost/35709] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-04-20 02:59:16,559 INFO [Listener at localhost/35709] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2024-04-20 02:59:16,633 DEBUG [Listener at localhost/35709] util.ClassSize(228): Using Unsafe to estimate memory layout 2024-04-20 02:59:16,727 INFO [Listener at localhost/35709] ipc.NettyRpcServer(120): Bind to /172.31.14.131:35099 2024-04-20 02:59:16,737 INFO [Listener at localhost/35709] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-20 02:59:16,739 INFO [Listener at localhost/35709] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-20 02:59:16,759 INFO [Listener at localhost/35709] zookeeper.RecoverableZooKeeper(93): Process identifier=master:35099 connecting to ZooKeeper ensemble=127.0.0.1:50743 2024-04-20 02:59:16,800 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:350990x0, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-04-20 02:59:16,801 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:35099-0x1011ed25edb0000 connected 2024-04-20 02:59:16,832 DEBUG [Listener at localhost/35709] zookeeper.ZKUtil(165): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-04-20 02:59:16,833 DEBUG [Listener at localhost/35709] zookeeper.ZKUtil(165): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-04-20 02:59:16,836 DEBUG [Listener at localhost/35709] zookeeper.ZKUtil(165): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-04-20 02:59:16,844 DEBUG [Listener at localhost/35709] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=35099 2024-04-20 02:59:16,844 DEBUG [Listener at localhost/35709] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=35099 2024-04-20 02:59:16,845 DEBUG [Listener at localhost/35709] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=35099 2024-04-20 02:59:16,845 DEBUG [Listener at localhost/35709] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=35099 2024-04-20 02:59:16,846 DEBUG [Listener at localhost/35709] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=35099 2024-04-20 02:59:16,851 INFO [Listener at localhost/35709] master.HMaster(445): hbase.rootdir=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3, hbase.cluster.distributed=false 2024-04-20 02:59:16,919 INFO [Listener at localhost/35709] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-04-20 02:59:16,919 INFO [Listener at localhost/35709] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-04-20 02:59:16,919 INFO [Listener at localhost/35709] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-04-20 02:59:16,919 INFO [Listener at localhost/35709] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-04-20 02:59:16,919 INFO [Listener at localhost/35709] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-04-20 02:59:16,920 INFO [Listener at localhost/35709] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-04-20 02:59:16,925 INFO [Listener at localhost/35709] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-04-20 02:59:16,927 INFO [Listener at localhost/35709] ipc.NettyRpcServer(120): Bind to /172.31.14.131:45079 2024-04-20 02:59:16,929 INFO [Listener at localhost/35709] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-04-20 02:59:16,935 DEBUG [Listener at localhost/35709] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-04-20 02:59:16,936 INFO [Listener at localhost/35709] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-20 02:59:16,938 INFO [Listener at localhost/35709] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-20 02:59:16,940 INFO [Listener at localhost/35709] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:45079 connecting to ZooKeeper ensemble=127.0.0.1:50743 2024-04-20 02:59:16,944 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): regionserver:450790x0, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-04-20 02:59:16,944 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:45079-0x1011ed25edb0001 connected 2024-04-20 02:59:16,945 DEBUG [Listener at localhost/35709] zookeeper.ZKUtil(165): regionserver:45079-0x1011ed25edb0001, quorum=127.0.0.1:50743, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-04-20 02:59:16,946 DEBUG [Listener at localhost/35709] zookeeper.ZKUtil(165): regionserver:45079-0x1011ed25edb0001, quorum=127.0.0.1:50743, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-04-20 02:59:16,947 DEBUG [Listener at localhost/35709] zookeeper.ZKUtil(165): regionserver:45079-0x1011ed25edb0001, quorum=127.0.0.1:50743, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-04-20 02:59:16,948 DEBUG [Listener at localhost/35709] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=45079 2024-04-20 02:59:16,948 DEBUG [Listener at localhost/35709] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=45079 2024-04-20 02:59:16,948 DEBUG [Listener at localhost/35709] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=45079 2024-04-20 02:59:16,949 DEBUG [Listener at localhost/35709] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=45079 2024-04-20 02:59:16,949 DEBUG [Listener at localhost/35709] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=45079 2024-04-20 02:59:16,961 INFO [Listener at localhost/35709] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=45 2024-04-20 02:59:16,961 INFO [Listener at localhost/35709] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-04-20 02:59:16,961 INFO [Listener at localhost/35709] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2024-04-20 02:59:16,962 INFO [Listener at localhost/35709] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2024-04-20 02:59:16,962 INFO [Listener at localhost/35709] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2024-04-20 02:59:16,962 INFO [Listener at localhost/35709] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2024-04-20 02:59:16,962 INFO [Listener at localhost/35709] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2024-04-20 02:59:16,964 INFO [Listener at localhost/35709] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43007 2024-04-20 02:59:16,964 INFO [Listener at localhost/35709] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2024-04-20 02:59:16,965 DEBUG [Listener at localhost/35709] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2024-04-20 02:59:16,966 INFO [Listener at localhost/35709] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-20 02:59:16,967 INFO [Listener at localhost/35709] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-20 02:59:16,970 INFO [Listener at localhost/35709] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:43007 connecting to ZooKeeper ensemble=127.0.0.1:50743 2024-04-20 02:59:16,973 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): regionserver:430070x0, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2024-04-20 02:59:16,974 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:43007-0x1011ed25edb0002 connected 2024-04-20 02:59:16,975 DEBUG [Listener at localhost/35709] zookeeper.ZKUtil(165): regionserver:43007-0x1011ed25edb0002, quorum=127.0.0.1:50743, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-04-20 02:59:16,976 DEBUG [Listener at localhost/35709] zookeeper.ZKUtil(165): regionserver:43007-0x1011ed25edb0002, quorum=127.0.0.1:50743, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-04-20 02:59:16,976 DEBUG [Listener at localhost/35709] zookeeper.ZKUtil(165): regionserver:43007-0x1011ed25edb0002, quorum=127.0.0.1:50743, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2024-04-20 02:59:16,977 DEBUG [Listener at localhost/35709] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43007 2024-04-20 02:59:16,977 DEBUG [Listener at localhost/35709] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43007 2024-04-20 02:59:16,978 DEBUG [Listener at localhost/35709] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43007 2024-04-20 02:59:16,978 DEBUG [Listener at localhost/35709] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43007 2024-04-20 02:59:16,979 DEBUG [Listener at localhost/35709] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43007 2024-04-20 02:59:16,981 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2174): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,35099,1713581955774 2024-04-20 02:59:16,990 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-04-20 02:59:16,992 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,35099,1713581955774 2024-04-20 02:59:17,010 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): regionserver:43007-0x1011ed25edb0002, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-04-20 02:59:17,010 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): regionserver:45079-0x1011ed25edb0001, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-04-20 02:59:17,010 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2024-04-20 02:59:17,011 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-20 02:59:17,012 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-04-20 02:59:17,013 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,35099,1713581955774 from backup master directory 2024-04-20 02:59:17,014 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(163): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2024-04-20 02:59:17,016 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,35099,1713581955774 2024-04-20 02:59:17,016 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2024-04-20 02:59:17,017 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-04-20 02:59:17,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,35099,1713581955774 2024-04-20 02:59:17,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2024-04-20 02:59:17,021 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2024-04-20 02:59:17,106 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/hbase.id with ID: 7059c9df-0299-45f0-8b25-cde5c39a0f95 2024-04-20 02:59:17,150 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2024-04-20 02:59:17,165 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-20 02:59:17,207 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x4ff526db to 127.0.0.1:50743 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-04-20 02:59:17,239 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@45482179, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-04-20 02:59:17,262 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-04-20 02:59:17,263 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2024-04-20 02:59:17,280 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2024-04-20 02:59:17,280 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2024-04-20 02:59:17,282 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-04-20 02:59:17,286 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:856) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2199) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:529) at java.lang.Thread.run(Thread.java:750) 2024-04-20 02:59:17,287 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-04-20 02:59:17,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/MasterData/data/master/store-tmp 2024-04-20 02:59:17,353 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-20 02:59:17,353 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-04-20 02:59:17,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-20 02:59:17,353 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-20 02:59:17,353 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-04-20 02:59:17,353 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-20 02:59:17,353 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-20 02:59:17,353 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-04-20 02:59:17,355 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/MasterData/WALs/jenkins-hbase4.apache.org,35099,1713581955774 2024-04-20 02:59:17,374 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(492): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C35099%2C1713581955774, suffix=, logDir=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/MasterData/WALs/jenkins-hbase4.apache.org,35099,1713581955774, archiveDir=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/MasterData/oldWALs, maxLogs=10 2024-04-20 02:59:17,438 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39697,DS-d2abdbee-4573-4054-8416-a8fc5a70dc06,DISK] 2024-04-20 02:59:17,438 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41859,DS-cce640c4-47dd-40cb-97e8-11c69db6e4c9,DISK] 2024-04-20 02:59:17,446 DEBUG [RS-EventLoopGroup-4-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2024-04-20 02:59:17,512 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(809): New WAL /user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/MasterData/WALs/jenkins-hbase4.apache.org,35099,1713581955774/jenkins-hbase4.apache.org%2C35099%2C1713581955774.1713581957385 2024-04-20 02:59:17,513 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(890): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:41859,DS-cce640c4-47dd-40cb-97e8-11c69db6e4c9,DISK], DatanodeInfoWithStorage[127.0.0.1:39697,DS-d2abdbee-4573-4054-8416-a8fc5a70dc06,DISK]] 2024-04-20 02:59:17,513 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2024-04-20 02:59:17,514 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-20 02:59:17,517 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2024-04-20 02:59:17,518 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2024-04-20 02:59:17,575 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2024-04-20 02:59:17,582 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2024-04-20 02:59:17,606 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2024-04-20 02:59:17,617 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-20 02:59:17,623 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-04-20 02:59:17,624 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2024-04-20 02:59:17,638 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2024-04-20 02:59:17,643 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-20 02:59:17,644 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63413458, jitterRate=-0.05506584048271179}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-04-20 02:59:17,644 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2024-04-20 02:59:17,645 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2024-04-20 02:59:17,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2024-04-20 02:59:17,664 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(608): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2024-04-20 02:59:17,666 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2024-04-20 02:59:17,668 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(628): Recovered RegionProcedureStore lease in 1 msec 2024-04-20 02:59:17,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(642): Loaded RegionProcedureStore in 33 msec 2024-04-20 02:59:17,701 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2024-04-20 02:59:17,726 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2024-04-20 02:59:17,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2024-04-20 02:59:17,755 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2024-04-20 02:59:17,758 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2024-04-20 02:59:17,760 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2024-04-20 02:59:17,766 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2024-04-20 02:59:17,770 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2024-04-20 02:59:17,773 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-20 02:59:17,775 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2024-04-20 02:59:17,776 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2024-04-20 02:59:17,788 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2024-04-20 02:59:17,792 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): regionserver:43007-0x1011ed25edb0002, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-04-20 02:59:17,792 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): regionserver:45079-0x1011ed25edb0001, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-04-20 02:59:17,792 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2024-04-20 02:59:17,793 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-20 02:59:17,793 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(745): Active/primary master=jenkins-hbase4.apache.org,35099,1713581955774, sessionid=0x1011ed25edb0000, setting cluster-up flag (Was=false) 2024-04-20 02:59:17,810 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-20 02:59:17,816 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2024-04-20 02:59:17,818 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35099,1713581955774 2024-04-20 02:59:17,823 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-20 02:59:17,830 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2024-04-20 02:59:17,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,35099,1713581955774 2024-04-20 02:59:17,834 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.hbase-snapshot/.tmp 2024-04-20 02:59:17,883 INFO [RS:1;jenkins-hbase4:43007] regionserver.HRegionServer(957): ClusterId : 7059c9df-0299-45f0-8b25-cde5c39a0f95 2024-04-20 02:59:17,883 INFO [RS:0;jenkins-hbase4:45079] regionserver.HRegionServer(957): ClusterId : 7059c9df-0299-45f0-8b25-cde5c39a0f95 2024-04-20 02:59:17,886 INFO [master/jenkins-hbase4:0:becomeActiveMaster] coprocessor.CoprocessorHost(174): System coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver loaded, priority=536870911. 2024-04-20 02:59:17,889 DEBUG [RS:1;jenkins-hbase4:43007] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-04-20 02:59:17,889 DEBUG [RS:0;jenkins-hbase4:45079] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2024-04-20 02:59:17,897 DEBUG [RS:0;jenkins-hbase4:45079] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-04-20 02:59:17,897 DEBUG [RS:1;jenkins-hbase4:43007] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2024-04-20 02:59:17,898 DEBUG [RS:0;jenkins-hbase4:45079] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-04-20 02:59:17,898 DEBUG [RS:1;jenkins-hbase4:43007] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2024-04-20 02:59:17,901 DEBUG [RS:0;jenkins-hbase4:45079] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-04-20 02:59:17,901 DEBUG [RS:1;jenkins-hbase4:43007] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2024-04-20 02:59:17,905 DEBUG [RS:0;jenkins-hbase4:45079] zookeeper.ReadOnlyZKClient(139): Connect 0x18f7687e to 127.0.0.1:50743 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-04-20 02:59:17,908 DEBUG [RS:1;jenkins-hbase4:43007] zookeeper.ReadOnlyZKClient(139): Connect 0x335d010c to 127.0.0.1:50743 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-04-20 02:59:17,913 DEBUG [RS:0;jenkins-hbase4:45079] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@16309510, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-04-20 02:59:17,914 DEBUG [RS:0;jenkins-hbase4:45079] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@120f030e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-04-20 02:59:17,914 DEBUG [RS:1;jenkins-hbase4:43007] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3d9af917, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-04-20 02:59:17,914 DEBUG [RS:1;jenkins-hbase4:43007] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@39a56a7c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-04-20 02:59:17,936 DEBUG [RS:1;jenkins-hbase4:43007] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:1;jenkins-hbase4:43007 2024-04-20 02:59:17,941 DEBUG [RS:0;jenkins-hbase4:45079] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:45079 2024-04-20 02:59:17,943 INFO [RS:1;jenkins-hbase4:43007] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-04-20 02:59:17,943 INFO [RS:0;jenkins-hbase4:45079] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2024-04-20 02:59:17,943 INFO [RS:0;jenkins-hbase4:45079] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-04-20 02:59:17,943 INFO [RS:1;jenkins-hbase4:43007] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2024-04-20 02:59:17,943 DEBUG [RS:0;jenkins-hbase4:45079] regionserver.HRegionServer(1028): About to register with Master. 2024-04-20 02:59:17,943 DEBUG [RS:1;jenkins-hbase4:43007] regionserver.HRegionServer(1028): About to register with Master. 2024-04-20 02:59:17,947 INFO [RS:1;jenkins-hbase4:43007] regionserver.HRegionServer(2820): reportForDuty to master=jenkins-hbase4.apache.org,35099,1713581955774 with isa=jenkins-hbase4.apache.org/172.31.14.131:43007, startcode=1713581956960 2024-04-20 02:59:17,947 INFO [RS:0;jenkins-hbase4:45079] regionserver.HRegionServer(2820): reportForDuty to master=jenkins-hbase4.apache.org,35099,1713581955774 with isa=jenkins-hbase4.apache.org/172.31.14.131:45079, startcode=1713581956918 2024-04-20 02:59:17,964 DEBUG [RS:1;jenkins-hbase4:43007] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-04-20 02:59:17,964 DEBUG [RS:0;jenkins-hbase4:45079] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2024-04-20 02:59:17,969 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2024-04-20 02:59:17,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-04-20 02:59:17,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-04-20 02:59:17,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-04-20 02:59:17,979 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2024-04-20 02:59:17,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2024-04-20 02:59:17,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-20 02:59:17,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-04-20 02:59:17,980 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-20 02:59:17,983 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1713581987982 2024-04-20 02:59:17,985 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2024-04-20 02:59:17,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2024-04-20 02:59:18,002 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2024-04-20 02:59:18,003 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2024-04-20 02:59:18,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2024-04-20 02:59:18,005 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2024-04-20 02:59:18,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2024-04-20 02:59:18,006 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2024-04-20 02:59:18,007 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:18,010 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2024-04-20 02:59:18,010 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-04-20 02:59:18,012 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2024-04-20 02:59:18,012 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2024-04-20 02:59:18,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2024-04-20 02:59:18,017 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2024-04-20 02:59:18,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1713581958019,5,FailOnTimeoutGroup] 2024-04-20 02:59:18,020 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1713581958020,5,FailOnTimeoutGroup] 2024-04-20 02:59:18,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:18,020 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1466): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2024-04-20 02:59:18,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:18,022 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:18,024 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34281, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=RegionServerStatusService 2024-04-20 02:59:18,024 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44885, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2024-04-20 02:59:18,038 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35099] master.ServerManager(404): Registering regionserver=jenkins-hbase4.apache.org,45079,1713581956918 2024-04-20 02:59:18,049 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-04-20 02:59:18,050 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2024-04-20 02:59:18,050 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3 2024-04-20 02:59:18,053 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=35099] master.ServerManager(404): Registering regionserver=jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 02:59:18,062 DEBUG [RS:1;jenkins-hbase4:43007] regionserver.HRegionServer(1601): Config from master: hbase.rootdir=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3 2024-04-20 02:59:18,062 DEBUG [RS:0;jenkins-hbase4:45079] regionserver.HRegionServer(1601): Config from master: hbase.rootdir=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3 2024-04-20 02:59:18,062 DEBUG [RS:1;jenkins-hbase4:43007] regionserver.HRegionServer(1601): Config from master: fs.defaultFS=hdfs://localhost:38043 2024-04-20 02:59:18,062 DEBUG [RS:0;jenkins-hbase4:45079] regionserver.HRegionServer(1601): Config from master: fs.defaultFS=hdfs://localhost:38043 2024-04-20 02:59:18,062 DEBUG [RS:1;jenkins-hbase4:43007] regionserver.HRegionServer(1601): Config from master: hbase.master.info.port=-1 2024-04-20 02:59:18,062 DEBUG [RS:0;jenkins-hbase4:45079] regionserver.HRegionServer(1601): Config from master: hbase.master.info.port=-1 2024-04-20 02:59:18,077 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-04-20 02:59:18,078 DEBUG [RS:1;jenkins-hbase4:43007] zookeeper.ZKUtil(163): regionserver:43007-0x1011ed25edb0002, quorum=127.0.0.1:50743, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 02:59:18,078 DEBUG [RS:0;jenkins-hbase4:45079] zookeeper.ZKUtil(163): regionserver:45079-0x1011ed25edb0001, quorum=127.0.0.1:50743, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45079,1713581956918 2024-04-20 02:59:18,079 WARN [RS:0;jenkins-hbase4:45079] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-04-20 02:59:18,078 WARN [RS:1;jenkins-hbase4:43007] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2024-04-20 02:59:18,079 INFO [RS:0;jenkins-hbase4:45079] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-04-20 02:59:18,079 INFO [RS:1;jenkins-hbase4:43007] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-04-20 02:59:18,080 DEBUG [RS:0;jenkins-hbase4:45079] regionserver.HRegionServer(1953): logDir=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/WALs/jenkins-hbase4.apache.org,45079,1713581956918 2024-04-20 02:59:18,080 DEBUG [RS:1;jenkins-hbase4:43007] regionserver.HRegionServer(1953): logDir=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/WALs/jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 02:59:18,081 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-20 02:59:18,082 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,45079,1713581956918] 2024-04-20 02:59:18,083 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,43007,1713581956960] 2024-04-20 02:59:18,089 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-04-20 02:59:18,092 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/meta/1588230740/info 2024-04-20 02:59:18,093 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-04-20 02:59:18,094 DEBUG [RS:1;jenkins-hbase4:43007] zookeeper.ZKUtil(163): regionserver:43007-0x1011ed25edb0002, quorum=127.0.0.1:50743, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45079,1713581956918 2024-04-20 02:59:18,094 DEBUG [RS:0;jenkins-hbase4:45079] zookeeper.ZKUtil(163): regionserver:45079-0x1011ed25edb0001, quorum=127.0.0.1:50743, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,45079,1713581956918 2024-04-20 02:59:18,094 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-20 02:59:18,095 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-04-20 02:59:18,095 DEBUG [RS:1;jenkins-hbase4:43007] zookeeper.ZKUtil(163): regionserver:43007-0x1011ed25edb0002, quorum=127.0.0.1:50743, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 02:59:18,095 DEBUG [RS:0;jenkins-hbase4:45079] zookeeper.ZKUtil(163): regionserver:45079-0x1011ed25edb0001, quorum=127.0.0.1:50743, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 02:59:18,099 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/meta/1588230740/rep_barrier 2024-04-20 02:59:18,099 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-04-20 02:59:18,100 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-20 02:59:18,100 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-04-20 02:59:18,103 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/meta/1588230740/table 2024-04-20 02:59:18,103 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-04-20 02:59:18,104 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-20 02:59:18,106 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/meta/1588230740 2024-04-20 02:59:18,107 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/meta/1588230740 2024-04-20 02:59:18,108 DEBUG [RS:0;jenkins-hbase4:45079] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-04-20 02:59:18,108 DEBUG [RS:1;jenkins-hbase4:43007] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2024-04-20 02:59:18,112 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-04-20 02:59:18,115 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2024-04-20 02:59:18,119 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-20 02:59:18,119 INFO [RS:1;jenkins-hbase4:43007] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-04-20 02:59:18,119 INFO [RS:0;jenkins-hbase4:45079] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2024-04-20 02:59:18,120 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61148239, jitterRate=-0.08882023394107819}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-04-20 02:59:18,120 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2024-04-20 02:59:18,120 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-04-20 02:59:18,120 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-04-20 02:59:18,120 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-04-20 02:59:18,120 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-04-20 02:59:18,120 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-04-20 02:59:18,121 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-04-20 02:59:18,122 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-04-20 02:59:18,126 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2024-04-20 02:59:18,127 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2024-04-20 02:59:18,134 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2024-04-20 02:59:18,138 INFO [RS:0;jenkins-hbase4:45079] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-04-20 02:59:18,138 INFO [RS:1;jenkins-hbase4:43007] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2024-04-20 02:59:18,142 INFO [RS:1;jenkins-hbase4:43007] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-04-20 02:59:18,142 INFO [RS:0;jenkins-hbase4:45079] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2024-04-20 02:59:18,143 INFO [RS:1;jenkins-hbase4:43007] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:18,143 INFO [RS:0;jenkins-hbase4:45079] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:18,144 INFO [RS:0;jenkins-hbase4:45079] regionserver.HRegionServer$CompactionChecker(1843): CompactionChecker runs every PT1S 2024-04-20 02:59:18,144 INFO [RS:1;jenkins-hbase4:43007] regionserver.HRegionServer$CompactionChecker(1843): CompactionChecker runs every PT1S 2024-04-20 02:59:18,147 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2024-04-20 02:59:18,149 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2024-04-20 02:59:18,152 INFO [RS:0;jenkins-hbase4:45079] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:18,152 INFO [RS:1;jenkins-hbase4:43007] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:18,153 DEBUG [RS:0;jenkins-hbase4:45079] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-20 02:59:18,153 DEBUG [RS:1;jenkins-hbase4:43007] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-20 02:59:18,153 DEBUG [RS:0;jenkins-hbase4:45079] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-20 02:59:18,153 DEBUG [RS:1;jenkins-hbase4:43007] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-20 02:59:18,153 DEBUG [RS:0;jenkins-hbase4:45079] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-20 02:59:18,153 DEBUG [RS:1;jenkins-hbase4:43007] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-20 02:59:18,153 DEBUG [RS:0;jenkins-hbase4:45079] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-20 02:59:18,153 DEBUG [RS:1;jenkins-hbase4:43007] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-20 02:59:18,153 DEBUG [RS:0;jenkins-hbase4:45079] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-20 02:59:18,153 DEBUG [RS:1;jenkins-hbase4:43007] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-20 02:59:18,153 DEBUG [RS:0;jenkins-hbase4:45079] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-04-20 02:59:18,154 DEBUG [RS:1;jenkins-hbase4:43007] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2024-04-20 02:59:18,154 DEBUG [RS:0;jenkins-hbase4:45079] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-20 02:59:18,154 DEBUG [RS:1;jenkins-hbase4:43007] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-20 02:59:18,154 DEBUG [RS:0;jenkins-hbase4:45079] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-20 02:59:18,154 DEBUG [RS:1;jenkins-hbase4:43007] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-20 02:59:18,154 DEBUG [RS:0;jenkins-hbase4:45079] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-20 02:59:18,154 DEBUG [RS:1;jenkins-hbase4:43007] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-20 02:59:18,154 DEBUG [RS:0;jenkins-hbase4:45079] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-20 02:59:18,154 DEBUG [RS:1;jenkins-hbase4:43007] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2024-04-20 02:59:18,155 INFO [RS:1;jenkins-hbase4:43007] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:18,155 INFO [RS:1;jenkins-hbase4:43007] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:18,156 INFO [RS:1;jenkins-hbase4:43007] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:18,156 INFO [RS:1;jenkins-hbase4:43007] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:18,156 INFO [RS:0;jenkins-hbase4:45079] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:18,156 INFO [RS:0;jenkins-hbase4:45079] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:18,156 INFO [RS:0;jenkins-hbase4:45079] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:18,156 INFO [RS:0;jenkins-hbase4:45079] hbase.ChoreService(166): Chore ScheduledChore name=FileSystemUtilizationChore, period=300000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:18,172 INFO [RS:0;jenkins-hbase4:45079] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-04-20 02:59:18,172 INFO [RS:1;jenkins-hbase4:43007] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2024-04-20 02:59:18,175 INFO [RS:1;jenkins-hbase4:43007] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43007,1713581956960-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:18,175 INFO [RS:0;jenkins-hbase4:45079] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,45079,1713581956918-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:18,196 INFO [RS:1;jenkins-hbase4:43007] regionserver.Replication(203): jenkins-hbase4.apache.org,43007,1713581956960 started 2024-04-20 02:59:18,196 INFO [RS:0;jenkins-hbase4:45079] regionserver.Replication(203): jenkins-hbase4.apache.org,45079,1713581956918 started 2024-04-20 02:59:18,197 INFO [RS:1;jenkins-hbase4:43007] regionserver.HRegionServer(1643): Serving as jenkins-hbase4.apache.org,43007,1713581956960, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:43007, sessionid=0x1011ed25edb0002 2024-04-20 02:59:18,197 INFO [RS:0;jenkins-hbase4:45079] regionserver.HRegionServer(1643): Serving as jenkins-hbase4.apache.org,45079,1713581956918, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:45079, sessionid=0x1011ed25edb0001 2024-04-20 02:59:18,197 DEBUG [RS:0;jenkins-hbase4:45079] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-04-20 02:59:18,197 DEBUG [RS:1;jenkins-hbase4:43007] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2024-04-20 02:59:18,197 DEBUG [RS:0;jenkins-hbase4:45079] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,45079,1713581956918 2024-04-20 02:59:18,197 DEBUG [RS:1;jenkins-hbase4:43007] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 02:59:18,198 DEBUG [RS:0;jenkins-hbase4:45079] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45079,1713581956918' 2024-04-20 02:59:18,198 DEBUG [RS:1;jenkins-hbase4:43007] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43007,1713581956960' 2024-04-20 02:59:18,198 DEBUG [RS:1;jenkins-hbase4:43007] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-04-20 02:59:18,198 DEBUG [RS:0;jenkins-hbase4:45079] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2024-04-20 02:59:18,199 DEBUG [RS:1;jenkins-hbase4:43007] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-04-20 02:59:18,199 DEBUG [RS:0;jenkins-hbase4:45079] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2024-04-20 02:59:18,200 DEBUG [RS:1;jenkins-hbase4:43007] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-04-20 02:59:18,200 DEBUG [RS:0;jenkins-hbase4:45079] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2024-04-20 02:59:18,200 DEBUG [RS:1;jenkins-hbase4:43007] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-04-20 02:59:18,200 DEBUG [RS:0;jenkins-hbase4:45079] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2024-04-20 02:59:18,201 DEBUG [RS:1;jenkins-hbase4:43007] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 02:59:18,201 DEBUG [RS:0;jenkins-hbase4:45079] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,45079,1713581956918 2024-04-20 02:59:18,201 DEBUG [RS:0;jenkins-hbase4:45079] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,45079,1713581956918' 2024-04-20 02:59:18,201 DEBUG [RS:0;jenkins-hbase4:45079] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-04-20 02:59:18,201 DEBUG [RS:1;jenkins-hbase4:43007] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,43007,1713581956960' 2024-04-20 02:59:18,201 DEBUG [RS:1;jenkins-hbase4:43007] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2024-04-20 02:59:18,202 DEBUG [RS:0;jenkins-hbase4:45079] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-04-20 02:59:18,203 DEBUG [RS:0;jenkins-hbase4:45079] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-04-20 02:59:18,203 DEBUG [RS:1;jenkins-hbase4:43007] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2024-04-20 02:59:18,203 INFO [RS:0;jenkins-hbase4:45079] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-04-20 02:59:18,204 DEBUG [RS:1;jenkins-hbase4:43007] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2024-04-20 02:59:18,204 INFO [RS:1;jenkins-hbase4:43007] quotas.RegionServerRpcQuotaManager(67): Initializing RPC quota support 2024-04-20 02:59:18,206 INFO [RS:0;jenkins-hbase4:45079] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:18,206 INFO [RS:1;jenkins-hbase4:43007] hbase.ChoreService(166): Chore ScheduledChore name=QuotaRefresherChore, period=1800000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:18,207 DEBUG [RS:0;jenkins-hbase4:45079] zookeeper.ZKUtil(399): regionserver:45079-0x1011ed25edb0001, quorum=127.0.0.1:50743, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-04-20 02:59:18,207 INFO [RS:0;jenkins-hbase4:45079] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-04-20 02:59:18,207 DEBUG [RS:1;jenkins-hbase4:43007] zookeeper.ZKUtil(399): regionserver:43007-0x1011ed25edb0002, quorum=127.0.0.1:50743, baseZNode=/hbase Unable to get data of znode /hbase/rpc-throttle because node does not exist (not an error) 2024-04-20 02:59:18,207 INFO [RS:1;jenkins-hbase4:43007] quotas.RegionServerRpcQuotaManager(73): Start rpc quota manager and rpc throttle enabled is true 2024-04-20 02:59:18,207 INFO [RS:0;jenkins-hbase4:45079] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:18,207 INFO [RS:1;jenkins-hbase4:43007] hbase.ChoreService(166): Chore ScheduledChore name=SpaceQuotaRefresherChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:18,208 INFO [RS:0;jenkins-hbase4:45079] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:18,208 INFO [RS:1;jenkins-hbase4:43007] hbase.ChoreService(166): Chore ScheduledChore name=RegionSizeReportingChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:18,301 DEBUG [jenkins-hbase4:35099] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=2, allServersCount=2 2024-04-20 02:59:18,305 DEBUG [jenkins-hbase4:35099] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-04-20 02:59:18,311 DEBUG [jenkins-hbase4:35099] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-04-20 02:59:18,311 DEBUG [jenkins-hbase4:35099] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-04-20 02:59:18,311 DEBUG [jenkins-hbase4:35099] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-04-20 02:59:18,314 INFO [PEWorker-4] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43007,1713581956960, state=OPENING 2024-04-20 02:59:18,322 INFO [RS:1;jenkins-hbase4:43007] wal.AbstractFSWAL(492): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43007%2C1713581956960, suffix=, logDir=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/WALs/jenkins-hbase4.apache.org,43007,1713581956960, archiveDir=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/oldWALs, maxLogs=32 2024-04-20 02:59:18,322 INFO [RS:0;jenkins-hbase4:45079] wal.AbstractFSWAL(492): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C45079%2C1713581956918, suffix=, logDir=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/WALs/jenkins-hbase4.apache.org,45079,1713581956918, archiveDir=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/oldWALs, maxLogs=32 2024-04-20 02:59:18,324 DEBUG [PEWorker-4] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2024-04-20 02:59:18,327 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-20 02:59:18,328 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-04-20 02:59:18,337 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43007,1713581956960}] 2024-04-20 02:59:18,346 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39697,DS-d2abdbee-4573-4054-8416-a8fc5a70dc06,DISK] 2024-04-20 02:59:18,347 DEBUG [RS-EventLoopGroup-4-3] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41859,DS-cce640c4-47dd-40cb-97e8-11c69db6e4c9,DISK] 2024-04-20 02:59:18,350 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39697,DS-d2abdbee-4573-4054-8416-a8fc5a70dc06,DISK] 2024-04-20 02:59:18,350 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41859,DS-cce640c4-47dd-40cb-97e8-11c69db6e4c9,DISK] 2024-04-20 02:59:18,375 INFO [RS:0;jenkins-hbase4:45079] wal.AbstractFSWAL(809): New WAL /user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/WALs/jenkins-hbase4.apache.org,45079,1713581956918/jenkins-hbase4.apache.org%2C45079%2C1713581956918.1713581958326 2024-04-20 02:59:18,375 INFO [RS:1;jenkins-hbase4:43007] wal.AbstractFSWAL(809): New WAL /user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/WALs/jenkins-hbase4.apache.org,43007,1713581956960/jenkins-hbase4.apache.org%2C43007%2C1713581956960.1713581958326 2024-04-20 02:59:18,375 DEBUG [RS:0;jenkins-hbase4:45079] wal.AbstractFSWAL(890): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39697,DS-d2abdbee-4573-4054-8416-a8fc5a70dc06,DISK], DatanodeInfoWithStorage[127.0.0.1:41859,DS-cce640c4-47dd-40cb-97e8-11c69db6e4c9,DISK]] 2024-04-20 02:59:18,375 DEBUG [RS:1;jenkins-hbase4:43007] wal.AbstractFSWAL(890): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39697,DS-d2abdbee-4573-4054-8416-a8fc5a70dc06,DISK], DatanodeInfoWithStorage[127.0.0.1:41859,DS-cce640c4-47dd-40cb-97e8-11c69db6e4c9,DISK]] 2024-04-20 02:59:18,545 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 02:59:18,548 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-04-20 02:59:18,551 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42690, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-04-20 02:59:18,563 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2024-04-20 02:59:18,563 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2024-04-20 02:59:18,567 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(492): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43007%2C1713581956960.meta, suffix=.meta, logDir=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/WALs/jenkins-hbase4.apache.org,43007,1713581956960, archiveDir=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/oldWALs, maxLogs=32 2024-04-20 02:59:18,583 DEBUG [RS-EventLoopGroup-4-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:39697,DS-d2abdbee-4573-4054-8416-a8fc5a70dc06,DISK] 2024-04-20 02:59:18,584 DEBUG [RS-EventLoopGroup-4-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:41859,DS-cce640c4-47dd-40cb-97e8-11c69db6e4c9,DISK] 2024-04-20 02:59:18,591 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(809): New WAL /user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/WALs/jenkins-hbase4.apache.org,43007,1713581956960/jenkins-hbase4.apache.org%2C43007%2C1713581956960.meta.1713581958568.meta 2024-04-20 02:59:18,594 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(890): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:39697,DS-d2abdbee-4573-4054-8416-a8fc5a70dc06,DISK], DatanodeInfoWithStorage[127.0.0.1:41859,DS-cce640c4-47dd-40cb-97e8-11c69db6e4c9,DISK]] 2024-04-20 02:59:18,594 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2024-04-20 02:59:18,596 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2024-04-20 02:59:18,612 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2024-04-20 02:59:18,616 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2024-04-20 02:59:18,621 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2024-04-20 02:59:18,622 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-20 02:59:18,622 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2024-04-20 02:59:18,622 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2024-04-20 02:59:18,625 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2024-04-20 02:59:18,627 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/meta/1588230740/info 2024-04-20 02:59:18,627 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/meta/1588230740/info 2024-04-20 02:59:18,628 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2024-04-20 02:59:18,629 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-20 02:59:18,629 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2024-04-20 02:59:18,631 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/meta/1588230740/rep_barrier 2024-04-20 02:59:18,631 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/meta/1588230740/rep_barrier 2024-04-20 02:59:18,633 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2024-04-20 02:59:18,634 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-20 02:59:18,635 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2024-04-20 02:59:18,636 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/meta/1588230740/table 2024-04-20 02:59:18,637 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/meta/1588230740/table 2024-04-20 02:59:18,637 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2024-04-20 02:59:18,638 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-20 02:59:18,641 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/meta/1588230740 2024-04-20 02:59:18,644 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/meta/1588230740 2024-04-20 02:59:18,649 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2024-04-20 02:59:18,652 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2024-04-20 02:59:18,654 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67760234, jitterRate=0.009706169366836548}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2024-04-20 02:59:18,655 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2024-04-20 02:59:18,667 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2345): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1713581958538 2024-04-20 02:59:18,687 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2372): Finished post open deploy task for hbase:meta,,1.1588230740 2024-04-20 02:59:18,688 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2024-04-20 02:59:18,688 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,43007,1713581956960, state=OPEN 2024-04-20 02:59:18,692 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2024-04-20 02:59:18,692 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2024-04-20 02:59:18,698 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=3, resume processing ppid=2 2024-04-20 02:59:18,699 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,43007,1713581956960 in 355 msec 2024-04-20 02:59:18,708 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=2, resume processing ppid=1 2024-04-20 02:59:18,708 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 565 msec 2024-04-20 02:59:18,717 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 817 msec 2024-04-20 02:59:18,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(954): Wait for region servers to report in: status=null, state=RUNNING, startTime=1713581958717, completionTime=-1 2024-04-20 02:59:18,717 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(824): Finished waiting on RegionServer count=2; waited=0ms, expected min=2 server(s), max=2 server(s), master is running 2024-04-20 02:59:18,718 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2024-04-20 02:59:18,788 DEBUG [hconnection-0xb4431c2-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-04-20 02:59:18,792 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42692, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-04-20 02:59:18,808 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=2 2024-04-20 02:59:18,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1713582018809 2024-04-20 02:59:18,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1713582078809 2024-04-20 02:59:18,809 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 90 msec 2024-04-20 02:59:18,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35099,1713581955774-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:18,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35099,1713581955774-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:18,834 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35099,1713581955774-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:18,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:35099, period=300000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:18,836 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:18,842 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2024-04-20 02:59:18,850 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2024-04-20 02:59:18,851 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2024-04-20 02:59:18,860 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2024-04-20 02:59:18,863 INFO [PEWorker-4] procedure.CreateTableProcedure(82): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2024-04-20 02:59:18,865 INFO [PEWorker-4] procedure.CreateTableProcedure(82): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-04-20 02:59:18,885 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/hbase/namespace/6f97c96a34d5ef54189957174fac767e 2024-04-20 02:59:18,887 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/hbase/namespace/6f97c96a34d5ef54189957174fac767e empty. 2024-04-20 02:59:18,888 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/hbase/namespace/6f97c96a34d5ef54189957174fac767e 2024-04-20 02:59:18,888 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2024-04-20 02:59:18,929 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2024-04-20 02:59:18,932 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => 6f97c96a34d5ef54189957174fac767e, NAME => 'hbase:namespace,,1713581958851.6f97c96a34d5ef54189957174fac767e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp 2024-04-20 02:59:18,951 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1713581958851.6f97c96a34d5ef54189957174fac767e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-20 02:59:18,951 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing 6f97c96a34d5ef54189957174fac767e, disabling compactions & flushes 2024-04-20 02:59:18,951 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1713581958851.6f97c96a34d5ef54189957174fac767e. 2024-04-20 02:59:18,951 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1713581958851.6f97c96a34d5ef54189957174fac767e. 2024-04-20 02:59:18,951 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1713581958851.6f97c96a34d5ef54189957174fac767e. after waiting 0 ms 2024-04-20 02:59:18,951 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1713581958851.6f97c96a34d5ef54189957174fac767e. 2024-04-20 02:59:18,951 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1713581958851.6f97c96a34d5ef54189957174fac767e. 2024-04-20 02:59:18,952 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for 6f97c96a34d5ef54189957174fac767e: 2024-04-20 02:59:18,956 INFO [PEWorker-4] procedure.CreateTableProcedure(82): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2024-04-20 02:59:18,971 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1713581958851.6f97c96a34d5ef54189957174fac767e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1713581958959"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713581958959"}]},"ts":"1713581958959"} 2024-04-20 02:59:18,997 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-04-20 02:59:18,999 INFO [PEWorker-4] procedure.CreateTableProcedure(82): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-04-20 02:59:19,003 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713581958999"}]},"ts":"1713581958999"} 2024-04-20 02:59:19,008 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2024-04-20 02:59:19,014 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-04-20 02:59:19,016 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-04-20 02:59:19,016 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-04-20 02:59:19,016 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-04-20 02:59:19,018 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6f97c96a34d5ef54189957174fac767e, ASSIGN}] 2024-04-20 02:59:19,021 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=6f97c96a34d5ef54189957174fac767e, ASSIGN 2024-04-20 02:59:19,023 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=6f97c96a34d5ef54189957174fac767e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43007,1713581956960; forceNewPlan=false, retain=false 2024-04-20 02:59:19,176 INFO [jenkins-hbase4:35099] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-04-20 02:59:19,177 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6f97c96a34d5ef54189957174fac767e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 02:59:19,177 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1713581958851.6f97c96a34d5ef54189957174fac767e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1713581959176"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713581959176"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713581959176"}]},"ts":"1713581959176"} 2024-04-20 02:59:19,181 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure 6f97c96a34d5ef54189957174fac767e, server=jenkins-hbase4.apache.org,43007,1713581956960}] 2024-04-20 02:59:19,335 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 02:59:19,342 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1713581958851.6f97c96a34d5ef54189957174fac767e. 2024-04-20 02:59:19,343 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 6f97c96a34d5ef54189957174fac767e, NAME => 'hbase:namespace,,1713581958851.6f97c96a34d5ef54189957174fac767e.', STARTKEY => '', ENDKEY => ''} 2024-04-20 02:59:19,344 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace 6f97c96a34d5ef54189957174fac767e 2024-04-20 02:59:19,344 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1713581958851.6f97c96a34d5ef54189957174fac767e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-20 02:59:19,344 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 6f97c96a34d5ef54189957174fac767e 2024-04-20 02:59:19,344 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 6f97c96a34d5ef54189957174fac767e 2024-04-20 02:59:19,346 INFO [StoreOpener-6f97c96a34d5ef54189957174fac767e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 6f97c96a34d5ef54189957174fac767e 2024-04-20 02:59:19,349 DEBUG [StoreOpener-6f97c96a34d5ef54189957174fac767e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/namespace/6f97c96a34d5ef54189957174fac767e/info 2024-04-20 02:59:19,349 DEBUG [StoreOpener-6f97c96a34d5ef54189957174fac767e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/namespace/6f97c96a34d5ef54189957174fac767e/info 2024-04-20 02:59:19,350 INFO [StoreOpener-6f97c96a34d5ef54189957174fac767e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 6f97c96a34d5ef54189957174fac767e columnFamilyName info 2024-04-20 02:59:19,350 INFO [StoreOpener-6f97c96a34d5ef54189957174fac767e-1] regionserver.HStore(310): Store=6f97c96a34d5ef54189957174fac767e/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-20 02:59:19,352 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/namespace/6f97c96a34d5ef54189957174fac767e 2024-04-20 02:59:19,353 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/namespace/6f97c96a34d5ef54189957174fac767e 2024-04-20 02:59:19,358 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 6f97c96a34d5ef54189957174fac767e 2024-04-20 02:59:19,363 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/namespace/6f97c96a34d5ef54189957174fac767e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-20 02:59:19,363 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 6f97c96a34d5ef54189957174fac767e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62705475, jitterRate=-0.06561560928821564}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-04-20 02:59:19,364 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 6f97c96a34d5ef54189957174fac767e: 2024-04-20 02:59:19,365 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2345): Post open deploy tasks for hbase:namespace,,1713581958851.6f97c96a34d5ef54189957174fac767e., pid=6, masterSystemTime=1713581959335 2024-04-20 02:59:19,370 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2372): Finished post open deploy task for hbase:namespace,,1713581958851.6f97c96a34d5ef54189957174fac767e. 2024-04-20 02:59:19,370 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1713581958851.6f97c96a34d5ef54189957174fac767e. 2024-04-20 02:59:19,371 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=6f97c96a34d5ef54189957174fac767e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 02:59:19,371 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1713581958851.6f97c96a34d5ef54189957174fac767e.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1713581959371"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1713581959371"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1713581959371"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1713581959371"}]},"ts":"1713581959371"} 2024-04-20 02:59:19,379 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=6, resume processing ppid=5 2024-04-20 02:59:19,379 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure 6f97c96a34d5ef54189957174fac767e, server=jenkins-hbase4.apache.org,43007,1713581956960 in 194 msec 2024-04-20 02:59:19,383 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=5, resume processing ppid=4 2024-04-20 02:59:19,384 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=6f97c96a34d5ef54189957174fac767e, ASSIGN in 361 msec 2024-04-20 02:59:19,385 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-04-20 02:59:19,385 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713581959385"}]},"ts":"1713581959385"} 2024-04-20 02:59:19,388 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2024-04-20 02:59:19,392 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2024-04-20 02:59:19,395 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 540 msec 2024-04-20 02:59:19,463 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2024-04-20 02:59:19,465 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2024-04-20 02:59:19,465 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-20 02:59:19,497 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2024-04-20 02:59:19,515 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-04-20 02:59:19,521 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 30 msec 2024-04-20 02:59:19,531 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2024-04-20 02:59:19,542 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-04-20 02:59:19,547 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 16 msec 2024-04-20 02:59:19,557 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2024-04-20 02:59:19,560 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2024-04-20 02:59:19,560 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1084): Master has completed initialization 2.542sec 2024-04-20 02:59:19,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(103): Quota table not found. Creating... 2024-04-20 02:59:19,563 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2154): Client=null/null create 'hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-04-20 02:59:19,564 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:quota 2024-04-20 02:59:19,564 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(107): Initializing quota support 2024-04-20 02:59:19,567 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_PRE_OPERATION 2024-04-20 02:59:19,567 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(59): Namespace State Manager started. 2024-04-20 02:59:19,568 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-04-20 02:59:19,571 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/hbase/quota/a77ab8549b52a7b4adb27fc00548978e 2024-04-20 02:59:19,572 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/hbase/quota/a77ab8549b52a7b4adb27fc00548978e empty. 2024-04-20 02:59:19,574 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/hbase/quota/a77ab8549b52a7b4adb27fc00548978e 2024-04-20 02:59:19,574 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived hbase:quota regions 2024-04-20 02:59:19,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceStateManager(222): Finished updating state of 2 namespaces. 2024-04-20 02:59:19,575 INFO [master/jenkins-hbase4:0:becomeActiveMaster] namespace.NamespaceAuditor(50): NamespaceAuditor started. 2024-04-20 02:59:19,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:19,577 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=QuotaObserverChore, period=300000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:19,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2024-04-20 02:59:19,579 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2024-04-20 02:59:19,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35099,1713581955774-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2024-04-20 02:59:19,581 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35099,1713581955774-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2024-04-20 02:59:19,594 DEBUG [Listener at localhost/35709] zookeeper.ReadOnlyZKClient(139): Connect 0x57016e43 to 127.0.0.1:50743 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2024-04-20 02:59:19,595 WARN [DataStreamer for file /user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/hbase/quota/.tmp/.tableinfo.0000000001] hdfs.DataStreamer(982): Caught exception java.lang.InterruptedException at java.lang.Object.wait(Native Method) at java.lang.Thread.join(Thread.java:1257) at java.lang.Thread.join(Thread.java:1331) at org.apache.hadoop.hdfs.DataStreamer.closeResponder(DataStreamer.java:980) at org.apache.hadoop.hdfs.DataStreamer.endBlock(DataStreamer.java:630) at org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:807) 2024-04-20 02:59:19,596 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1176): Balancer post startup initialization complete, took 0 seconds 2024-04-20 02:59:19,596 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,35099,1713581955774-OldWALsDirSizeChore, period=300000, unit=MILLISECONDS is enabled. 2024-04-20 02:59:19,598 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/hbase/quota/.tabledesc/.tableinfo.0000000001 2024-04-20 02:59:19,601 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(7675): creating {ENCODED => a77ab8549b52a7b4adb27fc00548978e, NAME => 'hbase:quota,,1713581959563.a77ab8549b52a7b4adb27fc00548978e.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:quota', {NAME => 'q', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'u', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp 2024-04-20 02:59:19,604 DEBUG [Listener at localhost/35709] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@7310d836, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2024-04-20 02:59:19,624 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(866): Instantiated hbase:quota,,1713581959563.a77ab8549b52a7b4adb27fc00548978e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-20 02:59:19,625 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1604): Closing a77ab8549b52a7b4adb27fc00548978e, disabling compactions & flushes 2024-04-20 02:59:19,625 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1626): Closing region hbase:quota,,1713581959563.a77ab8549b52a7b4adb27fc00548978e. 2024-04-20 02:59:19,625 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1713581959563.a77ab8549b52a7b4adb27fc00548978e. 2024-04-20 02:59:19,625 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1713581959563.a77ab8549b52a7b4adb27fc00548978e. after waiting 0 ms 2024-04-20 02:59:19,625 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1713581959563.a77ab8549b52a7b4adb27fc00548978e. 2024-04-20 02:59:19,625 INFO [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1838): Closed hbase:quota,,1713581959563.a77ab8549b52a7b4adb27fc00548978e. 2024-04-20 02:59:19,625 DEBUG [RegionOpenAndInit-hbase:quota-pool-0] regionserver.HRegion(1558): Region close journal for a77ab8549b52a7b4adb27fc00548978e: 2024-04-20 02:59:19,627 DEBUG [hconnection-0x52cb5591-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-04-20 02:59:19,630 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ADD_TO_META 2024-04-20 02:59:19,631 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:quota,,1713581959563.a77ab8549b52a7b4adb27fc00548978e.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1713581959631"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713581959631"}]},"ts":"1713581959631"} 2024-04-20 02:59:19,634 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-04-20 02:59:19,636 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-04-20 02:59:19,636 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713581959636"}]},"ts":"1713581959636"} 2024-04-20 02:59:19,639 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLING in hbase:meta 2024-04-20 02:59:19,642 INFO [RS-EventLoopGroup-4-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42696, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-04-20 02:59:19,650 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-04-20 02:59:19,652 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-04-20 02:59:19,652 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-04-20 02:59:19,652 DEBUG [PEWorker-2] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-04-20 02:59:19,652 INFO [Listener at localhost/35709] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,35099,1713581955774 2024-04-20 02:59:19,652 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=a77ab8549b52a7b4adb27fc00548978e, ASSIGN}] 2024-04-20 02:59:19,653 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 02:59:19,655 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:quota, region=a77ab8549b52a7b4adb27fc00548978e, ASSIGN 2024-04-20 02:59:19,656 DEBUG [Listener at localhost/35709] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-04-20 02:59:19,656 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:quota, region=a77ab8549b52a7b4adb27fc00548978e, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43007,1713581956960; forceNewPlan=false, retain=false 2024-04-20 02:59:19,758 DEBUG [Listener at localhost/35709] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-04-20 02:59:19,807 INFO [jenkins-hbase4:35099] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-04-20 02:59:19,807 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=a77ab8549b52a7b4adb27fc00548978e, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 02:59:19,808 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:quota,,1713581959563.a77ab8549b52a7b4adb27fc00548978e.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1713581959807"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713581959807"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713581959807"}]},"ts":"1713581959807"} 2024-04-20 02:59:19,811 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure a77ab8549b52a7b4adb27fc00548978e, server=jenkins-hbase4.apache.org,43007,1713581956960}] 2024-04-20 02:59:19,860 DEBUG [Listener at localhost/35709] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-04-20 02:59:19,962 DEBUG [Listener at localhost/35709] client.ConnectionImplementation(716): Table hbase:quota not enabled 2024-04-20 02:59:19,965 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 02:59:19,970 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:quota,,1713581959563.a77ab8549b52a7b4adb27fc00548978e. 2024-04-20 02:59:19,970 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a77ab8549b52a7b4adb27fc00548978e, NAME => 'hbase:quota,,1713581959563.a77ab8549b52a7b4adb27fc00548978e.', STARTKEY => '', ENDKEY => ''} 2024-04-20 02:59:19,971 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table quota a77ab8549b52a7b4adb27fc00548978e 2024-04-20 02:59:19,971 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:quota,,1713581959563.a77ab8549b52a7b4adb27fc00548978e.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-20 02:59:19,971 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a77ab8549b52a7b4adb27fc00548978e 2024-04-20 02:59:19,971 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a77ab8549b52a7b4adb27fc00548978e 2024-04-20 02:59:19,973 INFO [StoreOpener-a77ab8549b52a7b4adb27fc00548978e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family q of region a77ab8549b52a7b4adb27fc00548978e 2024-04-20 02:59:19,975 DEBUG [StoreOpener-a77ab8549b52a7b4adb27fc00548978e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/quota/a77ab8549b52a7b4adb27fc00548978e/q 2024-04-20 02:59:19,975 DEBUG [StoreOpener-a77ab8549b52a7b4adb27fc00548978e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/quota/a77ab8549b52a7b4adb27fc00548978e/q 2024-04-20 02:59:19,976 INFO [StoreOpener-a77ab8549b52a7b4adb27fc00548978e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a77ab8549b52a7b4adb27fc00548978e columnFamilyName q 2024-04-20 02:59:19,977 INFO [StoreOpener-a77ab8549b52a7b4adb27fc00548978e-1] regionserver.HStore(310): Store=a77ab8549b52a7b4adb27fc00548978e/q, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-20 02:59:19,977 INFO [StoreOpener-a77ab8549b52a7b4adb27fc00548978e-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family u of region a77ab8549b52a7b4adb27fc00548978e 2024-04-20 02:59:19,979 DEBUG [StoreOpener-a77ab8549b52a7b4adb27fc00548978e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/quota/a77ab8549b52a7b4adb27fc00548978e/u 2024-04-20 02:59:19,979 DEBUG [StoreOpener-a77ab8549b52a7b4adb27fc00548978e-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/quota/a77ab8549b52a7b4adb27fc00548978e/u 2024-04-20 02:59:19,980 INFO [StoreOpener-a77ab8549b52a7b4adb27fc00548978e-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a77ab8549b52a7b4adb27fc00548978e columnFamilyName u 2024-04-20 02:59:19,980 INFO [StoreOpener-a77ab8549b52a7b4adb27fc00548978e-1] regionserver.HStore(310): Store=a77ab8549b52a7b4adb27fc00548978e/u, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-20 02:59:19,982 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/quota/a77ab8549b52a7b4adb27fc00548978e 2024-04-20 02:59:19,983 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/quota/a77ab8549b52a7b4adb27fc00548978e 2024-04-20 02:59:19,986 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:quota descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2024-04-20 02:59:19,988 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a77ab8549b52a7b4adb27fc00548978e 2024-04-20 02:59:19,991 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/quota/a77ab8549b52a7b4adb27fc00548978e/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-20 02:59:19,992 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a77ab8549b52a7b4adb27fc00548978e; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73341270, jitterRate=0.0928700864315033}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2024-04-20 02:59:19,992 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a77ab8549b52a7b4adb27fc00548978e: 2024-04-20 02:59:19,993 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2345): Post open deploy tasks for hbase:quota,,1713581959563.a77ab8549b52a7b4adb27fc00548978e., pid=11, masterSystemTime=1713581959965 2024-04-20 02:59:19,996 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2372): Finished post open deploy task for hbase:quota,,1713581959563.a77ab8549b52a7b4adb27fc00548978e. 2024-04-20 02:59:19,996 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:quota,,1713581959563.a77ab8549b52a7b4adb27fc00548978e. 2024-04-20 02:59:19,997 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=a77ab8549b52a7b4adb27fc00548978e, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 02:59:19,997 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:quota,,1713581959563.a77ab8549b52a7b4adb27fc00548978e.","families":{"info":[{"qualifier":"regioninfo","vlen":37,"tag":[],"timestamp":"1713581959997"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1713581959997"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1713581959997"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1713581959997"}]},"ts":"1713581959997"} 2024-04-20 02:59:20,003 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=11, resume processing ppid=10 2024-04-20 02:59:20,003 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure a77ab8549b52a7b4adb27fc00548978e, server=jenkins-hbase4.apache.org,43007,1713581956960 in 189 msec 2024-04-20 02:59:20,007 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=10, resume processing ppid=9 2024-04-20 02:59:20,007 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=hbase:quota, region=a77ab8549b52a7b4adb27fc00548978e, ASSIGN in 351 msec 2024-04-20 02:59:20,008 INFO [PEWorker-4] procedure.CreateTableProcedure(82): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-04-20 02:59:20,008 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:quota","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713581960008"}]},"ts":"1713581960008"} 2024-04-20 02:59:20,010 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:quota, state=ENABLED in hbase:meta 2024-04-20 02:59:20,014 INFO [PEWorker-4] procedure.CreateTableProcedure(82): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:quota execute state=CREATE_TABLE_POST_OPERATION 2024-04-20 02:59:20,017 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=9, state=SUCCESS; CreateTableProcedure table=hbase:quota in 451 msec 2024-04-20 02:59:20,076 DEBUG [Listener at localhost/35709] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-04-20 02:59:20,080 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46964, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2024-04-20 02:59:20,109 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35099] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-04-20 02:59:20,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35099] procedure2.ProcedureExecutor(1075): Stored pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin0 2024-04-20 02:59:20,115 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=12, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_PRE_OPERATION 2024-04-20 02:59:20,117 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=12, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-04-20 02:59:20,120 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35099] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin0" procId is: 12 2024-04-20 02:59:20,121 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/default/TestQuotaAdmin0/76bb885c3f8f7a19b203a07471b7edad 2024-04-20 02:59:20,122 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/default/TestQuotaAdmin0/76bb885c3f8f7a19b203a07471b7edad empty. 2024-04-20 02:59:20,123 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/default/TestQuotaAdmin0/76bb885c3f8f7a19b203a07471b7edad 2024-04-20 02:59:20,123 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-04-20 02:59:20,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-04-20 02:59:20,152 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/default/TestQuotaAdmin0/.tabledesc/.tableinfo.0000000001 2024-04-20 02:59:20,154 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(7675): creating {ENCODED => 76bb885c3f8f7a19b203a07471b7edad, NAME => 'TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin0', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp 2024-04-20 02:59:20,171 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-20 02:59:20,172 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1604): Closing 76bb885c3f8f7a19b203a07471b7edad, disabling compactions & flushes 2024-04-20 02:59:20,172 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad. 2024-04-20 02:59:20,172 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad. 2024-04-20 02:59:20,172 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad. after waiting 0 ms 2024-04-20 02:59:20,172 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad. 2024-04-20 02:59:20,172 INFO [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad. 2024-04-20 02:59:20,172 DEBUG [RegionOpenAndInit-TestQuotaAdmin0-pool-0] regionserver.HRegion(1558): Region close journal for 76bb885c3f8f7a19b203a07471b7edad: 2024-04-20 02:59:20,177 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=12, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ADD_TO_META 2024-04-20 02:59:20,179 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713581960179"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713581960179"}]},"ts":"1713581960179"} 2024-04-20 02:59:20,182 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-04-20 02:59:20,184 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=12, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-04-20 02:59:20,184 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713581960184"}]},"ts":"1713581960184"} 2024-04-20 02:59:20,187 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLING in hbase:meta 2024-04-20 02:59:20,192 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-04-20 02:59:20,193 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-04-20 02:59:20,193 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-04-20 02:59:20,193 DEBUG [PEWorker-3] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-04-20 02:59:20,194 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=76bb885c3f8f7a19b203a07471b7edad, ASSIGN}] 2024-04-20 02:59:20,195 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=76bb885c3f8f7a19b203a07471b7edad, ASSIGN 2024-04-20 02:59:20,196 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=13, ppid=12, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin0, region=76bb885c3f8f7a19b203a07471b7edad, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43007,1713581956960; forceNewPlan=false, retain=false 2024-04-20 02:59:20,347 INFO [jenkins-hbase4:35099] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-04-20 02:59:20,348 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=76bb885c3f8f7a19b203a07471b7edad, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 02:59:20,348 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713581960348"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713581960348"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713581960348"}]},"ts":"1713581960348"} 2024-04-20 02:59:20,351 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE; OpenRegionProcedure 76bb885c3f8f7a19b203a07471b7edad, server=jenkins-hbase4.apache.org,43007,1713581956960}] 2024-04-20 02:59:20,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-04-20 02:59:20,504 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 02:59:20,510 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad. 2024-04-20 02:59:20,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 76bb885c3f8f7a19b203a07471b7edad, NAME => 'TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad.', STARTKEY => '', ENDKEY => ''} 2024-04-20 02:59:20,510 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin0 76bb885c3f8f7a19b203a07471b7edad 2024-04-20 02:59:20,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-20 02:59:20,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 76bb885c3f8f7a19b203a07471b7edad 2024-04-20 02:59:20,511 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 76bb885c3f8f7a19b203a07471b7edad 2024-04-20 02:59:20,513 INFO [StoreOpener-76bb885c3f8f7a19b203a07471b7edad-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 76bb885c3f8f7a19b203a07471b7edad 2024-04-20 02:59:20,515 DEBUG [StoreOpener-76bb885c3f8f7a19b203a07471b7edad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/default/TestQuotaAdmin0/76bb885c3f8f7a19b203a07471b7edad/cf 2024-04-20 02:59:20,515 DEBUG [StoreOpener-76bb885c3f8f7a19b203a07471b7edad-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/default/TestQuotaAdmin0/76bb885c3f8f7a19b203a07471b7edad/cf 2024-04-20 02:59:20,515 INFO [StoreOpener-76bb885c3f8f7a19b203a07471b7edad-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 76bb885c3f8f7a19b203a07471b7edad columnFamilyName cf 2024-04-20 02:59:20,516 INFO [StoreOpener-76bb885c3f8f7a19b203a07471b7edad-1] regionserver.HStore(310): Store=76bb885c3f8f7a19b203a07471b7edad/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-20 02:59:20,519 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/default/TestQuotaAdmin0/76bb885c3f8f7a19b203a07471b7edad 2024-04-20 02:59:20,520 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/default/TestQuotaAdmin0/76bb885c3f8f7a19b203a07471b7edad 2024-04-20 02:59:20,525 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 76bb885c3f8f7a19b203a07471b7edad 2024-04-20 02:59:20,530 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/default/TestQuotaAdmin0/76bb885c3f8f7a19b203a07471b7edad/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-20 02:59:20,531 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 76bb885c3f8f7a19b203a07471b7edad; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65311176, jitterRate=-0.026787638664245605}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-04-20 02:59:20,531 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 76bb885c3f8f7a19b203a07471b7edad: 2024-04-20 02:59:20,533 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2345): Post open deploy tasks for TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad., pid=14, masterSystemTime=1713581960504 2024-04-20 02:59:20,535 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2372): Finished post open deploy task for TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad. 2024-04-20 02:59:20,535 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad. 2024-04-20 02:59:20,536 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=13 updating hbase:meta row=76bb885c3f8f7a19b203a07471b7edad, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 02:59:20,536 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713581960536"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1713581960536"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1713581960536"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1713581960536"}]},"ts":"1713581960536"} 2024-04-20 02:59:20,542 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=14, resume processing ppid=13 2024-04-20 02:59:20,544 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=14, ppid=13, state=SUCCESS; OpenRegionProcedure 76bb885c3f8f7a19b203a07471b7edad, server=jenkins-hbase4.apache.org,43007,1713581956960 in 188 msec 2024-04-20 02:59:20,546 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=13, resume processing ppid=12 2024-04-20 02:59:20,547 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=13, ppid=12, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=76bb885c3f8f7a19b203a07471b7edad, ASSIGN in 349 msec 2024-04-20 02:59:20,548 INFO [PEWorker-5] procedure.CreateTableProcedure(82): pid=12, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-04-20 02:59:20,548 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713581960548"}]},"ts":"1713581960548"} 2024-04-20 02:59:20,550 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=ENABLED in hbase:meta 2024-04-20 02:59:20,554 INFO [PEWorker-5] procedure.CreateTableProcedure(82): pid=12, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin0 execute state=CREATE_TABLE_POST_OPERATION 2024-04-20 02:59:20,556 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=12, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin0 in 444 msec 2024-04-20 02:59:20,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=12 2024-04-20 02:59:20,887 INFO [Listener at localhost/35709] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin0, procId: 12 completed 2024-04-20 02:59:20,887 DEBUG [Listener at localhost/35709] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin0 get assigned. Timeout = 60000ms 2024-04-20 02:59:20,888 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 02:59:20,892 INFO [Listener at localhost/35709] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin0 assigned to meta. Checking AM states. 2024-04-20 02:59:20,893 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 02:59:20,893 INFO [Listener at localhost/35709] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin0 assigned. 2024-04-20 02:59:20,893 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 02:59:20,907 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-04-20 02:59:20,910 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46978, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.1 (auth:SIMPLE), service=MasterService 2024-04-20 02:59:20,911 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-04-20 02:59:20,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] procedure2.ProcedureExecutor(1075): Stored pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin1 2024-04-20 02:59:20,915 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=15, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_PRE_OPERATION 2024-04-20 02:59:20,916 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin1" procId is: 15 2024-04-20 02:59:20,917 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=15, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-04-20 02:59:20,918 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-04-20 02:59:20,920 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/default/TestQuotaAdmin1/7a1ab58edfbcf60e96d5768bd727001f 2024-04-20 02:59:20,921 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/default/TestQuotaAdmin1/7a1ab58edfbcf60e96d5768bd727001f empty. 2024-04-20 02:59:20,922 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/default/TestQuotaAdmin1/7a1ab58edfbcf60e96d5768bd727001f 2024-04-20 02:59:20,922 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-04-20 02:59:20,942 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/default/TestQuotaAdmin1/.tabledesc/.tableinfo.0000000001 2024-04-20 02:59:20,944 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(7675): creating {ENCODED => 7a1ab58edfbcf60e96d5768bd727001f, NAME => 'TestQuotaAdmin1,,1713581960911.7a1ab58edfbcf60e96d5768bd727001f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin1', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp 2024-04-20 02:59:20,960 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1713581960911.7a1ab58edfbcf60e96d5768bd727001f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-20 02:59:20,960 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1604): Closing 7a1ab58edfbcf60e96d5768bd727001f, disabling compactions & flushes 2024-04-20 02:59:20,960 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1713581960911.7a1ab58edfbcf60e96d5768bd727001f. 2024-04-20 02:59:20,960 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1713581960911.7a1ab58edfbcf60e96d5768bd727001f. 2024-04-20 02:59:20,960 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1713581960911.7a1ab58edfbcf60e96d5768bd727001f. after waiting 0 ms 2024-04-20 02:59:20,960 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1713581960911.7a1ab58edfbcf60e96d5768bd727001f. 2024-04-20 02:59:20,960 INFO [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1713581960911.7a1ab58edfbcf60e96d5768bd727001f. 2024-04-20 02:59:20,960 DEBUG [RegionOpenAndInit-TestQuotaAdmin1-pool-0] regionserver.HRegion(1558): Region close journal for 7a1ab58edfbcf60e96d5768bd727001f: 2024-04-20 02:59:20,964 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=15, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ADD_TO_META 2024-04-20 02:59:20,966 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1713581960911.7a1ab58edfbcf60e96d5768bd727001f.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713581960966"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713581960966"}]},"ts":"1713581960966"} 2024-04-20 02:59:20,970 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-04-20 02:59:20,971 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=15, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-04-20 02:59:20,971 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713581960971"}]},"ts":"1713581960971"} 2024-04-20 02:59:20,974 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLING in hbase:meta 2024-04-20 02:59:20,980 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-04-20 02:59:20,981 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-04-20 02:59:20,981 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-04-20 02:59:20,981 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-04-20 02:59:20,982 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=7a1ab58edfbcf60e96d5768bd727001f, ASSIGN}] 2024-04-20 02:59:20,983 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=7a1ab58edfbcf60e96d5768bd727001f, ASSIGN 2024-04-20 02:59:20,984 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=16, ppid=15, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin1, region=7a1ab58edfbcf60e96d5768bd727001f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43007,1713581956960; forceNewPlan=false, retain=false 2024-04-20 02:59:21,135 INFO [jenkins-hbase4:35099] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-04-20 02:59:21,136 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=7a1ab58edfbcf60e96d5768bd727001f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 02:59:21,136 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1713581960911.7a1ab58edfbcf60e96d5768bd727001f.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713581961136"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713581961136"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713581961136"}]},"ts":"1713581961136"} 2024-04-20 02:59:21,139 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=17, ppid=16, state=RUNNABLE; OpenRegionProcedure 7a1ab58edfbcf60e96d5768bd727001f, server=jenkins-hbase4.apache.org,43007,1713581956960}] 2024-04-20 02:59:21,170 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-04-20 02:59:21,292 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 02:59:21,298 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin1,,1713581960911.7a1ab58edfbcf60e96d5768bd727001f. 2024-04-20 02:59:21,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 7a1ab58edfbcf60e96d5768bd727001f, NAME => 'TestQuotaAdmin1,,1713581960911.7a1ab58edfbcf60e96d5768bd727001f.', STARTKEY => '', ENDKEY => ''} 2024-04-20 02:59:21,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin1 7a1ab58edfbcf60e96d5768bd727001f 2024-04-20 02:59:21,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin1,,1713581960911.7a1ab58edfbcf60e96d5768bd727001f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-20 02:59:21,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 7a1ab58edfbcf60e96d5768bd727001f 2024-04-20 02:59:21,298 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 7a1ab58edfbcf60e96d5768bd727001f 2024-04-20 02:59:21,300 INFO [StoreOpener-7a1ab58edfbcf60e96d5768bd727001f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 7a1ab58edfbcf60e96d5768bd727001f 2024-04-20 02:59:21,303 DEBUG [StoreOpener-7a1ab58edfbcf60e96d5768bd727001f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/default/TestQuotaAdmin1/7a1ab58edfbcf60e96d5768bd727001f/cf 2024-04-20 02:59:21,303 DEBUG [StoreOpener-7a1ab58edfbcf60e96d5768bd727001f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/default/TestQuotaAdmin1/7a1ab58edfbcf60e96d5768bd727001f/cf 2024-04-20 02:59:21,304 INFO [StoreOpener-7a1ab58edfbcf60e96d5768bd727001f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 7a1ab58edfbcf60e96d5768bd727001f columnFamilyName cf 2024-04-20 02:59:21,304 INFO [StoreOpener-7a1ab58edfbcf60e96d5768bd727001f-1] regionserver.HStore(310): Store=7a1ab58edfbcf60e96d5768bd727001f/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-20 02:59:21,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/default/TestQuotaAdmin1/7a1ab58edfbcf60e96d5768bd727001f 2024-04-20 02:59:21,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/default/TestQuotaAdmin1/7a1ab58edfbcf60e96d5768bd727001f 2024-04-20 02:59:21,314 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 7a1ab58edfbcf60e96d5768bd727001f 2024-04-20 02:59:21,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/default/TestQuotaAdmin1/7a1ab58edfbcf60e96d5768bd727001f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-20 02:59:21,320 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 7a1ab58edfbcf60e96d5768bd727001f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64362042, jitterRate=-0.04093083739280701}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-04-20 02:59:21,320 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 7a1ab58edfbcf60e96d5768bd727001f: 2024-04-20 02:59:21,321 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2345): Post open deploy tasks for TestQuotaAdmin1,,1713581960911.7a1ab58edfbcf60e96d5768bd727001f., pid=17, masterSystemTime=1713581961292 2024-04-20 02:59:21,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2372): Finished post open deploy task for TestQuotaAdmin1,,1713581960911.7a1ab58edfbcf60e96d5768bd727001f. 2024-04-20 02:59:21,324 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin1,,1713581960911.7a1ab58edfbcf60e96d5768bd727001f. 2024-04-20 02:59:21,325 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=16 updating hbase:meta row=7a1ab58edfbcf60e96d5768bd727001f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 02:59:21,325 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin1,,1713581960911.7a1ab58edfbcf60e96d5768bd727001f.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713581961324"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1713581961324"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1713581961324"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1713581961324"}]},"ts":"1713581961324"} 2024-04-20 02:59:21,330 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=17, resume processing ppid=16 2024-04-20 02:59:21,330 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=17, ppid=16, state=SUCCESS; OpenRegionProcedure 7a1ab58edfbcf60e96d5768bd727001f, server=jenkins-hbase4.apache.org,43007,1713581956960 in 188 msec 2024-04-20 02:59:21,334 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=16, resume processing ppid=15 2024-04-20 02:59:21,335 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=16, ppid=15, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=7a1ab58edfbcf60e96d5768bd727001f, ASSIGN in 349 msec 2024-04-20 02:59:21,336 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=15, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-04-20 02:59:21,336 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713581961336"}]},"ts":"1713581961336"} 2024-04-20 02:59:21,339 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=ENABLED in hbase:meta 2024-04-20 02:59:21,342 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=15, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin1 execute state=CREATE_TABLE_POST_OPERATION 2024-04-20 02:59:21,345 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=15, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin1 in 432 msec 2024-04-20 02:59:21,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=15 2024-04-20 02:59:21,672 INFO [Listener at localhost/35709] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin1, procId: 15 completed 2024-04-20 02:59:21,672 DEBUG [Listener at localhost/35709] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin1 get assigned. Timeout = 60000ms 2024-04-20 02:59:21,673 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 02:59:21,676 INFO [Listener at localhost/35709] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin1 assigned to meta. Checking AM states. 2024-04-20 02:59:21,676 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 02:59:21,676 INFO [Listener at localhost/35709] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin1 assigned. 2024-04-20 02:59:21,676 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 02:59:21,688 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-04-20 02:59:21,690 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] procedure2.ProcedureExecutor(1075): Stored pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestQuotaAdmin2 2024-04-20 02:59:21,692 INFO [PEWorker-4] procedure.CreateTableProcedure(82): pid=18, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_PRE_OPERATION 2024-04-20 02:59:21,692 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "TestQuotaAdmin2" procId is: 18 2024-04-20 02:59:21,694 INFO [PEWorker-4] procedure.CreateTableProcedure(82): pid=18, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-04-20 02:59:21,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-04-20 02:59:21,696 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/default/TestQuotaAdmin2/0f801c0048fc46c3107c1abc821ef574 2024-04-20 02:59:21,697 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/default/TestQuotaAdmin2/0f801c0048fc46c3107c1abc821ef574 empty. 2024-04-20 02:59:21,697 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/default/TestQuotaAdmin2/0f801c0048fc46c3107c1abc821ef574 2024-04-20 02:59:21,698 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-04-20 02:59:21,718 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/default/TestQuotaAdmin2/.tabledesc/.tableinfo.0000000001 2024-04-20 02:59:21,720 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0f801c0048fc46c3107c1abc821ef574, NAME => 'TestQuotaAdmin2,,1713581961688.0f801c0048fc46c3107c1abc821ef574.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='TestQuotaAdmin2', {TABLE_ATTRIBUTES => {REGION_REPLICATION => '1'}}, {NAME => 'cf', BLOOMFILTER => 'NONE', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp 2024-04-20 02:59:21,733 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1713581961688.0f801c0048fc46c3107c1abc821ef574.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-20 02:59:21,734 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1604): Closing 0f801c0048fc46c3107c1abc821ef574, disabling compactions & flushes 2024-04-20 02:59:21,734 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1713581961688.0f801c0048fc46c3107c1abc821ef574. 2024-04-20 02:59:21,734 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1713581961688.0f801c0048fc46c3107c1abc821ef574. 2024-04-20 02:59:21,734 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1713581961688.0f801c0048fc46c3107c1abc821ef574. after waiting 0 ms 2024-04-20 02:59:21,734 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1713581961688.0f801c0048fc46c3107c1abc821ef574. 2024-04-20 02:59:21,734 INFO [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1713581961688.0f801c0048fc46c3107c1abc821ef574. 2024-04-20 02:59:21,734 DEBUG [RegionOpenAndInit-TestQuotaAdmin2-pool-0] regionserver.HRegion(1558): Region close journal for 0f801c0048fc46c3107c1abc821ef574: 2024-04-20 02:59:21,738 INFO [PEWorker-4] procedure.CreateTableProcedure(82): pid=18, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ADD_TO_META 2024-04-20 02:59:21,740 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1713581961688.0f801c0048fc46c3107c1abc821ef574.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713581961740"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713581961740"}]},"ts":"1713581961740"} 2024-04-20 02:59:21,742 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2024-04-20 02:59:21,743 INFO [PEWorker-4] procedure.CreateTableProcedure(82): pid=18, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-04-20 02:59:21,744 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713581961743"}]},"ts":"1713581961743"} 2024-04-20 02:59:21,746 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLING in hbase:meta 2024-04-20 02:59:21,751 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-04-20 02:59:21,752 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-04-20 02:59:21,752 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-04-20 02:59:21,752 DEBUG [PEWorker-4] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-04-20 02:59:21,752 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=0f801c0048fc46c3107c1abc821ef574, ASSIGN}] 2024-04-20 02:59:21,753 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=0f801c0048fc46c3107c1abc821ef574, ASSIGN 2024-04-20 02:59:21,754 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=19, ppid=18, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestQuotaAdmin2, region=0f801c0048fc46c3107c1abc821ef574, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45079,1713581956918; forceNewPlan=false, retain=false 2024-04-20 02:59:21,905 INFO [jenkins-hbase4:35099] balancer.BaseLoadBalancer(1545): Reassigned 1 regions. 1 retained the pre-restart assignment. 2024-04-20 02:59:21,906 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=0f801c0048fc46c3107c1abc821ef574, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45079,1713581956918 2024-04-20 02:59:21,906 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1713581961688.0f801c0048fc46c3107c1abc821ef574.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713581961906"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713581961906"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713581961906"}]},"ts":"1713581961906"} 2024-04-20 02:59:21,908 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE; OpenRegionProcedure 0f801c0048fc46c3107c1abc821ef574, server=jenkins-hbase4.apache.org,45079,1713581956918}] 2024-04-20 02:59:21,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-04-20 02:59:22,062 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,45079,1713581956918 2024-04-20 02:59:22,062 DEBUG [RSProcedureDispatcher-pool-2] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2024-04-20 02:59:22,065 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37658, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2024-04-20 02:59:22,070 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestQuotaAdmin2,,1713581961688.0f801c0048fc46c3107c1abc821ef574. 2024-04-20 02:59:22,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0f801c0048fc46c3107c1abc821ef574, NAME => 'TestQuotaAdmin2,,1713581961688.0f801c0048fc46c3107c1abc821ef574.', STARTKEY => '', ENDKEY => ''} 2024-04-20 02:59:22,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestQuotaAdmin2 0f801c0048fc46c3107c1abc821ef574 2024-04-20 02:59:22,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestQuotaAdmin2,,1713581961688.0f801c0048fc46c3107c1abc821ef574.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-20 02:59:22,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0f801c0048fc46c3107c1abc821ef574 2024-04-20 02:59:22,071 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0f801c0048fc46c3107c1abc821ef574 2024-04-20 02:59:22,073 INFO [StoreOpener-0f801c0048fc46c3107c1abc821ef574-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0f801c0048fc46c3107c1abc821ef574 2024-04-20 02:59:22,075 DEBUG [StoreOpener-0f801c0048fc46c3107c1abc821ef574-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/default/TestQuotaAdmin2/0f801c0048fc46c3107c1abc821ef574/cf 2024-04-20 02:59:22,076 DEBUG [StoreOpener-0f801c0048fc46c3107c1abc821ef574-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/default/TestQuotaAdmin2/0f801c0048fc46c3107c1abc821ef574/cf 2024-04-20 02:59:22,076 INFO [StoreOpener-0f801c0048fc46c3107c1abc821ef574-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0f801c0048fc46c3107c1abc821ef574 columnFamilyName cf 2024-04-20 02:59:22,077 INFO [StoreOpener-0f801c0048fc46c3107c1abc821ef574-1] regionserver.HStore(310): Store=0f801c0048fc46c3107c1abc821ef574/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-20 02:59:22,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/default/TestQuotaAdmin2/0f801c0048fc46c3107c1abc821ef574 2024-04-20 02:59:22,079 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/default/TestQuotaAdmin2/0f801c0048fc46c3107c1abc821ef574 2024-04-20 02:59:22,085 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0f801c0048fc46c3107c1abc821ef574 2024-04-20 02:59:22,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/default/TestQuotaAdmin2/0f801c0048fc46c3107c1abc821ef574/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-20 02:59:22,090 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0f801c0048fc46c3107c1abc821ef574; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71860748, jitterRate=0.07080858945846558}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-04-20 02:59:22,090 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0f801c0048fc46c3107c1abc821ef574: 2024-04-20 02:59:22,091 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2345): Post open deploy tasks for TestQuotaAdmin2,,1713581961688.0f801c0048fc46c3107c1abc821ef574., pid=20, masterSystemTime=1713581962062 2024-04-20 02:59:22,094 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2372): Finished post open deploy task for TestQuotaAdmin2,,1713581961688.0f801c0048fc46c3107c1abc821ef574. 2024-04-20 02:59:22,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestQuotaAdmin2,,1713581961688.0f801c0048fc46c3107c1abc821ef574. 2024-04-20 02:59:22,095 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=19 updating hbase:meta row=0f801c0048fc46c3107c1abc821ef574, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45079,1713581956918 2024-04-20 02:59:22,096 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestQuotaAdmin2,,1713581961688.0f801c0048fc46c3107c1abc821ef574.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713581962095"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1713581962095"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1713581962095"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1713581962095"}]},"ts":"1713581962095"} 2024-04-20 02:59:22,101 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=20, resume processing ppid=19 2024-04-20 02:59:22,101 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=20, ppid=19, state=SUCCESS; OpenRegionProcedure 0f801c0048fc46c3107c1abc821ef574, server=jenkins-hbase4.apache.org,45079,1713581956918 in 190 msec 2024-04-20 02:59:22,104 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=19, resume processing ppid=18 2024-04-20 02:59:22,104 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=19, ppid=18, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=0f801c0048fc46c3107c1abc821ef574, ASSIGN in 349 msec 2024-04-20 02:59:22,106 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=18, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-04-20 02:59:22,106 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713581962106"}]},"ts":"1713581962106"} 2024-04-20 02:59:22,108 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=ENABLED in hbase:meta 2024-04-20 02:59:22,111 INFO [PEWorker-3] procedure.CreateTableProcedure(82): pid=18, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestQuotaAdmin2 execute state=CREATE_TABLE_POST_OPERATION 2024-04-20 02:59:22,113 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=18, state=SUCCESS; CreateTableProcedure table=TestQuotaAdmin2 in 423 msec 2024-04-20 02:59:22,447 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=18 2024-04-20 02:59:22,448 INFO [Listener at localhost/35709] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:TestQuotaAdmin2, procId: 18 completed 2024-04-20 02:59:22,448 DEBUG [Listener at localhost/35709] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestQuotaAdmin2 get assigned. Timeout = 60000ms 2024-04-20 02:59:22,448 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 02:59:22,452 INFO [Listener at localhost/35709] hbase.HBaseTestingUtility(3484): All regions for table TestQuotaAdmin2 assigned to meta. Checking AM states. 2024-04-20 02:59:22,452 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 02:59:22,452 INFO [Listener at localhost/35709] hbase.HBaseTestingUtility(3504): All regions for table TestQuotaAdmin2 assigned. 2024-04-20 02:59:22,452 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 02:59:22,459 DEBUG [hconnection-0x52cb5591-shared-pool-3] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-04-20 02:59:22,463 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:37670, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2024-04-20 02:59:22,465 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2024-04-20 02:59:22,469 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:46982, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=MasterService 2024-04-20 02:59:22,474 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.HMaster$15(3020): Client=jenkins//172.31.14.131 creating {NAME => 'TestNs'} 2024-04-20 02:59:22,474 DEBUG [hconnection-0x76f2cb6b-metaLookup-shared--pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2024-04-20 02:59:22,476 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] procedure2.ProcedureExecutor(1075): Stored pid=21, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=TestNs 2024-04-20 02:59:22,478 INFO [RS-EventLoopGroup-4-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42710, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=ClientService 2024-04-20 02:59:22,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-04-20 02:59:22,491 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-04-20 02:59:22,497 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=21, state=SUCCESS; CreateNamespaceProcedure, namespace=TestNs in 21 msec 2024-04-20 02:59:22,736 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=21 2024-04-20 02:59:22,738 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.HMaster$4(2118): Client=jenkins//172.31.14.131 create 'TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2024-04-20 02:59:22,740 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] procedure2.ProcedureExecutor(1075): Stored pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=TestNs:TestTable 2024-04-20 02:59:22,743 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=22, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_PRE_OPERATION 2024-04-20 02:59:22,743 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "TestNs" qualifier: "TestTable" procId is: 22 2024-04-20 02:59:22,744 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=22, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2024-04-20 02:59:22,745 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-04-20 02:59:22,748 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/TestNs/TestTable/f60e93233ba9b2c52d52b41655d81bff 2024-04-20 02:59:22,748 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/TestNs/TestTable/0ac165ce85857a7f8639a49afe9d2bf9 2024-04-20 02:59:22,749 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/TestNs/TestTable/f60e93233ba9b2c52d52b41655d81bff empty. 2024-04-20 02:59:22,750 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/TestNs/TestTable/0ac165ce85857a7f8639a49afe9d2bf9 empty. 2024-04-20 02:59:22,750 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/TestNs/TestTable/f60e93233ba9b2c52d52b41655d81bff 2024-04-20 02:59:22,751 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/TestNs/TestTable/0ac165ce85857a7f8639a49afe9d2bf9 2024-04-20 02:59:22,751 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-04-20 02:59:22,772 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/TestNs/TestTable/.tabledesc/.tableinfo.0000000001 2024-04-20 02:59:22,774 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(7675): creating {ENCODED => 0ac165ce85857a7f8639a49afe9d2bf9, NAME => 'TestNs:TestTable,,1713581962738.0ac165ce85857a7f8639a49afe9d2bf9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp 2024-04-20 02:59:22,776 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(7675): creating {ENCODED => f60e93233ba9b2c52d52b41655d81bff, NAME => 'TestNs:TestTable,1,1713581962738.f60e93233ba9b2c52d52b41655d81bff.', STARTKEY => '1', ENDKEY => ''}, tableDescriptor='TestNs:TestTable', {NAME => 'cf', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp 2024-04-20 02:59:22,795 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1713581962738.0ac165ce85857a7f8639a49afe9d2bf9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-20 02:59:22,796 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1604): Closing 0ac165ce85857a7f8639a49afe9d2bf9, disabling compactions & flushes 2024-04-20 02:59:22,796 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1713581962738.0ac165ce85857a7f8639a49afe9d2bf9. 2024-04-20 02:59:22,796 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1713581962738.0ac165ce85857a7f8639a49afe9d2bf9. 2024-04-20 02:59:22,796 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1713581962738.0ac165ce85857a7f8639a49afe9d2bf9. after waiting 0 ms 2024-04-20 02:59:22,796 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1713581962738.0ac165ce85857a7f8639a49afe9d2bf9. 2024-04-20 02:59:22,796 INFO [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1713581962738.0ac165ce85857a7f8639a49afe9d2bf9. 2024-04-20 02:59:22,796 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-0] regionserver.HRegion(1558): Region close journal for 0ac165ce85857a7f8639a49afe9d2bf9: 2024-04-20 02:59:22,796 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1713581962738.f60e93233ba9b2c52d52b41655d81bff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-20 02:59:22,797 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1604): Closing f60e93233ba9b2c52d52b41655d81bff, disabling compactions & flushes 2024-04-20 02:59:22,797 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1713581962738.f60e93233ba9b2c52d52b41655d81bff. 2024-04-20 02:59:22,797 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1713581962738.f60e93233ba9b2c52d52b41655d81bff. 2024-04-20 02:59:22,797 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1713581962738.f60e93233ba9b2c52d52b41655d81bff. after waiting 0 ms 2024-04-20 02:59:22,797 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1713581962738.f60e93233ba9b2c52d52b41655d81bff. 2024-04-20 02:59:22,797 INFO [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1713581962738.f60e93233ba9b2c52d52b41655d81bff. 2024-04-20 02:59:22,797 DEBUG [RegionOpenAndInit-TestNs:TestTable-pool-1] regionserver.HRegion(1558): Region close journal for f60e93233ba9b2c52d52b41655d81bff: 2024-04-20 02:59:22,802 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=22, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ADD_TO_META 2024-04-20 02:59:22,803 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,,1713581962738.0ac165ce85857a7f8639a49afe9d2bf9.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713581962803"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713581962803"}]},"ts":"1713581962803"} 2024-04-20 02:59:22,803 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1713581962738.f60e93233ba9b2c52d52b41655d81bff.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713581962803"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713581962803"}]},"ts":"1713581962803"} 2024-04-20 02:59:22,811 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 2 regions to meta. 2024-04-20 02:59:22,812 INFO [PEWorker-1] procedure.CreateTableProcedure(82): pid=22, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_ASSIGN_REGIONS 2024-04-20 02:59:22,812 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713581962812"}]},"ts":"1713581962812"} 2024-04-20 02:59:22,815 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLING in hbase:meta 2024-04-20 02:59:22,820 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(334): Hosts are {jenkins-hbase4.apache.org=0} racks are {/default-rack=0} 2024-04-20 02:59:22,822 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 0 is on host 0 2024-04-20 02:59:22,822 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(362): server 1 is on host 0 2024-04-20 02:59:22,822 DEBUG [PEWorker-1] balancer.BaseLoadBalancer$Cluster(378): Number of tables=1, number of hosts=1, number of racks=1 2024-04-20 02:59:22,822 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=0ac165ce85857a7f8639a49afe9d2bf9, ASSIGN}, {pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=f60e93233ba9b2c52d52b41655d81bff, ASSIGN}] 2024-04-20 02:59:22,824 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=f60e93233ba9b2c52d52b41655d81bff, ASSIGN 2024-04-20 02:59:22,824 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=TestNs:TestTable, region=0ac165ce85857a7f8639a49afe9d2bf9, ASSIGN 2024-04-20 02:59:22,825 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=f60e93233ba9b2c52d52b41655d81bff, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,43007,1713581956960; forceNewPlan=false, retain=false 2024-04-20 02:59:22,825 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=23, ppid=22, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=TestNs:TestTable, region=0ac165ce85857a7f8639a49afe9d2bf9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,45079,1713581956918; forceNewPlan=false, retain=false 2024-04-20 02:59:22,976 INFO [jenkins-hbase4:35099] balancer.BaseLoadBalancer(1545): Reassigned 2 regions. 2 retained the pre-restart assignment. 2024-04-20 02:59:22,977 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=0ac165ce85857a7f8639a49afe9d2bf9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,45079,1713581956918 2024-04-20 02:59:22,977 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=f60e93233ba9b2c52d52b41655d81bff, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 02:59:22,978 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1713581962738.0ac165ce85857a7f8639a49afe9d2bf9.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713581962977"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713581962977"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713581962977"}]},"ts":"1713581962977"} 2024-04-20 02:59:22,978 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1713581962738.f60e93233ba9b2c52d52b41655d81bff.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713581962977"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713581962977"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713581962977"}]},"ts":"1713581962977"} 2024-04-20 02:59:22,980 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=25, ppid=23, state=RUNNABLE; OpenRegionProcedure 0ac165ce85857a7f8639a49afe9d2bf9, server=jenkins-hbase4.apache.org,45079,1713581956918}] 2024-04-20 02:59:22,982 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=26, ppid=24, state=RUNNABLE; OpenRegionProcedure f60e93233ba9b2c52d52b41655d81bff, server=jenkins-hbase4.apache.org,43007,1713581956960}] 2024-04-20 02:59:22,996 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-04-20 02:59:23,133 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,45079,1713581956918 2024-04-20 02:59:23,135 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 02:59:23,139 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,,1713581962738.0ac165ce85857a7f8639a49afe9d2bf9. 2024-04-20 02:59:23,139 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0ac165ce85857a7f8639a49afe9d2bf9, NAME => 'TestNs:TestTable,,1713581962738.0ac165ce85857a7f8639a49afe9d2bf9.', STARTKEY => '', ENDKEY => '1'} 2024-04-20 02:59:23,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable 0ac165ce85857a7f8639a49afe9d2bf9 2024-04-20 02:59:23,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,,1713581962738.0ac165ce85857a7f8639a49afe9d2bf9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-20 02:59:23,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0ac165ce85857a7f8639a49afe9d2bf9 2024-04-20 02:59:23,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0ac165ce85857a7f8639a49afe9d2bf9 2024-04-20 02:59:23,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open TestNs:TestTable,1,1713581962738.f60e93233ba9b2c52d52b41655d81bff. 2024-04-20 02:59:23,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f60e93233ba9b2c52d52b41655d81bff, NAME => 'TestNs:TestTable,1,1713581962738.f60e93233ba9b2c52d52b41655d81bff.', STARTKEY => '1', ENDKEY => ''} 2024-04-20 02:59:23,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table TestTable f60e93233ba9b2c52d52b41655d81bff 2024-04-20 02:59:23,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated TestNs:TestTable,1,1713581962738.f60e93233ba9b2c52d52b41655d81bff.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2024-04-20 02:59:23,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f60e93233ba9b2c52d52b41655d81bff 2024-04-20 02:59:23,141 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f60e93233ba9b2c52d52b41655d81bff 2024-04-20 02:59:23,142 INFO [StoreOpener-0ac165ce85857a7f8639a49afe9d2bf9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region 0ac165ce85857a7f8639a49afe9d2bf9 2024-04-20 02:59:23,143 INFO [StoreOpener-f60e93233ba9b2c52d52b41655d81bff-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family cf of region f60e93233ba9b2c52d52b41655d81bff 2024-04-20 02:59:23,144 DEBUG [StoreOpener-0ac165ce85857a7f8639a49afe9d2bf9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/TestNs/TestTable/0ac165ce85857a7f8639a49afe9d2bf9/cf 2024-04-20 02:59:23,144 DEBUG [StoreOpener-0ac165ce85857a7f8639a49afe9d2bf9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/TestNs/TestTable/0ac165ce85857a7f8639a49afe9d2bf9/cf 2024-04-20 02:59:23,144 INFO [StoreOpener-0ac165ce85857a7f8639a49afe9d2bf9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ac165ce85857a7f8639a49afe9d2bf9 columnFamilyName cf 2024-04-20 02:59:23,145 DEBUG [StoreOpener-f60e93233ba9b2c52d52b41655d81bff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/TestNs/TestTable/f60e93233ba9b2c52d52b41655d81bff/cf 2024-04-20 02:59:23,145 DEBUG [StoreOpener-f60e93233ba9b2c52d52b41655d81bff-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/TestNs/TestTable/f60e93233ba9b2c52d52b41655d81bff/cf 2024-04-20 02:59:23,145 INFO [StoreOpener-0ac165ce85857a7f8639a49afe9d2bf9-1] regionserver.HStore(310): Store=0ac165ce85857a7f8639a49afe9d2bf9/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-20 02:59:23,146 INFO [StoreOpener-f60e93233ba9b2c52d52b41655d81bff-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:10, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f60e93233ba9b2c52d52b41655d81bff columnFamilyName cf 2024-04-20 02:59:23,147 INFO [StoreOpener-f60e93233ba9b2c52d52b41655d81bff-1] regionserver.HStore(310): Store=f60e93233ba9b2c52d52b41655d81bff/cf, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2024-04-20 02:59:23,147 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/TestNs/TestTable/0ac165ce85857a7f8639a49afe9d2bf9 2024-04-20 02:59:23,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/TestNs/TestTable/0ac165ce85857a7f8639a49afe9d2bf9 2024-04-20 02:59:23,149 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/TestNs/TestTable/f60e93233ba9b2c52d52b41655d81bff 2024-04-20 02:59:23,150 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/TestNs/TestTable/f60e93233ba9b2c52d52b41655d81bff 2024-04-20 02:59:23,153 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0ac165ce85857a7f8639a49afe9d2bf9 2024-04-20 02:59:23,155 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f60e93233ba9b2c52d52b41655d81bff 2024-04-20 02:59:23,157 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/TestNs/TestTable/0ac165ce85857a7f8639a49afe9d2bf9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-20 02:59:23,158 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0ac165ce85857a7f8639a49afe9d2bf9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67710986, jitterRate=0.008972316980361938}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-04-20 02:59:23,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0ac165ce85857a7f8639a49afe9d2bf9: 2024-04-20 02:59:23,158 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/TestNs/TestTable/f60e93233ba9b2c52d52b41655d81bff/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2024-04-20 02:59:23,159 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2345): Post open deploy tasks for TestNs:TestTable,,1713581962738.0ac165ce85857a7f8639a49afe9d2bf9., pid=25, masterSystemTime=1713581963133 2024-04-20 02:59:23,159 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f60e93233ba9b2c52d52b41655d81bff; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=74595831, jitterRate=0.111564502120018}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2024-04-20 02:59:23,159 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f60e93233ba9b2c52d52b41655d81bff: 2024-04-20 02:59:23,161 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2345): Post open deploy tasks for TestNs:TestTable,1,1713581962738.f60e93233ba9b2c52d52b41655d81bff., pid=26, masterSystemTime=1713581963135 2024-04-20 02:59:23,162 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2372): Finished post open deploy task for TestNs:TestTable,,1713581962738.0ac165ce85857a7f8639a49afe9d2bf9. 2024-04-20 02:59:23,162 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,,1713581962738.0ac165ce85857a7f8639a49afe9d2bf9. 2024-04-20 02:59:23,162 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=23 updating hbase:meta row=0ac165ce85857a7f8639a49afe9d2bf9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,45079,1713581956918 2024-04-20 02:59:23,163 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,,1713581962738.0ac165ce85857a7f8639a49afe9d2bf9.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713581963162"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1713581963162"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1713581963162"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1713581963162"}]},"ts":"1713581963162"} 2024-04-20 02:59:23,163 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2372): Finished post open deploy task for TestNs:TestTable,1,1713581962738.f60e93233ba9b2c52d52b41655d81bff. 2024-04-20 02:59:23,163 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened TestNs:TestTable,1,1713581962738.f60e93233ba9b2c52d52b41655d81bff. 2024-04-20 02:59:23,164 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=f60e93233ba9b2c52d52b41655d81bff, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 02:59:23,165 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"TestNs:TestTable,1,1713581962738.f60e93233ba9b2c52d52b41655d81bff.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713581963164"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1713581963164"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1713581963164"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1713581963164"}]},"ts":"1713581963164"} 2024-04-20 02:59:23,168 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=25, resume processing ppid=23 2024-04-20 02:59:23,169 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=25, ppid=23, state=SUCCESS; OpenRegionProcedure 0ac165ce85857a7f8639a49afe9d2bf9, server=jenkins-hbase4.apache.org,45079,1713581956918 in 186 msec 2024-04-20 02:59:23,170 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=26, resume processing ppid=24 2024-04-20 02:59:23,172 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=23, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=0ac165ce85857a7f8639a49afe9d2bf9, ASSIGN in 347 msec 2024-04-20 02:59:23,172 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=26, ppid=24, state=SUCCESS; OpenRegionProcedure f60e93233ba9b2c52d52b41655d81bff, server=jenkins-hbase4.apache.org,43007,1713581956960 in 185 msec 2024-04-20 02:59:23,174 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=24, resume processing ppid=22 2024-04-20 02:59:23,174 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=24, ppid=22, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=f60e93233ba9b2c52d52b41655d81bff, ASSIGN in 348 msec 2024-04-20 02:59:23,175 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=22, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2024-04-20 02:59:23,175 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713581963175"}]},"ts":"1713581963175"} 2024-04-20 02:59:23,177 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=ENABLED in hbase:meta 2024-04-20 02:59:23,181 INFO [PEWorker-2] procedure.CreateTableProcedure(82): pid=22, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=TestNs:TestTable execute state=CREATE_TABLE_POST_OPERATION 2024-04-20 02:59:23,184 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=22, state=SUCCESS; CreateTableProcedure table=TestNs:TestTable in 443 msec 2024-04-20 02:59:23,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=22 2024-04-20 02:59:23,498 INFO [Listener at localhost/35709] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: TestNs:TestTable, procId: 22 completed 2024-04-20 02:59:23,498 DEBUG [Listener at localhost/35709] hbase.HBaseTestingUtility(3430): Waiting until all regions of table TestNs:TestTable get assigned. Timeout = 60000ms 2024-04-20 02:59:23,498 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 02:59:23,503 INFO [Listener at localhost/35709] hbase.HBaseTestingUtility(3484): All regions for table TestNs:TestTable assigned to meta. Checking AM states. 2024-04-20 02:59:23,503 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 02:59:23,503 INFO [Listener at localhost/35709] hbase.HBaseTestingUtility(3504): All regions for table TestNs:TestTable assigned. 2024-04-20 02:59:23,503 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [30,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 02:59:23,547 INFO [Listener at localhost/35709] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=309, OpenFileDescriptor=623, MaxFileDescriptor=60000, SystemLoadAverage=303, ProcessCount=166, AvailableMemoryMB=8513 2024-04-20 02:59:23,872 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 02:59:23,872 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-20 02:59:23,872 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713585563620 bypass), TestNs=QuotaState(ts=1713585563620 bypass)} 2024-04-20 02:59:23,872 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713585563620 bypass), TestQuotaAdmin2=QuotaState(ts=1713585563620 bypass)} 2024-04-20 02:59:23,872 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713585563620 [ TestNs:TestTable ])} 2024-04-20 02:59:23,872 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713585563620 bypass)} 2024-04-20 02:59:24,123 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 02:59:24,123 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-20 02:59:24,123 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713585563620 bypass), TestNs=QuotaState(ts=1713585563620 bypass)} 2024-04-20 02:59:24,123 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713585563620 bypass), TestNs:TestTable=QuotaState(ts=1713585563620 bypass), TestQuotaAdmin1=QuotaState(ts=1713585563620 bypass)} 2024-04-20 02:59:24,123 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713585563620 [ TestNs:TestTable ])} 2024-04-20 02:59:24,123 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713585563620 bypass)} 2024-04-20 02:59:24,132 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2024-04-20 02:59:24,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 02:59:24,141 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 90 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:42696 deadline: 1713581974140, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 02:59:24,194 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin0' 2024-04-20 02:59:24,195 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2024-04-20 02:59:24,195 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2024-04-20 02:59:24,196 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestNs:TestTable' 2024-04-20 02:59:24,196 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:quota' 2024-04-20 02:59:24,197 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin1' 2024-04-20 02:59:24,197 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'TestQuotaAdmin2' 2024-04-20 02:59:24,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 02:59:24,418 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 92 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:42696 deadline: 1713581974139, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 02:59:24,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 02:59:24,924 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 94 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:42696 deadline: 1713581974139, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 02:59:25,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 02:59:25,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 96 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:42696 deadline: 1713581974139, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 02:59:25,931 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-04-20 02:59:25,931 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver Metrics about HBase MasterObservers 2024-04-20 02:59:25,932 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-04-20 02:59:25,932 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2024-04-20 02:59:26,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 02:59:26,944 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 98 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:42696 deadline: 1713581974139, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 02:59:29,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 02:59:29,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 100 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:42696 deadline: 1713581974139, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 02:59:29,458 ERROR [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10355: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1713581962738.f60e93233ba9b2c52d52b41655d81bff., hostname=jenkins-hbase4.apache.org,43007,1713581956960, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-20 02:59:29,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 02:59:29,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 101 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:42696 deadline: 1713581979461, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 02:59:29,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 02:59:29,718 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 103 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:42696 deadline: 1713581979461, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 02:59:30,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 02:59:30,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 105 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:42696 deadline: 1713581979462, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 02:59:30,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 02:59:30,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 107 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:42696 deadline: 1713581979462, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 02:59:32,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 02:59:32,241 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 109 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:42696 deadline: 1713581979461, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 02:59:34,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 02:59:34,764 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 111 service: ClientService methodName: Get size: 115 connection: 172.31.14.131:42696 deadline: 1713581979461, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 02:59:34,764 ERROR [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10343: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1713581962738.f60e93233ba9b2c52d52b41655d81bff., hostname=jenkins-hbase4.apache.org,43007,1713581956960, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:224) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-20 02:59:35,025 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 02:59:35,026 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-20 02:59:35,026 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713589163620 bypass), TestNs=QuotaState(ts=1713589163620 bypass)} 2024-04-20 02:59:35,026 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713589163620 bypass), TestQuotaAdmin2=QuotaState(ts=1713589163620 bypass)} 2024-04-20 02:59:35,026 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713589163620 bypass)} 2024-04-20 02:59:35,026 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713589163620 bypass)} 2024-04-20 02:59:35,276 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 02:59:35,276 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-20 02:59:35,276 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713589163620 bypass), TestNs=QuotaState(ts=1713589163620 bypass)} 2024-04-20 02:59:35,276 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713589163620 bypass), TestNs:TestTable=QuotaState(ts=1713589163620 bypass), TestQuotaAdmin1=QuotaState(ts=1713589163620 bypass)} 2024-04-20 02:59:35,276 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713589163620 bypass)} 2024-04-20 02:59:35,276 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713589163620 bypass)} 2024-04-20 02:59:35,292 INFO [Listener at localhost/35709] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserTableClusterScopeQuota Thread=292 (was 309), OpenFileDescriptor=598 (was 623), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=265 (was 303), ProcessCount=166 (was 166), AvailableMemoryMB=8449 (was 8513) 2024-04-20 02:59:35,305 INFO [Listener at localhost/35709] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=292, OpenFileDescriptor=598, MaxFileDescriptor=60000, SystemLoadAverage=265, ProcessCount=166, AvailableMemoryMB=8448 2024-04-20 02:59:35,567 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 02:59:35,567 INFO [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-04-20 02:59:35,818 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-20 02:59:35,819 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713592763720 bypass), TestNs=QuotaState(ts=1713592763720 bypass)} 2024-04-20 02:59:35,819 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713592763720 bypass), TestQuotaAdmin2=QuotaState(ts=1713592763720 bypass)} 2024-04-20 02:59:35,819 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713592763720 [ default ])} 2024-04-20 02:59:35,820 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713592763720 bypass)} 2024-04-20 02:59:36,070 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 02:59:36,070 INFO [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-04-20 02:59:36,320 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-20 02:59:36,322 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713592763820 bypass), TestNs=QuotaState(ts=1713592763820 bypass)} 2024-04-20 02:59:36,324 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713592763820 bypass), TestNs:TestTable=QuotaState(ts=1713592763820 bypass), TestQuotaAdmin1=QuotaState(ts=1713592763820 bypass)} 2024-04-20 02:59:36,324 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713592763820 [ default ])} 2024-04-20 02:59:36,324 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713592763820 bypass)} 2024-04-20 02:59:36,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-04-20 02:59:36,335 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 123 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:42696 deadline: 1713581986334, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-04-20 02:59:36,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-04-20 02:59:36,590 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 125 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:42696 deadline: 1713581986334, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-04-20 02:59:37,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-04-20 02:59:37,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 127 service: ClientService methodName: Get size: 113 connection: 172.31.14.131:42696 deadline: 1713581986334, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-04-20 02:59:37,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-04-20 02:59:37,856 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 129 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42696 deadline: 1713581986335, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-04-20 02:59:39,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-04-20 02:59:39,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 131 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42696 deadline: 1713581986334, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-04-20 02:59:41,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 12sec, 0ms 2024-04-20 02:59:41,625 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 133 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42696 deadline: 1713581986334, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms 2024-04-20 02:59:41,628 ERROR [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10316: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad., hostname=jenkins-hbase4.apache.org,43007,1713581956960, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:199) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-20 02:59:41,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-20 02:59:41,645 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 140 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42696 deadline: 1713581991644, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-20 02:59:41,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-20 02:59:41,899 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 142 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42696 deadline: 1713581991644, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-20 02:59:42,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-20 02:59:42,407 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 144 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42696 deadline: 1713581991644, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-20 02:59:43,163 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-20 02:59:43,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 146 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42696 deadline: 1713581991644, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-20 02:59:44,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-20 02:59:44,422 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 148 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42696 deadline: 1713581991645, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-20 02:59:46,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-20 02:59:46,948 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 150 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42696 deadline: 1713581991645, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-20 02:59:46,949 ERROR [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10326: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad., hostname=jenkins-hbase4.apache.org,43007,1713581956960, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:200) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-20 02:59:47,206 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 02:59:47,206 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-20 02:59:47,206 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713596363820 bypass), TestNs=QuotaState(ts=1713596363820 bypass)} 2024-04-20 02:59:47,206 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713596363820 bypass), TestQuotaAdmin2=QuotaState(ts=1713596363820 bypass)} 2024-04-20 02:59:47,206 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713596363820 bypass)} 2024-04-20 02:59:47,206 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713596363820 bypass)} 2024-04-20 02:59:47,457 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 02:59:47,457 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-20 02:59:47,457 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713596363820 bypass), TestNs=QuotaState(ts=1713596363820 bypass)} 2024-04-20 02:59:47,457 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713596363820 bypass), TestNs:TestTable=QuotaState(ts=1713596363820 bypass), TestQuotaAdmin1=QuotaState(ts=1713596363820 bypass)} 2024-04-20 02:59:47,457 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713596363820 bypass)} 2024-04-20 02:59:47,457 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713596363820 bypass)} 2024-04-20 02:59:47,471 INFO [Listener at localhost/35709] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserNamespaceClusterScopeQuota Thread=292 (was 292), OpenFileDescriptor=594 (was 598), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=252 (was 265), ProcessCount=166 (was 166), AvailableMemoryMB=8428 (was 8448) 2024-04-20 02:59:47,483 INFO [Listener at localhost/35709] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=292, OpenFileDescriptor=594, MaxFileDescriptor=60000, SystemLoadAverage=252, ProcessCount=166, AvailableMemoryMB=8427 2024-04-20 02:59:47,745 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 02:59:47,746 INFO [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-04-20 02:59:47,996 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-20 02:59:47,998 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713599963920 bypass), TestNs=QuotaState(ts=1713599963920 bypass)} 2024-04-20 02:59:47,999 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713599963920 bypass), TestQuotaAdmin2=QuotaState(ts=1713599963920 bypass)} 2024-04-20 02:59:47,999 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713599963920 global-limiter)} 2024-04-20 02:59:48,000 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713599963920 bypass)} 2024-04-20 02:59:48,250 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 02:59:48,250 INFO [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil$1(153): User limiter for user=jenkins (auth:SIMPLE), table=TestQuotaAdmin0 not refreshed, bypass expected false, actual true 2024-04-20 02:59:48,501 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-20 02:59:48,502 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713599964020 bypass), TestNs=QuotaState(ts=1713599964020 bypass)} 2024-04-20 02:59:48,502 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713599964020 bypass), TestNs:TestTable=QuotaState(ts=1713599964020 bypass), TestQuotaAdmin1=QuotaState(ts=1713599964020 bypass)} 2024-04-20 02:59:48,503 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713599964020 global-limiter)} 2024-04-20 02:59:48,503 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713599964020 bypass)} 2024-04-20 02:59:48,517 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-20 02:59:48,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 163 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42696 deadline: 1713581998517, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-20 02:59:48,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-20 02:59:48,771 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 165 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42696 deadline: 1713581998517, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-20 02:59:49,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-20 02:59:49,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 167 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42696 deadline: 1713581998517, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-20 02:59:50,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-20 02:59:50,035 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 169 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42696 deadline: 1713581998517, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-20 02:59:51,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-20 02:59:51,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 171 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42696 deadline: 1713581998518, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-20 02:59:53,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 10sec, 0ms 2024-04-20 02:59:53,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 173 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42696 deadline: 1713581998518, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms 2024-04-20 02:59:53,815 ERROR [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10326: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad., hostname=jenkins-hbase4.apache.org,43007,1713581956960, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:178) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-20 02:59:53,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-04-20 02:59:53,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 177 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42696 deadline: 1713582003821, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-04-20 02:59:54,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-04-20 02:59:54,076 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 179 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42696 deadline: 1713582003821, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-04-20 02:59:54,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-04-20 02:59:54,583 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 181 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42696 deadline: 1713582003821, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-04-20 02:59:55,337 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-04-20 02:59:55,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 183 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42696 deadline: 1713582003820, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-04-20 02:59:56,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-04-20 02:59:56,603 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 185 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42696 deadline: 1713582003821, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-04-20 02:59:59,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 20sec, 0ms 2024-04-20 02:59:59,128 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 187 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42696 deadline: 1713582003821, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms 2024-04-20 02:59:59,129 ERROR [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=3 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10310: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-3' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad., hostname=jenkins-hbase4.apache.org,43007,1713581956960, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testUserClusterScopeQuota(TestClusterScopeQuotaThrottle.java:179) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 20sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-20 02:59:59,386 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 02:59:59,386 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-20 02:59:59,386 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713603564020 bypass), TestNs=QuotaState(ts=1713603564020 bypass)} 2024-04-20 02:59:59,386 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713603564020 bypass), TestQuotaAdmin2=QuotaState(ts=1713603564020 bypass)} 2024-04-20 02:59:59,386 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713603564020 bypass)} 2024-04-20 02:59:59,386 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713603564020 bypass)} 2024-04-20 02:59:59,637 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 02:59:59,637 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-20 02:59:59,637 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713603564020 bypass), TestNs=QuotaState(ts=1713603564020 bypass)} 2024-04-20 02:59:59,637 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713603564020 bypass), TestNs:TestTable=QuotaState(ts=1713603564020 bypass), TestQuotaAdmin1=QuotaState(ts=1713603564020 bypass)} 2024-04-20 02:59:59,637 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713603564020 bypass)} 2024-04-20 02:59:59,637 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713603564020 bypass)} 2024-04-20 02:59:59,650 INFO [Listener at localhost/35709] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testUserClusterScopeQuota Thread=283 (was 292), OpenFileDescriptor=592 (was 594), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=214 (was 252), ProcessCount=169 (was 166) - ProcessCount LEAK? -, AvailableMemoryMB=8429 (was 8427) - AvailableMemoryMB LEAK? - 2024-04-20 02:59:59,664 INFO [Listener at localhost/35709] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=283, OpenFileDescriptor=592, MaxFileDescriptor=60000, SystemLoadAverage=214, ProcessCount=169, AvailableMemoryMB=8429 2024-04-20 02:59:59,920 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 02:59:59,921 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-20 02:59:59,922 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713607164020 bypass), TestNs=QuotaState(ts=1713607164020 bypass)} 2024-04-20 02:59:59,923 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713607164020 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin2=QuotaState(ts=1713607164020 bypass)} 2024-04-20 02:59:59,923 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(218): {} 2024-04-20 02:59:59,923 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713607164020 bypass)} 2024-04-20 03:00:00,174 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 03:00:00,175 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-20 03:00:00,175 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713607164020 bypass), TestNs=QuotaState(ts=1713607164020 bypass)} 2024-04-20 03:00:00,176 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713607164020 bypass), TestNs:TestTable=QuotaState(ts=1713607164020 TimeBasedLimiter( readReqs=AverageIntervalRateLimiter(avail=10 limit=10 tunit=3600000))), TestQuotaAdmin1=QuotaState(ts=1713607164020 bypass)} 2024-04-20 03:00:00,176 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(218): {} 2024-04-20 03:00:00,176 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713607164020 bypass)} 2024-04-20 03:00:00,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 03:00:00,192 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 202 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:42696 deadline: 1713582010192, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 03:00:00,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 03:00:00,448 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 204 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:42696 deadline: 1713582010192, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 03:00:00,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 03:00:00,956 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 206 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:42696 deadline: 1713582010191, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 03:00:01,712 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 03:00:01,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 208 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:42696 deadline: 1713582010191, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 03:00:02,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 03:00:02,977 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 210 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:42696 deadline: 1713582010192, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 03:00:05,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 03:00:05,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 212 service: ClientService methodName: Get size: 117 connection: 172.31.14.131:42696 deadline: 1713582010192, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 03:00:05,505 ERROR [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=10 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10353: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-10' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1713581962738.f60e93233ba9b2c52d52b41655d81bff., hostname=jenkins-hbase4.apache.org,43007,1713581956960, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-20 03:00:05,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 03:00:05,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 213 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:42696 deadline: 1713582015507, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 03:00:05,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 03:00:05,761 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 215 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:42696 deadline: 1713582015507, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 03:00:06,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 03:00:06,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 217 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:42696 deadline: 1713582015507, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 03:00:07,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 03:00:07,021 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 219 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:42696 deadline: 1713582015506, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 03:00:08,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 03:00:08,277 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 221 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:42696 deadline: 1713582015506, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 03:00:10,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestNs:TestTable numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 03:00:10,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 223 service: ClientService methodName: Get size: 116 connection: 172.31.14.131:42696 deadline: 1713582015506, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms 2024-04-20 03:00:10,797 ERROR [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=0 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10293: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-0' on table 'TestNs:TestTable' at region=TestNs:TestTable,1,1713581962738.f60e93233ba9b2c52d52b41655d81bff., hostname=jenkins-hbase4.apache.org,43007,1713581956960, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testTableClusterScopeQuota(TestClusterScopeQuotaThrottle.java:151) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 6mins, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-20 03:00:11,054 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 03:00:11,055 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-20 03:00:11,055 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713610764020 bypass), TestNs=QuotaState(ts=1713610764020 bypass)} 2024-04-20 03:00:11,055 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713610764020 bypass), TestQuotaAdmin2=QuotaState(ts=1713610764020 bypass)} 2024-04-20 03:00:11,055 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(218): {} 2024-04-20 03:00:11,055 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713610764020 bypass)} 2024-04-20 03:00:11,305 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 03:00:11,305 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-20 03:00:11,305 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713610764020 bypass), TestNs=QuotaState(ts=1713610764020 bypass)} 2024-04-20 03:00:11,305 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713610764020 bypass), TestNs:TestTable=QuotaState(ts=1713610764020 bypass), TestQuotaAdmin1=QuotaState(ts=1713610764020 bypass)} 2024-04-20 03:00:11,305 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713610764020 bypass)} 2024-04-20 03:00:11,305 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713610764020 bypass)} 2024-04-20 03:00:11,319 INFO [Listener at localhost/35709] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testTableClusterScopeQuota Thread=282 (was 283), OpenFileDescriptor=592 (was 592), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=174 (was 214), ProcessCount=169 (was 169), AvailableMemoryMB=8427 (was 8429) 2024-04-20 03:00:11,331 INFO [Listener at localhost/35709] hbase.ResourceChecker(147): before: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=282, OpenFileDescriptor=592, MaxFileDescriptor=60000, SystemLoadAverage=174, ProcessCount=169, AvailableMemoryMB=8426 2024-04-20 03:00:11,592 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 03:00:11,593 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-20 03:00:11,594 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713614364020 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1713614364020 bypass)} 2024-04-20 03:00:11,594 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713614364020 bypass), TestQuotaAdmin2=QuotaState(ts=1713614364020 bypass)} 2024-04-20 03:00:11,594 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(218): {} 2024-04-20 03:00:11,594 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713614364020 bypass)} 2024-04-20 03:00:11,844 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 03:00:11,845 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-20 03:00:11,846 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713614364020 TimeBasedLimiter( writeReqs=AverageIntervalRateLimiter(avail=5 limit=5 tunit=60000) readReqs=AverageIntervalRateLimiter(avail=6 limit=6 tunit=60000))), TestNs=QuotaState(ts=1713614364020 bypass)} 2024-04-20 03:00:11,846 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713614364020 bypass), TestNs:TestTable=QuotaState(ts=1713614364020 bypass), TestQuotaAdmin1=QuotaState(ts=1713614364020 bypass)} 2024-04-20 03:00:11,846 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(218): {} 2024-04-20 03:00:11,846 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713614364020 bypass)} 2024-04-20 03:00:11,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-04-20 03:00:11,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 235 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42696 deadline: 1713582021862, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-04-20 03:00:12,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-04-20 03:00:12,116 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 237 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42696 deadline: 1713582021863, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-04-20 03:00:12,619 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-04-20 03:00:12,620 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 239 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42696 deadline: 1713582021862, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-04-20 03:00:13,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-04-20 03:00:13,374 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 241 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42696 deadline: 1713582021862, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-04-20 03:00:14,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-04-20 03:00:14,629 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 243 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42696 deadline: 1713582021863, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-04-20 03:00:17,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=1 numReads=0 numScans=0: number of write requests exceeded - wait 12sec, 0ms 2024-04-20 03:00:17,151 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 245 service: ClientService methodName: Mutate size: 142 connection: 172.31.14.131:42696 deadline: 1713582021863, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms 2024-04-20 03:00:17,152 ERROR [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(79): put failed after nRetries=5 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10301: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-5' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad., hostname=jenkins-hbase4.apache.org,43007,1713581956960, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.put(HTable.java:512) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:74) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doPuts(ThrottleQuotaTestUtil.java:57) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:128) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of write requests exceeded - wait 12sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumWriteRequestsExceeded(RpcThrottlingException.java:104) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:158) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:170) at org.apache.hadoop.hbase.regionserver.RSRpcServices.mutate(RSRpcServices.java:2944) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45004) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-20 03:00:17,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-04-20 03:00:17,161 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 252 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42696 deadline: 1713582027160, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-04-20 03:00:17,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-04-20 03:00:17,414 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 254 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42696 deadline: 1713582027161, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-04-20 03:00:17,920 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-04-20 03:00:17,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 256 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42696 deadline: 1713582027160, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-04-20 03:00:18,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-04-20 03:00:18,678 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 258 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42696 deadline: 1713582027161, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-04-20 03:00:19,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-04-20 03:00:19,935 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 260 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42696 deadline: 1713582027160, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-04-20 03:00:22,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] quotas.RegionServerRpcQuotaManager(222): Throttling exception for user=jenkins table=TestQuotaAdmin0 numWrites=0 numReads=1 numScans=0: number of read requests exceeded - wait 10sec, 0ms 2024-04-20 03:00:22,440 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43007] ipc.CallRunner(144): callId: 262 service: ClientService methodName: Get size: 114 connection: 172.31.14.131:42696 deadline: 1713582027160, exception=org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms 2024-04-20 03:00:22,441 ERROR [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(103): get failed after nRetries=6 java.net.SocketTimeoutException: callTimeout=10000, callDuration=10305: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) row 'row-6' on table 'TestQuotaAdmin0' at region=TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad., hostname=jenkins-hbase4.apache.org,43007,1713581956960, seqNum=2 at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:156) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:370) at org.apache.hadoop.hbase.client.HTable.get(HTable.java:343) at org.apache.hadoop.hbase.quotas.ThrottleQuotaTestUtil.doGets(ThrottleQuotaTestUtil.java:98) at org.apache.hadoop.hbase.quotas.TestClusterScopeQuotaThrottle.testNamespaceClusterScopeQuota(TestClusterScopeQuotaThrottle.java:129) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:59) at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12) at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:56) at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.runners.ParentRunner$3.evaluate(ParentRunner.java:306) at org.junit.runners.BlockJUnit4ClassRunner$1.evaluate(BlockJUnit4ClassRunner.java:100) at org.junit.runners.ParentRunner.runLeaf(ParentRunner.java:366) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:103) at org.junit.runners.BlockJUnit4ClassRunner.runChild(BlockJUnit4ClassRunner.java:63) at org.junit.runners.ParentRunner$4.run(ParentRunner.java:331) at org.junit.runners.ParentRunner$1.schedule(ParentRunner.java:79) at org.junit.runners.ParentRunner.runChildren(ParentRunner.java:329) at org.junit.runners.ParentRunner.access$100(ParentRunner.java:66) at org.junit.runners.ParentRunner$2.evaluate(ParentRunner.java:293) at org.junit.internal.runners.statements.RunBefores.evaluate(RunBefores.java:26) at org.junit.internal.runners.statements.RunAfters.evaluate(RunAfters.java:27) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:299) at org.junit.internal.runners.statements.FailOnTimeout$CallableStatement.call(FailOnTimeout.java:293) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.lang.Thread.run(Thread.java:750) Caused by: org.apache.hadoop.hbase.quotas.RpcThrottlingException: org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at sun.reflect.GeneratedConstructorAccessor36.newInstance(Unknown Source) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.instantiateException(RemoteWithExtrasException.java:97) at org.apache.hadoop.hbase.ipc.RemoteWithExtrasException.unwrapRemoteException(RemoteWithExtrasException.java:87) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.makeIOExceptionOfException(ProtobufUtil.java:276) at org.apache.hadoop.hbase.protobuf.ProtobufUtil.handleRemoteException(ProtobufUtil.java:261) at org.apache.hadoop.hbase.client.RegionServerCallable.call(RegionServerCallable.java:126) at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:104) ... 29 more Caused by: org.apache.hadoop.hbase.ipc.RemoteWithExtrasException(org.apache.hadoop.hbase.quotas.RpcThrottlingException): org.apache.hadoop.hbase.quotas.RpcThrottlingException: number of read requests exceeded - wait 10sec, 0ms at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwThrottlingException(RpcThrottlingException.java:133) at org.apache.hadoop.hbase.quotas.RpcThrottlingException.throwNumReadRequestsExceeded(RpcThrottlingException.java:99) at org.apache.hadoop.hbase.quotas.TimeBasedLimiter.checkQuota(TimeBasedLimiter.java:172) at org.apache.hadoop.hbase.quotas.DefaultOperationQuota.checkQuota(DefaultOperationQuota.java:82) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:220) at org.apache.hadoop.hbase.quotas.RegionServerRpcQuotaManager.checkQuota(RegionServerRpcQuotaManager.java:168) at org.apache.hadoop.hbase.regionserver.RSRpcServices.get(RSRpcServices.java:2534) at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:45002) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.onCallFinished(AbstractRpcClient.java:381) at org.apache.hadoop.hbase.ipc.AbstractRpcClient.access$100(AbstractRpcClient.java:87) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:415) at org.apache.hadoop.hbase.ipc.AbstractRpcClient$3.run(AbstractRpcClient.java:411) at org.apache.hadoop.hbase.ipc.Call.callComplete(Call.java:115) at org.apache.hadoop.hbase.ipc.Call.setException(Call.java:130) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.readResponse(NettyRpcDuplexHandler.java:193) at org.apache.hadoop.hbase.ipc.NettyRpcDuplexHandler.channelRead(NettyRpcDuplexHandler.java:214) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.fireChannelRead(ByteToMessageDecoder.java:346) at org.apache.hbase.thirdparty.io.netty.handler.codec.ByteToMessageDecoder.channelRead(ByteToMessageDecoder.java:318) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:444) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.handler.timeout.IdleStateHandler.channelRead(IdleStateHandler.java:286) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:442) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.fireChannelRead(AbstractChannelHandlerContext.java:412) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline$HeadContext.channelRead(DefaultChannelPipeline.java:1410) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:440) at org.apache.hbase.thirdparty.io.netty.channel.AbstractChannelHandlerContext.invokeChannelRead(AbstractChannelHandlerContext.java:420) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPipeline.fireChannelRead(DefaultChannelPipeline.java:919) at org.apache.hbase.thirdparty.io.netty.channel.nio.AbstractNioByteChannel$NioByteUnsafe.read(AbstractNioByteChannel.java:166) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKey(NioEventLoop.java:788) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeysOptimized(NioEventLoop.java:724) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.processSelectedKeys(NioEventLoop.java:650) at org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:562) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) ... 1 more 2024-04-20 03:00:22,699 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 03:00:22,699 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-20 03:00:22,699 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713617964020 bypass), TestNs=QuotaState(ts=1713617964020 bypass)} 2024-04-20 03:00:22,699 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(217): {TestNs:TestTable=QuotaState(ts=1713617964020 bypass), TestQuotaAdmin2=QuotaState(ts=1713617964020 bypass)} 2024-04-20 03:00:22,699 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(218): {} 2024-04-20 03:00:22,699 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713617964020 bypass)} 2024-04-20 03:00:22,949 INFO [Listener at localhost/35709] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2024-04-20 03:00:22,950 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(215): QuotaCache 2024-04-20 03:00:22,950 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(216): {default=QuotaState(ts=1713617964020 bypass), TestNs=QuotaState(ts=1713617964020 bypass)} 2024-04-20 03:00:22,950 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(217): {TestQuotaAdmin0=QuotaState(ts=1713617964020 bypass), TestNs:TestTable=QuotaState(ts=1713617964020 bypass), TestQuotaAdmin1=QuotaState(ts=1713617964020 bypass)} 2024-04-20 03:00:22,950 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(218): {jenkins=UserQuotaState(ts=1713617964020 bypass)} 2024-04-20 03:00:22,950 DEBUG [Listener at localhost/35709] quotas.ThrottleQuotaTestUtil(219): {all=QuotaState(ts=1713617964020 bypass)} 2024-04-20 03:00:22,963 INFO [Listener at localhost/35709] hbase.ResourceChecker(175): after: quotas.TestClusterScopeQuotaThrottle#testNamespaceClusterScopeQuota Thread=266 (was 282), OpenFileDescriptor=583 (was 592), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=155 (was 174), ProcessCount=169 (was 169), AvailableMemoryMB=8421 (was 8426) 2024-04-20 03:00:22,965 INFO [Listener at localhost/35709] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin0 2024-04-20 03:00:22,969 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin0 2024-04-20 03:00:22,976 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] procedure2.ProcedureExecutor(1075): Stored pid=27, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin0 2024-04-20 03:00:22,980 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713582022980"}]},"ts":"1713582022980"} 2024-04-20 03:00:22,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-04-20 03:00:22,982 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLING in hbase:meta 2024-04-20 03:00:22,984 INFO [PEWorker-4] procedure.DisableTableProcedure(293): Set TestQuotaAdmin0 to state=DISABLING 2024-04-20 03:00:22,986 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=76bb885c3f8f7a19b203a07471b7edad, UNASSIGN}] 2024-04-20 03:00:22,987 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin0, region=76bb885c3f8f7a19b203a07471b7edad, UNASSIGN 2024-04-20 03:00:22,988 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=76bb885c3f8f7a19b203a07471b7edad, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 03:00:22,988 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713582022987"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713582022987"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713582022987"}]},"ts":"1713582022987"} 2024-04-20 03:00:22,990 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure 76bb885c3f8f7a19b203a07471b7edad, server=jenkins-hbase4.apache.org,43007,1713581956960}] 2024-04-20 03:00:23,136 ERROR [ProcedureDispatcherTimeoutThread] procedure2.RemoteProcedureDispatcher$TimeoutExecutorThread(324): DelayQueue for RemoteProcedureDispatcher is not empty when timed waiting elapsed. If this is repeated consistently, it means no element is getting expired from the queue and it might freeze the system. Queue: [containedObject=jenkins-hbase4.apache.org,43007,1713581956960, timeout=1713582023144, delay=8, operations=[pid=29, ppid=28, state=RUNNABLE; CloseRegionProcedure 76bb885c3f8f7a19b203a07471b7edad, server=jenkins-hbase4.apache.org,43007,1713581956960]] 2024-04-20 03:00:23,146 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 03:00:23,147 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 76bb885c3f8f7a19b203a07471b7edad 2024-04-20 03:00:23,148 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 76bb885c3f8f7a19b203a07471b7edad, disabling compactions & flushes 2024-04-20 03:00:23,148 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad. 2024-04-20 03:00:23,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad. 2024-04-20 03:00:23,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad. after waiting 0 ms 2024-04-20 03:00:23,149 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad. 2024-04-20 03:00:23,149 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 76bb885c3f8f7a19b203a07471b7edad 1/1 column families, dataSize=578 B heapSize=2.11 KB 2024-04-20 03:00:23,216 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=578 B at sequenceid=21 (bloomFilter=false), to=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/default/TestQuotaAdmin0/76bb885c3f8f7a19b203a07471b7edad/.tmp/cf/8ae5b2b622be4891b337972b03745aca 2024-04-20 03:00:23,232 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-04-20 03:00:23,265 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/default/TestQuotaAdmin0/76bb885c3f8f7a19b203a07471b7edad/.tmp/cf/8ae5b2b622be4891b337972b03745aca as hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/default/TestQuotaAdmin0/76bb885c3f8f7a19b203a07471b7edad/cf/8ae5b2b622be4891b337972b03745aca 2024-04-20 03:00:23,276 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/default/TestQuotaAdmin0/76bb885c3f8f7a19b203a07471b7edad/cf/8ae5b2b622be4891b337972b03745aca, entries=6, sequenceid=21, filesize=4.7 K 2024-04-20 03:00:23,278 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~578 B/578, heapSize ~2.09 KB/2144, currentSize=0 B/0 for 76bb885c3f8f7a19b203a07471b7edad in 129ms, sequenceid=21, compaction requested=false 2024-04-20 03:00:23,286 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/default/TestQuotaAdmin0/76bb885c3f8f7a19b203a07471b7edad/recovered.edits/24.seqid, newMaxSeqId=24, maxSeqId=1 2024-04-20 03:00:23,287 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad. 2024-04-20 03:00:23,288 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 76bb885c3f8f7a19b203a07471b7edad: 2024-04-20 03:00:23,290 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 76bb885c3f8f7a19b203a07471b7edad 2024-04-20 03:00:23,290 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=76bb885c3f8f7a19b203a07471b7edad, regionState=CLOSED 2024-04-20 03:00:23,290 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713582023290"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713582023290"}]},"ts":"1713582023290"} 2024-04-20 03:00:23,294 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=29, resume processing ppid=28 2024-04-20 03:00:23,294 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=29, ppid=28, state=SUCCESS; CloseRegionProcedure 76bb885c3f8f7a19b203a07471b7edad, server=jenkins-hbase4.apache.org,43007,1713581956960 in 302 msec 2024-04-20 03:00:23,296 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=28, resume processing ppid=27 2024-04-20 03:00:23,296 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin0, region=76bb885c3f8f7a19b203a07471b7edad, UNASSIGN in 308 msec 2024-04-20 03:00:23,297 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713582023297"}]},"ts":"1713582023297"} 2024-04-20 03:00:23,299 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin0, state=DISABLED in hbase:meta 2024-04-20 03:00:23,301 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set TestQuotaAdmin0 to state=DISABLED 2024-04-20 03:00:23,304 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=27, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin0 in 331 msec 2024-04-20 03:00:23,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2024-04-20 03:00:23,733 INFO [Listener at localhost/35709] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin0, procId: 27 completed 2024-04-20 03:00:23,737 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin0 2024-04-20 03:00:23,744 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] procedure2.ProcedureExecutor(1075): Stored pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin0 2024-04-20 03:00:23,746 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=30, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-04-20 03:00:23,748 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=30, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-04-20 03:00:23,752 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-04-20 03:00:23,754 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/default/TestQuotaAdmin0/76bb885c3f8f7a19b203a07471b7edad 2024-04-20 03:00:23,759 DEBUG [HFileArchiver-8] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/default/TestQuotaAdmin0/76bb885c3f8f7a19b203a07471b7edad/cf, FileablePath, hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/default/TestQuotaAdmin0/76bb885c3f8f7a19b203a07471b7edad/recovered.edits] 2024-04-20 03:00:23,768 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/default/TestQuotaAdmin0/76bb885c3f8f7a19b203a07471b7edad/cf/8ae5b2b622be4891b337972b03745aca to hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/archive/data/default/TestQuotaAdmin0/76bb885c3f8f7a19b203a07471b7edad/cf/8ae5b2b622be4891b337972b03745aca 2024-04-20 03:00:23,773 DEBUG [HFileArchiver-8] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/default/TestQuotaAdmin0/76bb885c3f8f7a19b203a07471b7edad/recovered.edits/24.seqid to hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/archive/data/default/TestQuotaAdmin0/76bb885c3f8f7a19b203a07471b7edad/recovered.edits/24.seqid 2024-04-20 03:00:23,774 DEBUG [HFileArchiver-8] backup.HFileArchiver(596): Deleted hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/default/TestQuotaAdmin0/76bb885c3f8f7a19b203a07471b7edad 2024-04-20 03:00:23,774 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin0 regions 2024-04-20 03:00:23,777 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=30, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-04-20 03:00:23,797 WARN [PEWorker-1] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin0 from hbase:meta 2024-04-20 03:00:23,800 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin0' descriptor. 2024-04-20 03:00:23,801 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=30, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-04-20 03:00:23,801 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin0' from region states. 2024-04-20 03:00:23,801 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1713582023801"}]},"ts":"9223372036854775807"} 2024-04-20 03:00:23,803 INFO [PEWorker-1] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-04-20 03:00:23,803 DEBUG [PEWorker-1] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 76bb885c3f8f7a19b203a07471b7edad, NAME => 'TestQuotaAdmin0,,1713581960105.76bb885c3f8f7a19b203a07471b7edad.', STARTKEY => '', ENDKEY => ''}] 2024-04-20 03:00:23,803 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin0' as deleted. 2024-04-20 03:00:23,803 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin0","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1713582023803"}]},"ts":"9223372036854775807"} 2024-04-20 03:00:23,805 INFO [PEWorker-1] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin0 state from META 2024-04-20 03:00:23,808 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(130): Finished pid=30, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin0 2024-04-20 03:00:23,809 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=30, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin0 in 69 msec 2024-04-20 03:00:24,003 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=30 2024-04-20 03:00:24,003 INFO [Listener at localhost/35709] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin0, procId: 30 completed 2024-04-20 03:00:24,004 INFO [Listener at localhost/35709] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin1 2024-04-20 03:00:24,004 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin1 2024-04-20 03:00:24,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] procedure2.ProcedureExecutor(1075): Stored pid=31, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin1 2024-04-20 03:00:24,009 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-04-20 03:00:24,009 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713582024009"}]},"ts":"1713582024009"} 2024-04-20 03:00:24,011 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLING in hbase:meta 2024-04-20 03:00:24,019 INFO [PEWorker-2] procedure.DisableTableProcedure(293): Set TestQuotaAdmin1 to state=DISABLING 2024-04-20 03:00:24,020 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=7a1ab58edfbcf60e96d5768bd727001f, UNASSIGN}] 2024-04-20 03:00:24,021 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=32, ppid=31, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin1, region=7a1ab58edfbcf60e96d5768bd727001f, UNASSIGN 2024-04-20 03:00:24,022 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=7a1ab58edfbcf60e96d5768bd727001f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 03:00:24,022 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin1,,1713581960911.7a1ab58edfbcf60e96d5768bd727001f.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713582024022"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713582024022"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713582024022"}]},"ts":"1713582024022"} 2024-04-20 03:00:24,024 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=33, ppid=32, state=RUNNABLE; CloseRegionProcedure 7a1ab58edfbcf60e96d5768bd727001f, server=jenkins-hbase4.apache.org,43007,1713581956960}] 2024-04-20 03:00:24,176 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 03:00:24,176 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 7a1ab58edfbcf60e96d5768bd727001f 2024-04-20 03:00:24,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 7a1ab58edfbcf60e96d5768bd727001f, disabling compactions & flushes 2024-04-20 03:00:24,177 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin1,,1713581960911.7a1ab58edfbcf60e96d5768bd727001f. 2024-04-20 03:00:24,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin1,,1713581960911.7a1ab58edfbcf60e96d5768bd727001f. 2024-04-20 03:00:24,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin1,,1713581960911.7a1ab58edfbcf60e96d5768bd727001f. after waiting 0 ms 2024-04-20 03:00:24,177 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin1,,1713581960911.7a1ab58edfbcf60e96d5768bd727001f. 2024-04-20 03:00:24,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/default/TestQuotaAdmin1/7a1ab58edfbcf60e96d5768bd727001f/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-04-20 03:00:24,185 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin1,,1713581960911.7a1ab58edfbcf60e96d5768bd727001f. 2024-04-20 03:00:24,185 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 7a1ab58edfbcf60e96d5768bd727001f: 2024-04-20 03:00:24,187 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 7a1ab58edfbcf60e96d5768bd727001f 2024-04-20 03:00:24,188 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=32 updating hbase:meta row=7a1ab58edfbcf60e96d5768bd727001f, regionState=CLOSED 2024-04-20 03:00:24,188 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin1,,1713581960911.7a1ab58edfbcf60e96d5768bd727001f.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713582024188"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713582024188"}]},"ts":"1713582024188"} 2024-04-20 03:00:24,192 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=33, resume processing ppid=32 2024-04-20 03:00:24,192 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=33, ppid=32, state=SUCCESS; CloseRegionProcedure 7a1ab58edfbcf60e96d5768bd727001f, server=jenkins-hbase4.apache.org,43007,1713581956960 in 165 msec 2024-04-20 03:00:24,194 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=32, resume processing ppid=31 2024-04-20 03:00:24,194 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=32, ppid=31, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin1, region=7a1ab58edfbcf60e96d5768bd727001f, UNASSIGN in 172 msec 2024-04-20 03:00:24,195 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713582024195"}]},"ts":"1713582024195"} 2024-04-20 03:00:24,196 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin1, state=DISABLED in hbase:meta 2024-04-20 03:00:24,198 INFO [PEWorker-2] procedure.DisableTableProcedure(305): Set TestQuotaAdmin1 to state=DISABLED 2024-04-20 03:00:24,201 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=31, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin1 in 195 msec 2024-04-20 03:00:24,260 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=31 2024-04-20 03:00:24,260 INFO [Listener at localhost/35709] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin1, procId: 31 completed 2024-04-20 03:00:24,261 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin1 2024-04-20 03:00:24,262 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] procedure2.ProcedureExecutor(1075): Stored pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin1 2024-04-20 03:00:24,264 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=34, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-04-20 03:00:24,265 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=34, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-04-20 03:00:24,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-04-20 03:00:24,270 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/default/TestQuotaAdmin1/7a1ab58edfbcf60e96d5768bd727001f 2024-04-20 03:00:24,272 DEBUG [HFileArchiver-9] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/default/TestQuotaAdmin1/7a1ab58edfbcf60e96d5768bd727001f/cf, FileablePath, hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/default/TestQuotaAdmin1/7a1ab58edfbcf60e96d5768bd727001f/recovered.edits] 2024-04-20 03:00:24,281 DEBUG [HFileArchiver-9] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/default/TestQuotaAdmin1/7a1ab58edfbcf60e96d5768bd727001f/recovered.edits/4.seqid to hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/archive/data/default/TestQuotaAdmin1/7a1ab58edfbcf60e96d5768bd727001f/recovered.edits/4.seqid 2024-04-20 03:00:24,282 DEBUG [HFileArchiver-9] backup.HFileArchiver(596): Deleted hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/default/TestQuotaAdmin1/7a1ab58edfbcf60e96d5768bd727001f 2024-04-20 03:00:24,282 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin1 regions 2024-04-20 03:00:24,285 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=34, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-04-20 03:00:24,287 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin1 from hbase:meta 2024-04-20 03:00:24,289 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin1' descriptor. 2024-04-20 03:00:24,291 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=34, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-04-20 03:00:24,291 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin1' from region states. 2024-04-20 03:00:24,291 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1,,1713581960911.7a1ab58edfbcf60e96d5768bd727001f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1713582024291"}]},"ts":"9223372036854775807"} 2024-04-20 03:00:24,292 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-04-20 03:00:24,292 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 7a1ab58edfbcf60e96d5768bd727001f, NAME => 'TestQuotaAdmin1,,1713581960911.7a1ab58edfbcf60e96d5768bd727001f.', STARTKEY => '', ENDKEY => ''}] 2024-04-20 03:00:24,292 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin1' as deleted. 2024-04-20 03:00:24,292 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin1","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1713582024292"}]},"ts":"9223372036854775807"} 2024-04-20 03:00:24,294 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin1 state from META 2024-04-20 03:00:24,297 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=34, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin1 2024-04-20 03:00:24,298 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=34, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin1 in 36 msec 2024-04-20 03:00:24,518 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=34 2024-04-20 03:00:24,518 INFO [Listener at localhost/35709] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin1, procId: 34 completed 2024-04-20 03:00:24,519 INFO [Listener at localhost/35709] client.HBaseAdmin$15(890): Started disable of TestQuotaAdmin2 2024-04-20 03:00:24,519 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestQuotaAdmin2 2024-04-20 03:00:24,520 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] procedure2.ProcedureExecutor(1075): Stored pid=35, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestQuotaAdmin2 2024-04-20 03:00:24,523 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-04-20 03:00:24,524 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713582024524"}]},"ts":"1713582024524"} 2024-04-20 03:00:24,526 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLING in hbase:meta 2024-04-20 03:00:24,528 INFO [PEWorker-5] procedure.DisableTableProcedure(293): Set TestQuotaAdmin2 to state=DISABLING 2024-04-20 03:00:24,529 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=0f801c0048fc46c3107c1abc821ef574, UNASSIGN}] 2024-04-20 03:00:24,530 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestQuotaAdmin2, region=0f801c0048fc46c3107c1abc821ef574, UNASSIGN 2024-04-20 03:00:24,530 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=0f801c0048fc46c3107c1abc821ef574, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45079,1713581956918 2024-04-20 03:00:24,531 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestQuotaAdmin2,,1713581961688.0f801c0048fc46c3107c1abc821ef574.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713582024530"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713582024530"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713582024530"}]},"ts":"1713582024530"} 2024-04-20 03:00:24,532 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; CloseRegionProcedure 0f801c0048fc46c3107c1abc821ef574, server=jenkins-hbase4.apache.org,45079,1713581956918}] 2024-04-20 03:00:24,684 DEBUG [RSProcedureDispatcher-pool-5] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,45079,1713581956918 2024-04-20 03:00:24,685 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0f801c0048fc46c3107c1abc821ef574 2024-04-20 03:00:24,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0f801c0048fc46c3107c1abc821ef574, disabling compactions & flushes 2024-04-20 03:00:24,686 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestQuotaAdmin2,,1713581961688.0f801c0048fc46c3107c1abc821ef574. 2024-04-20 03:00:24,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestQuotaAdmin2,,1713581961688.0f801c0048fc46c3107c1abc821ef574. 2024-04-20 03:00:24,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestQuotaAdmin2,,1713581961688.0f801c0048fc46c3107c1abc821ef574. after waiting 0 ms 2024-04-20 03:00:24,686 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestQuotaAdmin2,,1713581961688.0f801c0048fc46c3107c1abc821ef574. 2024-04-20 03:00:24,692 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/default/TestQuotaAdmin2/0f801c0048fc46c3107c1abc821ef574/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-04-20 03:00:24,694 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestQuotaAdmin2,,1713581961688.0f801c0048fc46c3107c1abc821ef574. 2024-04-20 03:00:24,694 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0f801c0048fc46c3107c1abc821ef574: 2024-04-20 03:00:24,696 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0f801c0048fc46c3107c1abc821ef574 2024-04-20 03:00:24,696 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=0f801c0048fc46c3107c1abc821ef574, regionState=CLOSED 2024-04-20 03:00:24,696 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestQuotaAdmin2,,1713581961688.0f801c0048fc46c3107c1abc821ef574.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1713582024696"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713582024696"}]},"ts":"1713582024696"} 2024-04-20 03:00:24,700 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=37, resume processing ppid=36 2024-04-20 03:00:24,701 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=37, ppid=36, state=SUCCESS; CloseRegionProcedure 0f801c0048fc46c3107c1abc821ef574, server=jenkins-hbase4.apache.org,45079,1713581956918 in 166 msec 2024-04-20 03:00:24,703 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=36, resume processing ppid=35 2024-04-20 03:00:24,703 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=TestQuotaAdmin2, region=0f801c0048fc46c3107c1abc821ef574, UNASSIGN in 172 msec 2024-04-20 03:00:24,704 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713582024703"}]},"ts":"1713582024703"} 2024-04-20 03:00:24,705 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=TestQuotaAdmin2, state=DISABLED in hbase:meta 2024-04-20 03:00:24,707 INFO [PEWorker-5] procedure.DisableTableProcedure(305): Set TestQuotaAdmin2 to state=DISABLED 2024-04-20 03:00:24,709 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=35, state=SUCCESS; DisableTableProcedure table=TestQuotaAdmin2 in 189 msec 2024-04-20 03:00:24,775 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2024-04-20 03:00:24,775 INFO [Listener at localhost/35709] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:TestQuotaAdmin2, procId: 35 completed 2024-04-20 03:00:24,776 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestQuotaAdmin2 2024-04-20 03:00:24,777 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] procedure2.ProcedureExecutor(1075): Stored pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestQuotaAdmin2 2024-04-20 03:00:24,779 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=38, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-04-20 03:00:24,780 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=38, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-04-20 03:00:24,782 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-04-20 03:00:24,785 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/default/TestQuotaAdmin2/0f801c0048fc46c3107c1abc821ef574 2024-04-20 03:00:24,788 DEBUG [HFileArchiver-10] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/default/TestQuotaAdmin2/0f801c0048fc46c3107c1abc821ef574/cf, FileablePath, hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/default/TestQuotaAdmin2/0f801c0048fc46c3107c1abc821ef574/recovered.edits] 2024-04-20 03:00:24,796 DEBUG [HFileArchiver-10] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/default/TestQuotaAdmin2/0f801c0048fc46c3107c1abc821ef574/recovered.edits/4.seqid to hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/archive/data/default/TestQuotaAdmin2/0f801c0048fc46c3107c1abc821ef574/recovered.edits/4.seqid 2024-04-20 03:00:24,797 DEBUG [HFileArchiver-10] backup.HFileArchiver(596): Deleted hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/default/TestQuotaAdmin2/0f801c0048fc46c3107c1abc821ef574 2024-04-20 03:00:24,797 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived TestQuotaAdmin2 regions 2024-04-20 03:00:24,800 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=38, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-04-20 03:00:24,802 WARN [PEWorker-3] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of TestQuotaAdmin2 from hbase:meta 2024-04-20 03:00:24,804 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(421): Removing 'TestQuotaAdmin2' descriptor. 2024-04-20 03:00:24,805 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=38, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-04-20 03:00:24,805 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(411): Removing 'TestQuotaAdmin2' from region states. 2024-04-20 03:00:24,806 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2,,1713581961688.0f801c0048fc46c3107c1abc821ef574.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1713582024805"}]},"ts":"9223372036854775807"} 2024-04-20 03:00:24,807 INFO [PEWorker-3] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2024-04-20 03:00:24,807 DEBUG [PEWorker-3] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0f801c0048fc46c3107c1abc821ef574, NAME => 'TestQuotaAdmin2,,1713581961688.0f801c0048fc46c3107c1abc821ef574.', STARTKEY => '', ENDKEY => ''}] 2024-04-20 03:00:24,807 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(415): Marking 'TestQuotaAdmin2' as deleted. 2024-04-20 03:00:24,807 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestQuotaAdmin2","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1713582024807"}]},"ts":"9223372036854775807"} 2024-04-20 03:00:24,809 INFO [PEWorker-3] hbase.MetaTableAccessor(1658): Deleted table TestQuotaAdmin2 state from META 2024-04-20 03:00:24,811 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(130): Finished pid=38, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestQuotaAdmin2 2024-04-20 03:00:24,813 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=38, state=SUCCESS; DeleteTableProcedure table=TestQuotaAdmin2 in 35 msec 2024-04-20 03:00:25,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=38 2024-04-20 03:00:25,034 INFO [Listener at localhost/35709] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:TestQuotaAdmin2, procId: 38 completed 2024-04-20 03:00:25,034 INFO [Listener at localhost/35709] client.HBaseAdmin$15(890): Started disable of TestNs:TestTable 2024-04-20 03:00:25,035 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.HMaster$11(2424): Client=jenkins//172.31.14.131 disable TestNs:TestTable 2024-04-20 03:00:25,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] procedure2.ProcedureExecutor(1075): Stored pid=39, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=TestNs:TestTable 2024-04-20 03:00:25,039 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-04-20 03:00:25,039 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713582025039"}]},"ts":"1713582025039"} 2024-04-20 03:00:25,040 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLING in hbase:meta 2024-04-20 03:00:25,043 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set TestNs:TestTable to state=DISABLING 2024-04-20 03:00:25,043 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=0ac165ce85857a7f8639a49afe9d2bf9, UNASSIGN}, {pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=f60e93233ba9b2c52d52b41655d81bff, UNASSIGN}] 2024-04-20 03:00:25,044 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=0ac165ce85857a7f8639a49afe9d2bf9, UNASSIGN 2024-04-20 03:00:25,045 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=41, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=TestNs:TestTable, region=f60e93233ba9b2c52d52b41655d81bff, UNASSIGN 2024-04-20 03:00:25,045 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=0ac165ce85857a7f8639a49afe9d2bf9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,45079,1713581956918 2024-04-20 03:00:25,045 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,,1713581962738.0ac165ce85857a7f8639a49afe9d2bf9.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713582025045"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713582025045"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713582025045"}]},"ts":"1713582025045"} 2024-04-20 03:00:25,045 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=f60e93233ba9b2c52d52b41655d81bff, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 03:00:25,046 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"TestNs:TestTable,1,1713581962738.f60e93233ba9b2c52d52b41655d81bff.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713582025045"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1713582025045"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1713582025045"}]},"ts":"1713582025045"} 2024-04-20 03:00:25,047 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=42, ppid=40, state=RUNNABLE; CloseRegionProcedure 0ac165ce85857a7f8639a49afe9d2bf9, server=jenkins-hbase4.apache.org,45079,1713581956918}] 2024-04-20 03:00:25,048 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=43, ppid=41, state=RUNNABLE; CloseRegionProcedure f60e93233ba9b2c52d52b41655d81bff, server=jenkins-hbase4.apache.org,43007,1713581956960}] 2024-04-20 03:00:25,200 DEBUG [RSProcedureDispatcher-pool-3] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,45079,1713581956918 2024-04-20 03:00:25,200 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0ac165ce85857a7f8639a49afe9d2bf9 2024-04-20 03:00:25,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0ac165ce85857a7f8639a49afe9d2bf9, disabling compactions & flushes 2024-04-20 03:00:25,201 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,,1713581962738.0ac165ce85857a7f8639a49afe9d2bf9. 2024-04-20 03:00:25,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,,1713581962738.0ac165ce85857a7f8639a49afe9d2bf9. 2024-04-20 03:00:25,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,,1713581962738.0ac165ce85857a7f8639a49afe9d2bf9. after waiting 0 ms 2024-04-20 03:00:25,201 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,,1713581962738.0ac165ce85857a7f8639a49afe9d2bf9. 2024-04-20 03:00:25,202 DEBUG [RSProcedureDispatcher-pool-4] master.ServerManager(718): New admin connection to jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 03:00:25,202 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close f60e93233ba9b2c52d52b41655d81bff 2024-04-20 03:00:25,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f60e93233ba9b2c52d52b41655d81bff, disabling compactions & flushes 2024-04-20 03:00:25,203 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region TestNs:TestTable,1,1713581962738.f60e93233ba9b2c52d52b41655d81bff. 2024-04-20 03:00:25,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on TestNs:TestTable,1,1713581962738.f60e93233ba9b2c52d52b41655d81bff. 2024-04-20 03:00:25,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on TestNs:TestTable,1,1713581962738.f60e93233ba9b2c52d52b41655d81bff. after waiting 0 ms 2024-04-20 03:00:25,203 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region TestNs:TestTable,1,1713581962738.f60e93233ba9b2c52d52b41655d81bff. 2024-04-20 03:00:25,210 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/TestNs/TestTable/0ac165ce85857a7f8639a49afe9d2bf9/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-04-20 03:00:25,211 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/TestNs/TestTable/f60e93233ba9b2c52d52b41655d81bff/recovered.edits/4.seqid, newMaxSeqId=4, maxSeqId=1 2024-04-20 03:00:25,211 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,,1713581962738.0ac165ce85857a7f8639a49afe9d2bf9. 2024-04-20 03:00:25,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0ac165ce85857a7f8639a49afe9d2bf9: 2024-04-20 03:00:25,212 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed TestNs:TestTable,1,1713581962738.f60e93233ba9b2c52d52b41655d81bff. 2024-04-20 03:00:25,212 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f60e93233ba9b2c52d52b41655d81bff: 2024-04-20 03:00:25,214 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0ac165ce85857a7f8639a49afe9d2bf9 2024-04-20 03:00:25,214 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=0ac165ce85857a7f8639a49afe9d2bf9, regionState=CLOSED 2024-04-20 03:00:25,214 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,,1713581962738.0ac165ce85857a7f8639a49afe9d2bf9.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713582025214"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713582025214"}]},"ts":"1713582025214"} 2024-04-20 03:00:25,215 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed f60e93233ba9b2c52d52b41655d81bff 2024-04-20 03:00:25,215 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=41 updating hbase:meta row=f60e93233ba9b2c52d52b41655d81bff, regionState=CLOSED 2024-04-20 03:00:25,215 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"TestNs:TestTable,1,1713581962738.f60e93233ba9b2c52d52b41655d81bff.","families":{"info":[{"qualifier":"regioninfo","vlen":43,"tag":[],"timestamp":"1713582025215"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1713582025215"}]},"ts":"1713582025215"} 2024-04-20 03:00:25,218 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=42, resume processing ppid=40 2024-04-20 03:00:25,218 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=42, ppid=40, state=SUCCESS; CloseRegionProcedure 0ac165ce85857a7f8639a49afe9d2bf9, server=jenkins-hbase4.apache.org,45079,1713581956918 in 169 msec 2024-04-20 03:00:25,219 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=43, resume processing ppid=41 2024-04-20 03:00:25,219 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=43, ppid=41, state=SUCCESS; CloseRegionProcedure f60e93233ba9b2c52d52b41655d81bff, server=jenkins-hbase4.apache.org,43007,1713581956960 in 169 msec 2024-04-20 03:00:25,220 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=0ac165ce85857a7f8639a49afe9d2bf9, UNASSIGN in 175 msec 2024-04-20 03:00:25,221 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=41, resume processing ppid=39 2024-04-20 03:00:25,221 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=41, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=TestNs:TestTable, region=f60e93233ba9b2c52d52b41655d81bff, UNASSIGN in 176 msec 2024-04-20 03:00:25,222 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1713582025222"}]},"ts":"1713582025222"} 2024-04-20 03:00:25,223 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=TestNs:TestTable, state=DISABLED in hbase:meta 2024-04-20 03:00:25,226 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set TestNs:TestTable to state=DISABLED 2024-04-20 03:00:25,228 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=39, state=SUCCESS; DisableTableProcedure table=TestNs:TestTable in 191 msec 2024-04-20 03:00:25,290 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2024-04-20 03:00:25,290 INFO [Listener at localhost/35709] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: TestNs:TestTable, procId: 39 completed 2024-04-20 03:00:25,291 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.HMaster$5(2234): Client=jenkins//172.31.14.131 delete TestNs:TestTable 2024-04-20 03:00:25,292 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] procedure2.ProcedureExecutor(1075): Stored pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=TestNs:TestTable 2024-04-20 03:00:25,293 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=44, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-04-20 03:00:25,294 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=44, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-04-20 03:00:25,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-04-20 03:00:25,301 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/TestNs/TestTable/0ac165ce85857a7f8639a49afe9d2bf9 2024-04-20 03:00:25,301 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/TestNs/TestTable/f60e93233ba9b2c52d52b41655d81bff 2024-04-20 03:00:25,303 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/TestNs/TestTable/f60e93233ba9b2c52d52b41655d81bff/cf, FileablePath, hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/TestNs/TestTable/f60e93233ba9b2c52d52b41655d81bff/recovered.edits] 2024-04-20 03:00:25,304 DEBUG [HFileArchiver-11] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/TestNs/TestTable/0ac165ce85857a7f8639a49afe9d2bf9/cf, FileablePath, hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/TestNs/TestTable/0ac165ce85857a7f8639a49afe9d2bf9/recovered.edits] 2024-04-20 03:00:25,312 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/TestNs/TestTable/f60e93233ba9b2c52d52b41655d81bff/recovered.edits/4.seqid to hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/archive/data/TestNs/TestTable/f60e93233ba9b2c52d52b41655d81bff/recovered.edits/4.seqid 2024-04-20 03:00:25,312 DEBUG [HFileArchiver-11] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/TestNs/TestTable/0ac165ce85857a7f8639a49afe9d2bf9/recovered.edits/4.seqid to hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/archive/data/TestNs/TestTable/0ac165ce85857a7f8639a49afe9d2bf9/recovered.edits/4.seqid 2024-04-20 03:00:25,312 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/TestNs/TestTable/f60e93233ba9b2c52d52b41655d81bff 2024-04-20 03:00:25,313 DEBUG [HFileArchiver-11] backup.HFileArchiver(596): Deleted hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/.tmp/data/TestNs/TestTable/0ac165ce85857a7f8639a49afe9d2bf9 2024-04-20 03:00:25,313 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived TestNs:TestTable regions 2024-04-20 03:00:25,316 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=44, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-04-20 03:00:25,318 WARN [PEWorker-4] procedure.DeleteTableProcedure(384): Deleting some vestigial 2 rows of TestNs:TestTable from hbase:meta 2024-04-20 03:00:25,319 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(421): Removing 'TestNs:TestTable' descriptor. 2024-04-20 03:00:25,321 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=44, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-04-20 03:00:25,321 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(411): Removing 'TestNs:TestTable' from region states. 2024-04-20 03:00:25,321 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,,1713581962738.0ac165ce85857a7f8639a49afe9d2bf9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1713582025321"}]},"ts":"9223372036854775807"} 2024-04-20 03:00:25,321 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable,1,1713581962738.f60e93233ba9b2c52d52b41655d81bff.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1713582025321"}]},"ts":"9223372036854775807"} 2024-04-20 03:00:25,323 INFO [PEWorker-4] hbase.MetaTableAccessor(1788): Deleted 2 regions from META 2024-04-20 03:00:25,323 DEBUG [PEWorker-4] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 0ac165ce85857a7f8639a49afe9d2bf9, NAME => 'TestNs:TestTable,,1713581962738.0ac165ce85857a7f8639a49afe9d2bf9.', STARTKEY => '', ENDKEY => '1'}, {ENCODED => f60e93233ba9b2c52d52b41655d81bff, NAME => 'TestNs:TestTable,1,1713581962738.f60e93233ba9b2c52d52b41655d81bff.', STARTKEY => '1', ENDKEY => ''}] 2024-04-20 03:00:25,323 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(415): Marking 'TestNs:TestTable' as deleted. 2024-04-20 03:00:25,323 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"TestNs:TestTable","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1713582025323"}]},"ts":"9223372036854775807"} 2024-04-20 03:00:25,325 INFO [PEWorker-4] hbase.MetaTableAccessor(1658): Deleted table TestNs:TestTable state from META 2024-04-20 03:00:25,328 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(130): Finished pid=44, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=TestNs:TestTable 2024-04-20 03:00:25,329 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=44, state=SUCCESS; DeleteTableProcedure table=TestNs:TestTable in 37 msec 2024-04-20 03:00:25,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=44 2024-04-20 03:00:25,548 INFO [Listener at localhost/35709] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: TestNs:TestTable, procId: 44 completed 2024-04-20 03:00:25,552 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.HMaster$17(3092): Client=jenkins//172.31.14.131 delete TestNs 2024-04-20 03:00:25,559 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] procedure2.ProcedureExecutor(1075): Stored pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE; DeleteNamespaceProcedure, namespace=TestNs 2024-04-20 03:00:25,561 INFO [PEWorker-5] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_PREPARE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-04-20 03:00:25,563 INFO [PEWorker-5] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_FROM_NS_TABLE, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-04-20 03:00:25,565 INFO [PEWorker-5] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_FROM_ZK, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-04-20 03:00:25,566 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-04-20 03:00:25,567 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/namespace/TestNs 2024-04-20 03:00:25,567 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2024-04-20 03:00:25,568 INFO [PEWorker-5] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_DELETE_DIRECTORIES, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-04-20 03:00:25,570 INFO [PEWorker-5] procedure.DeleteNamespaceProcedure(73): pid=45, state=RUNNABLE:DELETE_NAMESPACE_REMOVE_NAMESPACE_QUOTA, locked=true; DeleteNamespaceProcedure, namespace=TestNs 2024-04-20 03:00:25,572 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=45, state=SUCCESS; DeleteNamespaceProcedure, namespace=TestNs in 17 msec 2024-04-20 03:00:25,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=35099] master.MasterRpcServices(1230): Checking to see if procedure is done pid=45 2024-04-20 03:00:25,817 INFO [Listener at localhost/35709] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2024-04-20 03:00:25,818 INFO [Listener at localhost/35709] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-04-20 03:00:25,818 DEBUG [Listener at localhost/35709] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x57016e43 to 127.0.0.1:50743 2024-04-20 03:00:25,818 DEBUG [Listener at localhost/35709] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-20 03:00:25,818 DEBUG [Listener at localhost/35709] util.JVMClusterUtil(237): Shutting down HBase Cluster 2024-04-20 03:00:25,819 DEBUG [Listener at localhost/35709] util.JVMClusterUtil(257): Found active master hash=95482937, stopped=false 2024-04-20 03:00:25,819 DEBUG [Listener at localhost/35709] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-04-20 03:00:25,819 INFO [Listener at localhost/35709] master.ServerManager(904): Cluster shutdown requested of master=jenkins-hbase4.apache.org,35099,1713581955774 2024-04-20 03:00:25,823 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): regionserver:45079-0x1011ed25edb0001, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-04-20 03:00:25,824 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-04-20 03:00:25,824 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): regionserver:43007-0x1011ed25edb0002, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2024-04-20 03:00:25,824 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-20 03:00:25,824 INFO [Listener at localhost/35709] procedure2.ProcedureExecutor(675): Stopping 2024-04-20 03:00:25,824 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-04-20 03:00:25,825 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:45079-0x1011ed25edb0001, quorum=127.0.0.1:50743, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-04-20 03:00:25,825 DEBUG [Listener at localhost/35709] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4ff526db to 127.0.0.1:50743 2024-04-20 03:00:25,825 DEBUG [Listener at localhost/35709] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-20 03:00:25,825 INFO [Listener at localhost/35709] regionserver.HRegionServer(2306): ***** STOPPING region server 'jenkins-hbase4.apache.org,45079,1713581956918' ***** 2024-04-20 03:00:25,825 INFO [Listener at localhost/35709] regionserver.HRegionServer(2320): STOPPED: Shutdown requested 2024-04-20 03:00:25,825 INFO [Listener at localhost/35709] regionserver.HRegionServer(2306): ***** STOPPING region server 'jenkins-hbase4.apache.org,43007,1713581956960' ***** 2024-04-20 03:00:25,825 INFO [Listener at localhost/35709] regionserver.HRegionServer(2320): STOPPED: Shutdown requested 2024-04-20 03:00:25,826 INFO [RS:0;jenkins-hbase4:45079] regionserver.HeapMemoryManager(220): Stopping 2024-04-20 03:00:25,826 INFO [RS:1;jenkins-hbase4:43007] regionserver.HeapMemoryManager(220): Stopping 2024-04-20 03:00:25,826 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:43007-0x1011ed25edb0002, quorum=127.0.0.1:50743, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2024-04-20 03:00:25,826 INFO [RS:1;jenkins-hbase4:43007] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-04-20 03:00:25,826 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-04-20 03:00:25,826 INFO [RS:1;jenkins-hbase4:43007] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-04-20 03:00:25,826 INFO [RS:1;jenkins-hbase4:43007] regionserver.HRegionServer(3314): Received CLOSE for a77ab8549b52a7b4adb27fc00548978e 2024-04-20 03:00:25,827 INFO [RS:0;jenkins-hbase4:45079] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2024-04-20 03:00:25,827 INFO [RS:1;jenkins-hbase4:43007] regionserver.HRegionServer(3314): Received CLOSE for 6f97c96a34d5ef54189957174fac767e 2024-04-20 03:00:25,827 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2024-04-20 03:00:25,827 INFO [RS:0;jenkins-hbase4:45079] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2024-04-20 03:00:25,828 INFO [RS:1;jenkins-hbase4:43007] regionserver.HRegionServer(1150): stopping server jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 03:00:25,828 INFO [RS:1;jenkins-hbase4:43007] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-04-20 03:00:25,828 DEBUG [RS:1;jenkins-hbase4:43007] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x335d010c to 127.0.0.1:50743 2024-04-20 03:00:25,828 DEBUG [RS:1;jenkins-hbase4:43007] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-20 03:00:25,828 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a77ab8549b52a7b4adb27fc00548978e, disabling compactions & flushes 2024-04-20 03:00:25,828 INFO [RS:0;jenkins-hbase4:45079] regionserver.HRegionServer(1150): stopping server jenkins-hbase4.apache.org,45079,1713581956918 2024-04-20 03:00:25,828 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:quota,,1713581959563.a77ab8549b52a7b4adb27fc00548978e. 2024-04-20 03:00:25,829 INFO [RS:1;jenkins-hbase4:43007] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-04-20 03:00:25,829 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:quota,,1713581959563.a77ab8549b52a7b4adb27fc00548978e. 2024-04-20 03:00:25,829 INFO [RS:0;jenkins-hbase4:45079] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2024-04-20 03:00:25,830 DEBUG [RS:0;jenkins-hbase4:45079] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x18f7687e to 127.0.0.1:50743 2024-04-20 03:00:25,830 DEBUG [RS:0;jenkins-hbase4:45079] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-20 03:00:25,830 INFO [RS:0;jenkins-hbase4:45079] regionserver.HRegionServer(1176): stopping server jenkins-hbase4.apache.org,45079,1713581956918; all regions closed. 2024-04-20 03:00:25,830 DEBUG [RS:0;jenkins-hbase4:45079] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-04-20 03:00:25,830 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:quota,,1713581959563.a77ab8549b52a7b4adb27fc00548978e. after waiting 0 ms 2024-04-20 03:00:25,829 INFO [RS:1;jenkins-hbase4:43007] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-04-20 03:00:25,831 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:quota,,1713581959563.a77ab8549b52a7b4adb27fc00548978e. 2024-04-20 03:00:25,831 INFO [RS:1;jenkins-hbase4:43007] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-04-20 03:00:25,831 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing a77ab8549b52a7b4adb27fc00548978e 2/2 column families, dataSize=726 B heapSize=2.44 KB 2024-04-20 03:00:25,831 INFO [RS:1;jenkins-hbase4:43007] regionserver.HRegionServer(3314): Received CLOSE for 1588230740 2024-04-20 03:00:25,832 INFO [RS:1;jenkins-hbase4:43007] regionserver.HRegionServer(1480): Waiting on 3 regions to close 2024-04-20 03:00:25,832 DEBUG [RS:1;jenkins-hbase4:43007] regionserver.HRegionServer(1484): Online Regions={a77ab8549b52a7b4adb27fc00548978e=hbase:quota,,1713581959563.a77ab8549b52a7b4adb27fc00548978e., 1588230740=hbase:meta,,1.1588230740, 6f97c96a34d5ef54189957174fac767e=hbase:namespace,,1713581958851.6f97c96a34d5ef54189957174fac767e.} 2024-04-20 03:00:25,833 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2024-04-20 03:00:25,833 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2024-04-20 03:00:25,833 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2024-04-20 03:00:25,833 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2024-04-20 03:00:25,833 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2024-04-20 03:00:25,833 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=14.15 KB heapSize=25.10 KB 2024-04-20 03:00:25,835 DEBUG [RS:1;jenkins-hbase4:43007] regionserver.HRegionServer(1510): Waiting on 1588230740, 6f97c96a34d5ef54189957174fac767e, a77ab8549b52a7b4adb27fc00548978e 2024-04-20 03:00:25,851 DEBUG [RS:0;jenkins-hbase4:45079] wal.AbstractFSWAL(1030): Moved 1 WAL file(s) to /user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/oldWALs 2024-04-20 03:00:25,851 INFO [RS:0;jenkins-hbase4:45079] wal.AbstractFSWAL(1033): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C45079%2C1713581956918:(num 1713581958326) 2024-04-20 03:00:25,851 DEBUG [RS:0;jenkins-hbase4:45079] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-20 03:00:25,851 INFO [RS:0;jenkins-hbase4:45079] regionserver.LeaseManager(133): Closed leases 2024-04-20 03:00:25,851 INFO [RS:0;jenkins-hbase4:45079] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2024-04-20 03:00:25,852 INFO [RS:0;jenkins-hbase4:45079] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2024-04-20 03:00:25,852 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-04-20 03:00:25,852 INFO [RS:0;jenkins-hbase4:45079] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2024-04-20 03:00:25,852 INFO [RS:0;jenkins-hbase4:45079] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2024-04-20 03:00:25,853 INFO [RS:0;jenkins-hbase4:45079] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:45079 2024-04-20 03:00:25,862 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): regionserver:45079-0x1011ed25edb0001, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45079,1713581956918 2024-04-20 03:00:25,862 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-04-20 03:00:25,862 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): regionserver:43007-0x1011ed25edb0002, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,45079,1713581956918 2024-04-20 03:00:25,862 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): regionserver:45079-0x1011ed25edb0001, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-04-20 03:00:25,862 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): regionserver:43007-0x1011ed25edb0002, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-04-20 03:00:25,864 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,45079,1713581956918] 2024-04-20 03:00:25,864 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,45079,1713581956918; numProcessing=1 2024-04-20 03:00:25,867 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,45079,1713581956918 already deleted, retry=false 2024-04-20 03:00:25,867 INFO [RegionServerTracker-0] master.ServerManager(570): Cluster shutdown set; jenkins-hbase4.apache.org,45079,1713581956918 expired; onlineServers=1 2024-04-20 03:00:25,876 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=12.16 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/meta/1588230740/.tmp/info/ebf4d5ad3f57461f9bf8fdec441d6aaf 2024-04-20 03:00:25,878 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=597 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/quota/a77ab8549b52a7b4adb27fc00548978e/.tmp/q/c7b4d6a91d4f47d6a1d5c91d2603fe49 2024-04-20 03:00:25,887 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ebf4d5ad3f57461f9bf8fdec441d6aaf 2024-04-20 03:00:25,887 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c7b4d6a91d4f47d6a1d5c91d2603fe49 2024-04-20 03:00:25,905 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-04-20 03:00:25,905 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2024-04-20 03:00:25,910 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=478 B at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/meta/1588230740/.tmp/rep_barrier/8aa672f1355f4b00a3656bef6d1f57f5 2024-04-20 03:00:25,915 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=129 B at sequenceid=17 (bloomFilter=true), to=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/quota/a77ab8549b52a7b4adb27fc00548978e/.tmp/u/028181b5e1084a56addc159e6dc0c811 2024-04-20 03:00:25,918 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8aa672f1355f4b00a3656bef6d1f57f5 2024-04-20 03:00:25,926 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 028181b5e1084a56addc159e6dc0c811 2024-04-20 03:00:25,927 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/quota/a77ab8549b52a7b4adb27fc00548978e/.tmp/q/c7b4d6a91d4f47d6a1d5c91d2603fe49 as hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/quota/a77ab8549b52a7b4adb27fc00548978e/q/c7b4d6a91d4f47d6a1d5c91d2603fe49 2024-04-20 03:00:25,930 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: Master,sub=Coprocessor.Master.CP_org.apache.hadoop.hbase.quotas.MasterQuotasObserver 2024-04-20 03:00:25,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c7b4d6a91d4f47d6a1d5c91d2603fe49 2024-04-20 03:00:25,947 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/quota/a77ab8549b52a7b4adb27fc00548978e/q/c7b4d6a91d4f47d6a1d5c91d2603fe49, entries=5, sequenceid=17, filesize=5.1 K 2024-04-20 03:00:25,949 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/quota/a77ab8549b52a7b4adb27fc00548978e/.tmp/u/028181b5e1084a56addc159e6dc0c811 as hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/quota/a77ab8549b52a7b4adb27fc00548978e/u/028181b5e1084a56addc159e6dc0c811 2024-04-20 03:00:25,958 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=1.53 KB at sequenceid=66 (bloomFilter=false), to=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/meta/1588230740/.tmp/table/a5adf8caf2a146c0a1effc171b89f824 2024-04-20 03:00:25,960 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 028181b5e1084a56addc159e6dc0c811 2024-04-20 03:00:25,960 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/quota/a77ab8549b52a7b4adb27fc00548978e/u/028181b5e1084a56addc159e6dc0c811, entries=4, sequenceid=17, filesize=5.0 K 2024-04-20 03:00:25,962 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~726 B/726, heapSize ~2.41 KB/2464, currentSize=0 B/0 for a77ab8549b52a7b4adb27fc00548978e in 131ms, sequenceid=17, compaction requested=false 2024-04-20 03:00:25,966 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): regionserver:45079-0x1011ed25edb0001, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-04-20 03:00:25,966 INFO [RS:0;jenkins-hbase4:45079] regionserver.HRegionServer(1233): Exiting; stopping=jenkins-hbase4.apache.org,45079,1713581956918; zookeeper connection closed. 2024-04-20 03:00:25,966 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): regionserver:45079-0x1011ed25edb0001, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-04-20 03:00:25,967 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@10f312ee] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@10f312ee 2024-04-20 03:00:25,969 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a5adf8caf2a146c0a1effc171b89f824 2024-04-20 03:00:25,970 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/meta/1588230740/.tmp/info/ebf4d5ad3f57461f9bf8fdec441d6aaf as hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/meta/1588230740/info/ebf4d5ad3f57461f9bf8fdec441d6aaf 2024-04-20 03:00:25,978 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/quota/a77ab8549b52a7b4adb27fc00548978e/recovered.edits/20.seqid, newMaxSeqId=20, maxSeqId=1 2024-04-20 03:00:25,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:quota,,1713581959563.a77ab8549b52a7b4adb27fc00548978e. 2024-04-20 03:00:25,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a77ab8549b52a7b4adb27fc00548978e: 2024-04-20 03:00:25,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:quota,,1713581959563.a77ab8549b52a7b4adb27fc00548978e. 2024-04-20 03:00:25,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 6f97c96a34d5ef54189957174fac767e, disabling compactions & flushes 2024-04-20 03:00:25,980 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1713581958851.6f97c96a34d5ef54189957174fac767e. 2024-04-20 03:00:25,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1713581958851.6f97c96a34d5ef54189957174fac767e. 2024-04-20 03:00:25,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1713581958851.6f97c96a34d5ef54189957174fac767e. after waiting 0 ms 2024-04-20 03:00:25,980 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1713581958851.6f97c96a34d5ef54189957174fac767e. 2024-04-20 03:00:25,981 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 6f97c96a34d5ef54189957174fac767e 1/1 column families, dataSize=147 B heapSize=704 B 2024-04-20 03:00:25,982 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ebf4d5ad3f57461f9bf8fdec441d6aaf 2024-04-20 03:00:25,982 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/meta/1588230740/info/ebf4d5ad3f57461f9bf8fdec441d6aaf, entries=30, sequenceid=66, filesize=8.0 K 2024-04-20 03:00:25,984 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/meta/1588230740/.tmp/rep_barrier/8aa672f1355f4b00a3656bef6d1f57f5 as hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/meta/1588230740/rep_barrier/8aa672f1355f4b00a3656bef6d1f57f5 2024-04-20 03:00:25,996 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8aa672f1355f4b00a3656bef6d1f57f5 2024-04-20 03:00:25,996 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/meta/1588230740/rep_barrier/8aa672f1355f4b00a3656bef6d1f57f5, entries=5, sequenceid=66, filesize=5.3 K 2024-04-20 03:00:25,998 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/meta/1588230740/.tmp/table/a5adf8caf2a146c0a1effc171b89f824 as hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/meta/1588230740/table/a5adf8caf2a146c0a1effc171b89f824 2024-04-20 03:00:26,004 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=147 B at sequenceid=8 (bloomFilter=true), to=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/namespace/6f97c96a34d5ef54189957174fac767e/.tmp/info/4f08dc1a611948a48446773ab934e149 2024-04-20 03:00:26,009 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a5adf8caf2a146c0a1effc171b89f824 2024-04-20 03:00:26,009 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/meta/1588230740/table/a5adf8caf2a146c0a1effc171b89f824, entries=13, sequenceid=66, filesize=5.6 K 2024-04-20 03:00:26,010 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~14.15 KB/14494, heapSize ~25.05 KB/25656, currentSize=0 B/0 for 1588230740 in 177ms, sequenceid=66, compaction requested=false 2024-04-20 03:00:26,016 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4f08dc1a611948a48446773ab934e149 2024-04-20 03:00:26,018 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/namespace/6f97c96a34d5ef54189957174fac767e/.tmp/info/4f08dc1a611948a48446773ab934e149 as hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/namespace/6f97c96a34d5ef54189957174fac767e/info/4f08dc1a611948a48446773ab934e149 2024-04-20 03:00:26,021 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/meta/1588230740/recovered.edits/69.seqid, newMaxSeqId=69, maxSeqId=1 2024-04-20 03:00:26,022 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2024-04-20 03:00:26,022 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2024-04-20 03:00:26,022 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2024-04-20 03:00:26,023 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2024-04-20 03:00:26,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 4f08dc1a611948a48446773ab934e149 2024-04-20 03:00:26,028 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/namespace/6f97c96a34d5ef54189957174fac767e/info/4f08dc1a611948a48446773ab934e149, entries=3, sequenceid=8, filesize=5.0 K 2024-04-20 03:00:26,029 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~147 B/147, heapSize ~688 B/688, currentSize=0 B/0 for 6f97c96a34d5ef54189957174fac767e in 48ms, sequenceid=8, compaction requested=false 2024-04-20 03:00:26,035 DEBUG [RS:1;jenkins-hbase4:43007] regionserver.HRegionServer(1510): Waiting on 6f97c96a34d5ef54189957174fac767e 2024-04-20 03:00:26,036 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/data/hbase/namespace/6f97c96a34d5ef54189957174fac767e/recovered.edits/11.seqid, newMaxSeqId=11, maxSeqId=1 2024-04-20 03:00:26,037 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1713581958851.6f97c96a34d5ef54189957174fac767e. 2024-04-20 03:00:26,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 6f97c96a34d5ef54189957174fac767e: 2024-04-20 03:00:26,037 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1713581958851.6f97c96a34d5ef54189957174fac767e. 2024-04-20 03:00:26,157 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2024-04-20 03:00:26,157 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2024-04-20 03:00:26,235 INFO [RS:1;jenkins-hbase4:43007] regionserver.HRegionServer(1176): stopping server jenkins-hbase4.apache.org,43007,1713581956960; all regions closed. 2024-04-20 03:00:26,235 DEBUG [RS:1;jenkins-hbase4:43007] quotas.QuotaCache(100): Stopping QuotaRefresherChore chore. 2024-04-20 03:00:26,243 DEBUG [RS:1;jenkins-hbase4:43007] wal.AbstractFSWAL(1030): Moved 1 WAL file(s) to /user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/oldWALs 2024-04-20 03:00:26,243 INFO [RS:1;jenkins-hbase4:43007] wal.AbstractFSWAL(1033): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43007%2C1713581956960.meta:.meta(num 1713581958568) 2024-04-20 03:00:26,249 DEBUG [RS:1;jenkins-hbase4:43007] wal.AbstractFSWAL(1030): Moved 1 WAL file(s) to /user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/oldWALs 2024-04-20 03:00:26,249 INFO [RS:1;jenkins-hbase4:43007] wal.AbstractFSWAL(1033): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C43007%2C1713581956960:(num 1713581958326) 2024-04-20 03:00:26,249 DEBUG [RS:1;jenkins-hbase4:43007] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-20 03:00:26,250 INFO [RS:1;jenkins-hbase4:43007] regionserver.LeaseManager(133): Closed leases 2024-04-20 03:00:26,250 INFO [RS:1;jenkins-hbase4:43007] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactedHFilesCleaner, period=120000, unit=MILLISECONDS] on shutdown 2024-04-20 03:00:26,250 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-04-20 03:00:26,251 INFO [RS:1;jenkins-hbase4:43007] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43007 2024-04-20 03:00:26,253 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): regionserver:43007-0x1011ed25edb0002, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,43007,1713581956960 2024-04-20 03:00:26,253 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2024-04-20 03:00:26,254 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,43007,1713581956960] 2024-04-20 03:00:26,254 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,43007,1713581956960; numProcessing=2 2024-04-20 03:00:26,256 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,43007,1713581956960 already deleted, retry=false 2024-04-20 03:00:26,256 INFO [RegionServerTracker-0] master.ServerManager(570): Cluster shutdown set; jenkins-hbase4.apache.org,43007,1713581956960 expired; onlineServers=0 2024-04-20 03:00:26,256 INFO [RegionServerTracker-0] regionserver.HRegionServer(2306): ***** STOPPING region server 'jenkins-hbase4.apache.org,35099,1713581955774' ***** 2024-04-20 03:00:26,256 INFO [RegionServerTracker-0] regionserver.HRegionServer(2320): STOPPED: Cluster shutdown set; onlineServer=0 2024-04-20 03:00:26,257 DEBUG [M:0;jenkins-hbase4:35099] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@77107b97, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2024-04-20 03:00:26,257 INFO [M:0;jenkins-hbase4:35099] regionserver.HRegionServer(1150): stopping server jenkins-hbase4.apache.org,35099,1713581955774 2024-04-20 03:00:26,257 INFO [M:0;jenkins-hbase4:35099] regionserver.HRegionServer(1176): stopping server jenkins-hbase4.apache.org,35099,1713581955774; all regions closed. 2024-04-20 03:00:26,257 DEBUG [M:0;jenkins-hbase4:35099] ipc.AbstractRpcClient(489): Stopping rpc client 2024-04-20 03:00:26,257 DEBUG [M:0;jenkins-hbase4:35099] cleaner.LogCleaner(198): Cancelling LogCleaner 2024-04-20 03:00:26,258 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2024-04-20 03:00:26,258 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1713581958019] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1713581958019,5,FailOnTimeoutGroup] 2024-04-20 03:00:26,258 DEBUG [M:0;jenkins-hbase4:35099] cleaner.HFileCleaner(317): Stopping file delete threads 2024-04-20 03:00:26,258 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1713581958020] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1713581958020,5,FailOnTimeoutGroup] 2024-04-20 03:00:26,258 INFO [M:0;jenkins-hbase4:35099] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2024-04-20 03:00:26,258 INFO [M:0;jenkins-hbase4:35099] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2024-04-20 03:00:26,258 INFO [M:0;jenkins-hbase4:35099] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [ScheduledChore name=QuotaObserverChore, period=60000, unit=MILLISECONDS] on shutdown 2024-04-20 03:00:26,258 DEBUG [M:0;jenkins-hbase4:35099] master.HMaster(1517): Stopping service threads 2024-04-20 03:00:26,258 INFO [M:0;jenkins-hbase4:35099] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2024-04-20 03:00:26,259 ERROR [M:0;jenkins-hbase4:35099] procedure2.ProcedureExecutor(699): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-8,5,PEWorkerGroup] Thread[HFileArchiver-9,5,PEWorkerGroup] Thread[HFileArchiver-10,5,PEWorkerGroup] Thread[HFileArchiver-11,5,PEWorkerGroup] Thread[HFileArchiver-12,5,PEWorkerGroup] 2024-04-20 03:00:26,259 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2024-04-20 03:00:26,259 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2024-04-20 03:00:26,259 INFO [M:0;jenkins-hbase4:35099] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2024-04-20 03:00:26,259 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2024-04-20 03:00:26,259 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2024-04-20 03:00:26,260 DEBUG [M:0;jenkins-hbase4:35099] zookeeper.ZKUtil(399): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2024-04-20 03:00:26,260 WARN [M:0;jenkins-hbase4:35099] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2024-04-20 03:00:26,260 INFO [M:0;jenkins-hbase4:35099] assignment.AssignmentManager(315): Stopping assignment manager 2024-04-20 03:00:26,260 INFO [M:0;jenkins-hbase4:35099] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2024-04-20 03:00:26,261 DEBUG [M:0;jenkins-hbase4:35099] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2024-04-20 03:00:26,261 INFO [M:0;jenkins-hbase4:35099] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-20 03:00:26,261 DEBUG [M:0;jenkins-hbase4:35099] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-20 03:00:26,261 DEBUG [M:0;jenkins-hbase4:35099] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2024-04-20 03:00:26,261 DEBUG [M:0;jenkins-hbase4:35099] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-20 03:00:26,261 INFO [M:0;jenkins-hbase4:35099] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=152.93 KB heapSize=184.74 KB 2024-04-20 03:00:26,276 INFO [M:0;jenkins-hbase4:35099] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=152.93 KB at sequenceid=376 (bloomFilter=true), to=hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f91b6af1e8ec4900a536069163c641fe 2024-04-20 03:00:26,282 INFO [M:0;jenkins-hbase4:35099] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f91b6af1e8ec4900a536069163c641fe 2024-04-20 03:00:26,284 DEBUG [M:0;jenkins-hbase4:35099] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/f91b6af1e8ec4900a536069163c641fe as hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f91b6af1e8ec4900a536069163c641fe 2024-04-20 03:00:26,290 INFO [M:0;jenkins-hbase4:35099] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for f91b6af1e8ec4900a536069163c641fe 2024-04-20 03:00:26,291 INFO [M:0;jenkins-hbase4:35099] regionserver.HStore(1080): Added hdfs://localhost:38043/user/jenkins/test-data/4adef1e0-19ca-9c2d-fd39-326524d05da3/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/f91b6af1e8ec4900a536069163c641fe, entries=45, sequenceid=376, filesize=12.0 K 2024-04-20 03:00:26,291 INFO [M:0;jenkins-hbase4:35099] regionserver.HRegion(2948): Finished flush of dataSize ~152.93 KB/156601, heapSize ~184.73 KB/189160, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 30ms, sequenceid=376, compaction requested=false 2024-04-20 03:00:26,292 INFO [M:0;jenkins-hbase4:35099] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2024-04-20 03:00:26,292 DEBUG [M:0;jenkins-hbase4:35099] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2024-04-20 03:00:26,297 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2024-04-20 03:00:26,297 INFO [M:0;jenkins-hbase4:35099] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2024-04-20 03:00:26,298 INFO [M:0;jenkins-hbase4:35099] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:35099 2024-04-20 03:00:26,300 DEBUG [M:0;jenkins-hbase4:35099] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,35099,1713581955774 already deleted, retry=false 2024-04-20 03:00:26,355 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): regionserver:43007-0x1011ed25edb0002, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-04-20 03:00:26,355 INFO [RS:1;jenkins-hbase4:43007] regionserver.HRegionServer(1233): Exiting; stopping=jenkins-hbase4.apache.org,43007,1713581956960; zookeeper connection closed. 2024-04-20 03:00:26,355 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): regionserver:43007-0x1011ed25edb0002, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-04-20 03:00:26,356 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@7021f052] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@7021f052 2024-04-20 03:00:26,356 INFO [Listener at localhost/35709] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 2 regionserver(s) complete 2024-04-20 03:00:26,402 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-04-20 03:00:26,402 INFO [M:0;jenkins-hbase4:35099] regionserver.HRegionServer(1233): Exiting; stopping=jenkins-hbase4.apache.org,35099,1713581955774; zookeeper connection closed. 2024-04-20 03:00:26,402 DEBUG [Listener at localhost/35709-EventThread] zookeeper.ZKWatcher(600): master:35099-0x1011ed25edb0000, quorum=127.0.0.1:50743, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2024-04-20 03:00:26,403 WARN [Listener at localhost/35709] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-04-20 03:00:26,406 INFO [Listener at localhost/35709] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-04-20 03:00:26,512 WARN [BP-430630728-172.31.14.131-1713581952780 heartbeating to localhost/127.0.0.1:38043] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-04-20 03:00:26,513 WARN [BP-430630728-172.31.14.131-1713581952780 heartbeating to localhost/127.0.0.1:38043] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-430630728-172.31.14.131-1713581952780 (Datanode Uuid c84fb22b-f714-45a6-a157-1264496e319d) service to localhost/127.0.0.1:38043 2024-04-20 03:00:26,515 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/cluster_b090cd7a-7189-fe5a-cea3-7fbe879c9bbf/dfs/data/data3/current/BP-430630728-172.31.14.131-1713581952780] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-04-20 03:00:26,515 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/cluster_b090cd7a-7189-fe5a-cea3-7fbe879c9bbf/dfs/data/data4/current/BP-430630728-172.31.14.131-1713581952780] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-04-20 03:00:26,516 WARN [Listener at localhost/35709] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2024-04-20 03:00:26,518 INFO [Listener at localhost/35709] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-04-20 03:00:26,622 WARN [BP-430630728-172.31.14.131-1713581952780 heartbeating to localhost/127.0.0.1:38043] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2024-04-20 03:00:26,622 WARN [BP-430630728-172.31.14.131-1713581952780 heartbeating to localhost/127.0.0.1:38043] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-430630728-172.31.14.131-1713581952780 (Datanode Uuid 9fd8b0ce-b99d-4c35-944e-ade1edb86801) service to localhost/127.0.0.1:38043 2024-04-20 03:00:26,623 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/cluster_b090cd7a-7189-fe5a-cea3-7fbe879c9bbf/dfs/data/data1/current/BP-430630728-172.31.14.131-1713581952780] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-04-20 03:00:26,623 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/5dd3685c-6f0b-e87b-0c0d-cab705b7a48c/cluster_b090cd7a-7189-fe5a-cea3-7fbe879c9bbf/dfs/data/data2/current/BP-430630728-172.31.14.131-1713581952780] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2024-04-20 03:00:26,663 INFO [Listener at localhost/35709] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2024-04-20 03:00:26,778 INFO [Listener at localhost/35709] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2024-04-20 03:00:26,829 INFO [Listener at localhost/35709] hbase.HBaseTestingUtility(1293): Minicluster is down